-- Logs begin at Thu 2022-07-21 18:40:06 UTC, end at Thu 2022-07-21 19:53:02 UTC. -- Jul 21 19:13:47.940990 dv-cinder-749155-9-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 21 19:13:47.950885 dv-cinder-749155-9-smb devstack@keystone.service[80325]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 21 19:13:47.952859 dv-cinder-749155-9-smb devstack@keystone.service[80325]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 21 19:13:47 2022] *** Jul 21 19:13:47.952859 dv-cinder-749155-9-smb devstack@keystone.service[80325]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 21 19:13:47.952859 dv-cinder-749155-9-smb devstack@keystone.service[80325]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 21 19:13:47.952859 dv-cinder-749155-9-smb devstack@keystone.service[80325]: nodename: dv-cinder-749155-9-smb Jul 21 19:13:47.952859 dv-cinder-749155-9-smb devstack@keystone.service[80325]: machine: x86_64 Jul 21 19:13:47.952859 dv-cinder-749155-9-smb devstack@keystone.service[80325]: clock source: unix Jul 21 19:13:47.952859 dv-cinder-749155-9-smb devstack@keystone.service[80325]: pcre jit disabled Jul 21 19:13:47.952859 dv-cinder-749155-9-smb devstack@keystone.service[80325]: detected number of CPU cores: 4 Jul 21 19:13:47.952859 dv-cinder-749155-9-smb devstack@keystone.service[80325]: current working directory: / Jul 21 19:13:47.952859 dv-cinder-749155-9-smb devstack@keystone.service[80325]: detected binary path: /usr/bin/uwsgi-core Jul 21 19:13:47.952859 dv-cinder-749155-9-smb devstack@keystone.service[80325]: your processes number limit is 47680 Jul 21 19:13:47.953486 dv-cinder-749155-9-smb devstack@keystone.service[80325]: your memory page size is 4096 bytes Jul 21 19:13:47.953486 dv-cinder-749155-9-smb devstack@keystone.service[80325]: detected max file descriptor number: 2048 Jul 21 19:13:47.953486 dv-cinder-749155-9-smb devstack@keystone.service[80325]: lock engine: pthread robust mutexes Jul 21 19:13:47.953486 dv-cinder-749155-9-smb devstack@keystone.service[80325]: thunder lock: enabled Jul 21 19:13:47.953486 dv-cinder-749155-9-smb devstack@keystone.service[80325]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 21 19:13:47.953486 dv-cinder-749155-9-smb devstack@keystone.service[80325]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 21 19:13:47.998475 dv-cinder-749155-9-smb devstack@keystone.service[80325]: Python main interpreter initialized at 0x562ba790e9c0 Jul 21 19:13:47.998475 dv-cinder-749155-9-smb devstack@keystone.service[80325]: python threads support enabled Jul 21 19:13:47.998475 dv-cinder-749155-9-smb devstack@keystone.service[80325]: your server socket listen backlog is limited to 100 connections Jul 21 19:13:47.998475 dv-cinder-749155-9-smb devstack@keystone.service[80325]: your mercy for graceful operations on workers is 90 seconds Jul 21 19:13:47.998840 dv-cinder-749155-9-smb devstack@keystone.service[80325]: mapped 403077 bytes (393 KB) for 2 cores Jul 21 19:13:47.998916 dv-cinder-749155-9-smb devstack@keystone.service[80325]: *** Operational MODE: preforking *** Jul 21 19:13:47.999170 dv-cinder-749155-9-smb devstack@keystone.service[80325]: *** uWSGI is running in multiple interpreter mode *** Jul 21 19:13:47.999170 dv-cinder-749155-9-smb devstack@keystone.service[80325]: spawned uWSGI master process (pid: 80325) Jul 21 19:13:47.999372 dv-cinder-749155-9-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 21 19:13:48.000140 dv-cinder-749155-9-smb devstack@keystone.service[80325]: spawned uWSGI worker 1 (pid: 80338, cores: 1) Jul 21 19:13:48.003480 dv-cinder-749155-9-smb devstack@keystone.service[80325]: spawned uWSGI worker 2 (pid: 80339, cores: 1) Jul 21 19:13:48.003480 dv-cinder-749155-9-smb devstack@keystone.service[80325]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 21 19:13:53.532632 dv-cinder-749155-9-smb devstack@keystone.service[80338]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 19:13:53.532632 dv-cinder-749155-9-smb devstack@keystone.service[80338]: from cryptography.utils import int_from_bytes Jul 21 19:13:53.533366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 19:13:53.533366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: from cryptography.utils import int_from_bytes Jul 21 19:13:53.533785 dv-cinder-749155-9-smb devstack@keystone.service[80339]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 19:13:53.533785 dv-cinder-749155-9-smb devstack@keystone.service[80339]: from cryptography.utils import int_from_bytes Jul 21 19:13:53.534242 dv-cinder-749155-9-smb devstack@keystone.service[80339]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 19:13:53.534242 dv-cinder-749155-9-smb devstack@keystone.service[80339]: from cryptography.utils import int_from_bytes Jul 21 19:13:53.582864 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 19:13:53.583072 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 19:13:53.583288 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] command line args: [] {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 19:13:53.583611 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 19:13:53.583770 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 19:13:53.583857 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ================================================================================ {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 19:13:53.583978 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 19:13:53.584057 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] admin_token = **** {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.584173 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] command line args: [] {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 19:13:53.584332 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] config_dir = [] {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.584456 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 19:13:53.584559 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.584660 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ================================================================================ {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 19:13:53.584773 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] config_source = [] {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.584929 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] admin_token = **** {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.585012 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] debug = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.585199 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] config_dir = [] {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.585284 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.585447 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.585591 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.585682 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] config_source = [] {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.585782 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] debug = True {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.585875 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.586002 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.586131 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.586237 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.586337 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.586430 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.586597 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] list_limit = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.586714 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.586818 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] log_config_append = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.586953 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.587061 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.587179 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] list_limit = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.587286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] log_dir = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.587585 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] log_file = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.587681 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] log_config_append = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.587811 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.587912 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.587986 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] log_dir = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.588136 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.588216 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] log_file = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.588397 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.588473 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.588662 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.588748 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.588869 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.588953 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.589076 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.589158 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.589317 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.589442 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.589517 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.589641 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.589723 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.589862 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.589961 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.590101 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.590184 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.590334 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.590417 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.590563 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.590666 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.590808 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.590911 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.591049 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.591180 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.591310 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.591460 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.591820 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.592004 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] publish_errors = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.592088 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.592235 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.592463 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.592541 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.592663 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.592743 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] publish_errors = False {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.592872 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.592947 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.593102 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.593180 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.593270 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.593346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] standard_threads = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.593520 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.593598 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.593754 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.593831 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.593934 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.594015 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] standard_threads = False {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.594098 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] use_journal = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.594204 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.594281 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] use_json = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.594423 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] use_stderr = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.594500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.594595 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] use_syslog = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.594748 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.594820 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] use_journal = False {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.594888 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.594963 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] use_json = False {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.595039 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.595115 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] use_stderr = False {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.595262 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] use_syslog = False {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.595338 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.595518 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 19:13:53.595599 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.595770 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.595856 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.596007 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.596083 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.596242 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.596317 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.596487 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.596563 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.596720 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.596797 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.596959 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.597040 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.597202 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.597284 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.597436 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.597511 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.597665 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.597741 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.597905 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.597981 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.598124 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.598237 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.598367 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.598444 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.598608 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.598690 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.598843 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.598921 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.599090 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.599173 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.599337 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.599415 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.599597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.599676 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.599827 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.599902 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.600078 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.600231 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.600326 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.600401 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.600561 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.600637 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.600806 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.600893 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.601035 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.601118 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.601263 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.601339 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.601491 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.601577 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.601720 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.601797 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.601964 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.602039 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.602190 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.602274 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.602422 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.602498 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.602648 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.602726 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.602943 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.603089 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.603228 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.603333 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.603411 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.603609 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.603686 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.603862 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.603941 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.604102 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.604178 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.604334 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.604420 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.604561 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.604640 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.604789 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.604903 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.604999 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.605092 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.605228 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.605332 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.605459 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.605562 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.605687 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.605798 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.605916 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.606001 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.606146 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.606224 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.606369 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.606446 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.606598 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.606687 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.606828 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.606909 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.607061 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.607136 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.607287 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.607378 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.607540 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.607620 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.607773 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.607850 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.608005 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.608099 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.608236 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.608319 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.608464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.608540 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.608690 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.608776 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.608922 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.609004 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.609157 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.609237 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.609386 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.609472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.609615 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.609697 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.609863 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.609945 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.610093 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.610180 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.610321 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.610399 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.610548 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.610632 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.610783 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.610871 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.611028 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.611105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.611258 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.611335 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.611516 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.611679 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.611761 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.611833 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.611997 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.612075 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.612231 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.612315 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.612463 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.612539 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.612707 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.612789 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.612940 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.613030 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.613172 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.613258 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.613405 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.613481 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.613635 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.613711 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.613871 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.613958 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.614104 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.614181 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.614335 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.614418 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.614567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.614651 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.614801 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.614879 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.615039 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.615117 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.615274 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.615352 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.615528 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.615618 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.615773 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.615857 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.616007 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.616087 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.616240 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.616324 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.616470 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.616547 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.616699 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.616778 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.616926 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.617010 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.617154 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.617232 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.617386 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.617463 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.617609 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.617685 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.617837 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.617913 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.618066 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.618149 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.618295 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.618372 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.619044 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.619187 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.619327 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.619482 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.619617 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.619749 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.619849 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.619923 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.620003 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.620075 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] auth.external = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.620222 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.620300 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.620485 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.620563 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.620726 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.620806 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.620951 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] auth.password = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.621059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] auth.external = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.621180 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.621264 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] auth.token = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.621411 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.621489 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.621642 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.621727 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.621885 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.621963 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] auth.password = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.622112 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.622189 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] auth.token = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.622349 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.622427 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.622584 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.622662 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.622809 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.622886 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.623039 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] credential.caching = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.623119 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.623283 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.623368 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.623550 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.623631 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.623781 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.623862 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.624012 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] credential.caching = True {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.624090 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.624255 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.624331 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.624488 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.624567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.624734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.624811 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.624969 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.625046 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.625206 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.625284 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.625439 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.625515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.625704 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.625781 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.625932 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.626005 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.626180 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.626266 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.626414 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.626491 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.626668 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.626748 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.626899 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] federation.caching = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.626977 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.627130 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.627208 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.627373 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.627471 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.627641 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.627721 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.627871 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.627949 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] federation.caching = True {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.628117 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.628197 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.628351 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.628429 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.628607 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.628693 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.628839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.628916 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.629089 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.629167 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.629325 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.629411 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.629565 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.629642 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.629797 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] identity.caching = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.629876 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.630042 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.630128 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.630278 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.630354 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.630510 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.630587 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.630742 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] identity.caching = True {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.630827 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.630990 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.631095 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.631238 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.631316 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.631496 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.631592 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.631736 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.631815 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.632064 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.632140 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.632295 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.632385 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.632527 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.632605 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.632757 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.632842 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.632999 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.633085 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.633240 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.633316 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.633530 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.633618 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.633690 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.633770 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.633939 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.634018 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.634753 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.634901 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.635036 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.635130 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.635205 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.635264 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.635456 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.635538 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.635698 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.635786 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.635928 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.636007 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.636162 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.636239 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.636402 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.636487 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.636641 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.636720 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.636875 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.636951 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.637107 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.637193 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.637348 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.637425 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.637588 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.637665 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.637819 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.637909 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.638059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.638137 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.638302 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.638379 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.638532 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.638612 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.638766 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.638844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.638994 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.639079 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.639233 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.639312 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.639481 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.639562 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.639724 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.639802 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.639956 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.640037 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.640187 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.640265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.640422 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.640499 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.640665 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.640745 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.640890 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.640970 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.641117 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.641195 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.641364 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.641443 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.641609 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.641686 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.641839 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.641922 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.642067 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.642144 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.642295 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.642372 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.642529 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.user = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.642606 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.642767 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.642846 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.643000 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.643076 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.643235 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.643313 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.643486 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.user = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.643569 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.643728 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.643816 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.643976 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.644053 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.644207 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.644285 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.644434 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.644511 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.644668 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.644745 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.644899 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.644979 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.645131 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.645208 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.645358 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.645436 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.645590 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.645668 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.645831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.645909 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.646068 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.646145 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.646300 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.646379 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.646540 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.646624 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.646767 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.646846 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.647007 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.647086 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.647240 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.647319 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.647496 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.647578 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.647732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.647811 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.647962 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.648039 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.648201 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.648277 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.648436 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.648516 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.648669 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.648746 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.648901 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.648977 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.649124 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.649197 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.649371 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.649450 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.649604 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.649681 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.649875 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.649975 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.650102 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.650180 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.650345 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.650496 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.650583 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.650747 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.650826 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.650979 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.651058 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.651212 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.651298 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.651483 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] resource.caching = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.651567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.651720 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.651799 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.651951 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.652041 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.652186 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.652263 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] resource.caching = True {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.652434 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.652510 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.652676 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.652761 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.652907 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.652985 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.653149 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.653225 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.653383 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.653470 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.653613 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.653690 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.653842 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] role.caching = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.653919 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.654082 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.654160 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] role.driver = sql {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.654305 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.654382 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.654537 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] role.caching = True {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.654613 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.654782 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] role.driver = sql {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.654865 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.655015 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.655093 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.655259 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.655337 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.655524 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.655606 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.655772 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.655892 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.656018 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.656095 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.656261 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.656340 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.656490 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.656568 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.656735 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.656812 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.656979 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.657058 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.657206 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.657282 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.657452 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.657530 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.657700 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.657838 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.657945 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.658075 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.658191 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.658323 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.658569 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.658647 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.658812 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.658888 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.659056 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.659132 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.659291 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.659373 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.659561 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.659641 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.659809 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.659898 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.660040 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.660117 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.660268 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.660345 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.660498 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.660584 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.660727 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.660804 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.660974 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.661050 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.661208 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.661295 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.661441 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.661519 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.661673 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.661750 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.661903 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.661988 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.662128 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.662206 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.662358 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] token.caching = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.662436 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.662591 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.662680 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.662818 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.662895 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.663050 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] token.caching = True {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.663128 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.663283 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.663369 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.663553 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.663632 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.663788 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.663865 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.664025 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.664113 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.664263 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.664341 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.664498 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.664574 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.664730 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.664818 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.664963 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.665041 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.665192 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.665269 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.665477 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.665609 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.665914 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.666003 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.666077 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.666147 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.666310 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.666399 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.666562 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.666639 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.666792 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.666870 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] database.connection = **** {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.667040 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.667128 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.667306 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.667385 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.667563 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.667644 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] database.connection = **** {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.667802 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.667891 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.668034 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.668113 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.668262 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.668337 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.668486 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.668565 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.668718 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.668797 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.668963 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.669045 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.669198 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.669276 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.669430 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.669509 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.669664 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.669742 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.669894 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.669977 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.670128 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.670205 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.670358 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.670437 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.670581 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.670659 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.670816 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.670894 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.671047 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.671127 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.671205 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 19:13:53.671278 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.671519 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.671756 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 19:13:53.671925 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 19:13:53.703108 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:53.703277 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:53.703521 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:53.703607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:53.703758 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:53.703991 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:53.711857 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:53.712362 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:53.754955 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:53.755182 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:53.755354 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:53.755610 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:53.897911 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:53.898459 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:53.947580 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:53.947804 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:53.948704 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:53.948940 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:54.012547 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:54.012714 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:54.012796 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:54.012926 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:54.013011 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:54.013144 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:54.013227 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:54.013362 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:54.013445 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:54.013577 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:54.013660 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:54.013827 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:54.038364 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:54.038488 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:54.038617 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:54.038709 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:54.038819 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:54.038920 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:54.039044 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:54.039127 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:54.039259 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:54.039340 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:54.039496 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:54.039596 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:54.039714 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:54.039794 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:54.051338 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:54.051466 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:54.064713 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:54.064945 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:54.065035 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:54.065172 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:54.065256 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:54.065393 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:54.065477 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:54.065608 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:54.065690 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:54.065821 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:54.065902 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:54.066033 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:54.066115 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:54.066239 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 19:13:54.083309 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.083541 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 19:13:54.083688 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.083878 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.083960 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 19:13:54.084086 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 19:13:54.084216 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.084350 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.084435 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 19:13:54.084607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.084689 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.084863 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.084947 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.085115 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.085198 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.085380 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.096355 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.096599 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.096685 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.096870 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.096954 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.097135 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.097218 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.097415 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.105853 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 19:13:54.106011 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 19:13:54.109165 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 19:13:54.109283 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 19:13:54.109443 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.109540 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.109723 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.109806 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.110115 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.110199 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.110401 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.110485 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.110663 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.110745 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.110932 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.111014 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.111201 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.111283 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.111486 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.111570 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.111762 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.111856 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.112027 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.112108 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.138985 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.139363 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.140604 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 19:13:54.140881 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.140998 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 19:13:54.141275 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.146092 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 19:13:54.146366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.146529 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 19:13:54.146642 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.146805 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.147082 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.153900 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 19:13:54.154176 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.154488 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 19:13:54.154764 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.158751 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 19:13:54.159030 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.159308 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.159391 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 19:13:54.159614 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.159697 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.159887 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.159970 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.160153 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.160237 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.160415 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.160496 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.160675 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.160764 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.160958 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.161223 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.179909 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.180181 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.180908 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.182015 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.185352 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 19:13:54.186599 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 19:13:54.188964 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.189253 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.190243 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.190536 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.194213 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 19:13:54.195562 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 19:13:54.197864 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 19:13:54.199179 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 19:13:54.201799 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.202096 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.202385 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.202667 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.202938 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.203066 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.203219 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.203353 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.203524 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.203812 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.204089 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.204365 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.222568 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 19:13:54.222939 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.223205 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.223334 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 19:13:54.223504 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.223634 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.223907 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.224167 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.231958 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.232598 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.233652 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.233921 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.234292 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.234563 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.237037 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 19:13:54.237310 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.237581 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.237721 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 19:13:54.237900 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.238036 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.238168 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.238297 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.238435 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.238762 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.252019 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 19:13:54.252292 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.252580 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.252808 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 19:13:54.252942 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.253071 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.253197 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.253347 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.253475 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.253611 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.253738 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.253887 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.254172 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.254441 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.272798 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 19:13:54.273699 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 19:13:54.276801 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 19:13:54.277509 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 19:13:54.280105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.280845 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.281687 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.282428 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.283320 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 19:13:54.283606 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.283885 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.284074 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 19:13:54.284349 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.284631 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.291444 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.292246 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.293076 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 19:13:54.293862 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 19:13:54.296287 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.296573 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.296853 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.297107 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.297235 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.297392 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.297668 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.297937 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.307059 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 19:13:54.307340 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.307640 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.308092 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 19:13:54.308374 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.308647 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.315416 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 19:13:54.315717 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.315990 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.316256 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.316496 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 19:13:54.316580 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.316773 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.316856 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.317051 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.317133 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.317314 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.317398 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.317577 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.317658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.317837 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.317926 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.318099 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.318181 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.318362 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.318444 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.318619 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.318703 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.318880 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.318961 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.319141 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.319397 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.319688 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.319954 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 19:13:54.357252 dv-cinder-749155-9-smb devstack@keystone.service[80338]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562ba790e9c0 pid: 80338 (default app) Jul 21 19:13:54.358418 dv-cinder-749155-9-smb devstack@keystone.service[80339]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562ba790e9c0 pid: 80339 (default app) Jul 21 19:13:54.360603 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6635c-e89c-438c-b081-dd9475cc6393 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:13:54.360896 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6635c-e89c-438c-b081-dd9475cc6393 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:13:54.361174 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6635c-e89c-438c-b081-dd9475cc6393 None None] PATH_INFO: `/v3` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:13:54.365651 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 791 bytes} [Thu Jul 21 19:13:54 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:03.018355 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1f44d-9813-4665-aa4c-dbc7b697fbde None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:03.018911 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1f44d-9813-4665-aa4c-dbc7b697fbde None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:03.018911 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1f44d-9813-4665-aa4c-dbc7b697fbde None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:03.023235 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1/2] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 19:14:03.028670 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22d34d-ba27-4659-817c-23efcf3f525f None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:03.029090 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22d34d-ba27-4659-817c-23efcf3f525f None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:03.029224 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22d34d-ba27-4659-817c-23efcf3f525f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:03.097767 dv-cinder-749155-9-smb devstack@keystone.service[80338]: INFO dbcounter [None req-4a22d34d-ba27-4659-817c-23efcf3f525f None None] Registered counter for database keystone Jul 21 19:14:03.118959 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG oslo_db.sqlalchemy.engines [None req-4a22d34d-ba27-4659-817c-23efcf3f525f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80338) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 19:14:03.125839 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writer thread running {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 19:14:03.302553 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG passlib.handlers.bcrypt [None req-4a22d34d-ba27-4659-817c-23efcf3f525f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80338) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 21 19:14:03.302894 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG passlib.handlers.bcrypt [None req-4a22d34d-ba27-4659-817c-23efcf3f525f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80338) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 21 19:14:03.357955 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-4a22d34d-ba27-4659-817c-23efcf3f525f None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:03.359617 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-4a22d34d-ba27-4659-817c-23efcf3f525f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:03.481266 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 2/3] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 454 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 21 19:14:03.646865 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b1f44d-9813-4665-aa4c-dbc7b697fbde None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:03.717454 dv-cinder-749155-9-smb devstack@keystone.service[80339]: INFO dbcounter [None req-f7b1f44d-9813-4665-aa4c-dbc7b697fbde None None] Registered counter for database keystone Jul 21 19:14:03.740287 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG oslo_db.sqlalchemy.engines [None req-f7b1f44d-9813-4665-aa4c-dbc7b697fbde None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80339) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 19:14:03.746506 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writer thread running {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 19:14:03.871320 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b1f44d-9813-4665-aa4c-dbc7b697fbde None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:03.875640 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d969a-01a1-412b-b554-e5a36e833164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:03.876299 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d969a-01a1-412b-b554-e5a36e833164 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:03.876586 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d969a-01a1-412b-b554-e5a36e833164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:03.876865 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d969a-01a1-412b-b554-e5a36e833164 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:03.885580 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983d969a-01a1-412b-b554-e5a36e833164 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:03.936809 dv-cinder-749155-9-smb devstack@keystone.service[80339]: WARNING keystone.common.rbac_enforcer.enforcer [None req-983d969a-01a1-412b-b554-e5a36e833164 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 21 19:14:03.937095 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983d969a-01a1-412b-b554-e5a36e833164 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:03.946527 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 2/4] 10.222.0.60 () {58 vars in 1324 bytes} [Thu Jul 21 19:14:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 19:14:03.953118 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22d34d-ba27-4659-817c-23efcf3f525f None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:03.968283 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22d34d-ba27-4659-817c-23efcf3f525f None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:03.972706 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190052e-3778-4797-994f-520ee2038f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:03.973829 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190052e-3778-4797-994f-520ee2038f91 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:03.974124 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190052e-3778-4797-994f-520ee2038f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:03.974406 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190052e-3778-4797-994f-520ee2038f91 admin admin] PATH_INFO: `/v3/projects/c15ec98f010f4039a43acd913bc93061` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:03.978567 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5190052e-3778-4797-994f-520ee2038f91 admin admin] RBAC: Authorizing `identity:get_project(project_id=c15ec98f010f4039a43acd913bc93061)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:04.030575 dv-cinder-749155-9-smb devstack@keystone.service[80338]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5190052e-3778-4797-994f-520ee2038f91 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 21 19:14:04.031131 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5190052e-3778-4797-994f-520ee2038f91 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:04.035538 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 3/5] 10.222.0.60 () {56 vars in 1207 bytes} [Thu Jul 21 19:14:03 2022] GET /identity/v3/projects/c15ec98f010f4039a43acd913bc93061 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:06.040613 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cb997-1181-41b6-86a4-364518731eee None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:06.041716 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cb997-1181-41b6-86a4-364518731eee None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:06.041716 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cb997-1181-41b6-86a4-364518731eee None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:06.045945 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 3/6] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:14:06.051405 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a210fa-aa6e-4548-b9d9-5241af890b9d None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:06.051799 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a210fa-aa6e-4548-b9d9-5241af890b9d None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:06.052248 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a210fa-aa6e-4548-b9d9-5241af890b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:06.071151 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-f5a210fa-aa6e-4548-b9d9-5241af890b9d None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:06.072827 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f5a210fa-aa6e-4548-b9d9-5241af890b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:06.080552 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 4/7] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 21 19:14:06.102855 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1cb997-1181-41b6-86a4-364518731eee None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:06.115294 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1cb997-1181-41b6-86a4-364518731eee None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:06.120083 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be88de-35bc-437d-a5aa-8e414fc8007a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:06.120707 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be88de-35bc-437d-a5aa-8e414fc8007a admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:06.120992 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be88de-35bc-437d-a5aa-8e414fc8007a admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:06.121269 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be88de-35bc-437d-a5aa-8e414fc8007a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:06.128920 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3be88de-35bc-437d-a5aa-8e414fc8007a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:06.130691 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3be88de-35bc-437d-a5aa-8e414fc8007a admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:06.139348 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 4/8] 10.222.0.60 () {58 vars in 1324 bytes} [Thu Jul 21 19:14:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 19:14:06.144708 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a210fa-aa6e-4548-b9d9-5241af890b9d None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:06.153921 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a210fa-aa6e-4548-b9d9-5241af890b9d None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:06.158235 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645666e-6db1-4ebf-9c20-3988f4b3ddd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:06.159092 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645666e-6db1-4ebf-9c20-3988f4b3ddd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:06.159373 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645666e-6db1-4ebf-9c20-3988f4b3ddd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:06.159684 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645666e-6db1-4ebf-9c20-3988f4b3ddd5 admin admin] PATH_INFO: `/v3/users/9e09a8e247ab497cad13b7109b21b1c9` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:06.161059 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e645666e-6db1-4ebf-9c20-3988f4b3ddd5 admin admin] RBAC: Authorizing `identity:get_user(user_id=9e09a8e247ab497cad13b7109b21b1c9)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:06.162876 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e645666e-6db1-4ebf-9c20-3988f4b3ddd5 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:06.164461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 5/9] 10.222.0.60 () {56 vars in 1198 bytes} [Thu Jul 21 19:14:06 2022] GET /identity/v3/users/9e09a8e247ab497cad13b7109b21b1c9 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:08.241887 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d96d1-4771-4225-8d95-3b774d2e594c None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:08.242408 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d96d1-4771-4225-8d95-3b774d2e594c None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:08.242522 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d96d1-4771-4225-8d95-3b774d2e594c None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:08.243955 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 5/10] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:14:08.249194 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4873f-169f-4e13-83f7-b4e706a9c791 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:08.249617 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4873f-169f-4e13-83f7-b4e706a9c791 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:08.249761 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4873f-169f-4e13-83f7-b4e706a9c791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:08.266537 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-66b4873f-169f-4e13-83f7-b4e706a9c791 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:08.267760 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-66b4873f-169f-4e13-83f7-b4e706a9c791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:08.279615 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39395cd-0094-4bf8-a4da-44bac86f192e None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:08.279917 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39395cd-0094-4bf8-a4da-44bac86f192e None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:08.280200 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39395cd-0094-4bf8-a4da-44bac86f192e None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:08.281545 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 6/11] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 19:14:08.286557 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0f5e2-8fc6-4ed4-8113-3184ab459e8f None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:08.286848 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0f5e2-8fc6-4ed4-8113-3184ab459e8f None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:08.287132 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0f5e2-8fc6-4ed4-8113-3184ab459e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:08.327968 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG passlib.handlers.bcrypt [None req-b5c0f5e2-8fc6-4ed4-8113-3184ab459e8f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80339) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 21 19:14:08.328386 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG passlib.handlers.bcrypt [None req-b5c0f5e2-8fc6-4ed4-8113-3184ab459e8f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80339) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 21 19:14:08.350169 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 6/12] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 19:14:08.373461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4873f-169f-4e13-83f7-b4e706a9c791 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:08.374280 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-b5c0f5e2-8fc6-4ed4-8113-3184ab459e8f None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:08.375910 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-b5c0f5e2-8fc6-4ed4-8113-3184ab459e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:08.396915 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:08.478995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 7/13] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 19:14:08.482209 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4873f-169f-4e13-83f7-b4e706a9c791 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:08.500629 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0f5e2-8fc6-4ed4-8113-3184ab459e8f None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:08.515181 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800fdb27-334b-413e-9919-b0f7c757b9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:08.516009 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fdb27-334b-413e-9919-b0f7c757b9e4 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:08.516299 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fdb27-334b-413e-9919-b0f7c757b9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:08.516581 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fdb27-334b-413e-9919-b0f7c757b9e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:08.528273 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800fdb27-334b-413e-9919-b0f7c757b9e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:14:08.539374 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-800fdb27-334b-413e-9919-b0f7c757b9e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:14:08.539374 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:14:08.539374 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:14:08.539374 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:14:08.539374 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:14:08.539374 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:14:08.539374 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:14:08.539374 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:14:08.539374 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:14:08.539374 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:14:08.539374 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:14:08.539374 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:14:08.539374 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:14:08.539374 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:14:08.539374 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:14:08.539374 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:14:08.540509 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:14:08.540509 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:14:08.540509 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:14:08.540509 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:14:08.540509 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:14:08.540509 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:14:08.540509 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:14:08.540509 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:14:08.540509 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:14:08.540509 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:14:08.540509 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:14:08.540509 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:14:08.540509 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:14:08.540509 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:14:08.540509 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:14:08.540509 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:14:08.546722 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:14:08.546722 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:14:08.546722 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:14:08.546722 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:14:08.546722 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:14:08.546722 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:14:08.546722 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:14:08.546722 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:14:08.546722 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:14:08.546722 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:14:08.546722 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:14:08.546722 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:14:08.546722 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 7/14] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Jul 21 19:14:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:14:08.547661 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800fdb27-334b-413e-9919-b0f7c757b9e4 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:08.604497 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0f5e2-8fc6-4ed4-8113-3184ab459e8f None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:08.606697 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:08.632033 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:08.640574 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec9763-78b8-4475-a198-7d19f8fd0eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:08.641468 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec9763-78b8-4475-a198-7d19f8fd0eaa None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:08.641755 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec9763-78b8-4475-a198-7d19f8fd0eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:08.642034 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec9763-78b8-4475-a198-7d19f8fd0eaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:08.649942 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800fdb27-334b-413e-9919-b0f7c757b9e4 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:08.684727 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca7964-64e3-4b64-931d-148f4c2aab3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:08.685620 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca7964-64e3-4b64-931d-148f4c2aab3f None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:08.686323 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca7964-64e3-4b64-931d-148f4c2aab3f None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:08.686608 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca7964-64e3-4b64-931d-148f4c2aab3f None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:08.687361 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca7964-64e3-4b64-931d-148f4c2aab3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:08.687705 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca7964-64e3-4b64-931d-148f4c2aab3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:08.689113 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca7964-64e3-4b64-931d-148f4c2aab3f None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:08.700847 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 8/15] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:14:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:14:08.706322 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca7964-64e3-4b64-931d-148f4c2aab3f None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:08.709728 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cec9763-78b8-4475-a198-7d19f8fd0eaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:08.711261 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cec9763-78b8-4475-a198-7d19f8fd0eaa None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:08.804697 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca7964-64e3-4b64-931d-148f4c2aab3f None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:08.807826 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 8/16] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:14:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 19:14:08.814106 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec9763-78b8-4475-a198-7d19f8fd0eaa None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:08.816801 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:08.839557 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffee38b-5f28-42c8-9f8c-f4fc2e9cb901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:08.840434 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffee38b-5f28-42c8-9f8c-f4fc2e9cb901 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:08.840725 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffee38b-5f28-42c8-9f8c-f4fc2e9cb901 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:08.841027 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffee38b-5f28-42c8-9f8c-f4fc2e9cb901 None admin] PATH_INFO: `/v3/users/9e09a8e247ab497cad13b7109b21b1c9` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:08.842249 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffee38b-5f28-42c8-9f8c-f4fc2e9cb901 None admin] RBAC: Authorizing `identity:get_user(user_id=9e09a8e247ab497cad13b7109b21b1c9)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:08.843771 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffee38b-5f28-42c8-9f8c-f4fc2e9cb901 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:08.845398 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 9/17] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:14:08 2022] GET /identity/v3/users/9e09a8e247ab497cad13b7109b21b1c9 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:14:08.857533 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffee38b-5f28-42c8-9f8c-f4fc2e9cb901 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:08.871798 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:08.917166 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec9763-78b8-4475-a198-7d19f8fd0eaa None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:08.949542 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65549f-a0b5-4f7e-8bcf-6d5b4be72970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:08.950327 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65549f-a0b5-4f7e-8bcf-6d5b4be72970 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:08.950616 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65549f-a0b5-4f7e-8bcf-6d5b4be72970 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:08.950892 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65549f-a0b5-4f7e-8bcf-6d5b4be72970 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:08.956995 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffee38b-5f28-42c8-9f8c-f4fc2e9cb901 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:08.969375 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65549f-a0b5-4f7e-8bcf-6d5b4be72970 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:08.970834 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65549f-a0b5-4f7e-8bcf-6d5b4be72970 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:08.991383 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-7c65549f-a0b5-4f7e-8bcf-6d5b4be72970 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:14:08.991383 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:14:08.991383 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:14:08.991383 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:14:08.991383 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:14:08.991383 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:14:08.991383 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:14:08.991383 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:14:08.991383 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:14:08.991383 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:14:08.991383 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:14:08.991383 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:14:08.991383 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:14:08.991383 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:14:08.991383 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:14:08.992397 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:14:08.992397 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:14:08.992397 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:14:08.992397 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:14:08.992397 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:14:08.992397 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:14:08.992397 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:14:08.992397 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:14:08.992397 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:14:08.992397 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:14:08.992397 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:14:08.992397 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:14:08.992397 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:14:08.992397 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:14:08.992397 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:14:08.992397 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:14:08.992397 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:14:08.993280 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:14:08.993280 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:14:08.993280 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:14:08.993280 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:14:08.993491 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc5ba1-62a2-45d7-8403-a39198951ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:08.993581 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 9/18] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:14:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:14:08.993647 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc5ba1-62a2-45d7-8403-a39198951ffa None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:08.993647 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc5ba1-62a2-45d7-8403-a39198951ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:08.993647 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc5ba1-62a2-45d7-8403-a39198951ffa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:08.994878 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cc5ba1-62a2-45d7-8403-a39198951ffa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:08.996376 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cc5ba1-62a2-45d7-8403-a39198951ffa None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:08.997991 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 10/19] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:14:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:14:08.998913 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65549f-a0b5-4f7e-8bcf-6d5b4be72970 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:09.003454 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc5ba1-62a2-45d7-8403-a39198951ffa None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:09.055156 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:09.083237 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:09.097756 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65549f-a0b5-4f7e-8bcf-6d5b4be72970 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:09.102909 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc5ba1-62a2-45d7-8403-a39198951ffa None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:09.130953 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249dcb61-463e-4329-b6bf-703b168033c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:09.131653 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249dcb61-463e-4329-b6bf-703b168033c2 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:09.131939 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249dcb61-463e-4329-b6bf-703b168033c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:09.132222 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249dcb61-463e-4329-b6bf-703b168033c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:09.132952 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249dcb61-463e-4329-b6bf-703b168033c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:09.133263 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249dcb61-463e-4329-b6bf-703b168033c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:09.135175 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249dcb61-463e-4329-b6bf-703b168033c2 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:09.138642 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da42d98-6acf-4511-aef8-b6fccf3f8918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:09.139301 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da42d98-6acf-4511-aef8-b6fccf3f8918 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:09.139623 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da42d98-6acf-4511-aef8-b6fccf3f8918 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:09.139906 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da42d98-6acf-4511-aef8-b6fccf3f8918 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:09.140742 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da42d98-6acf-4511-aef8-b6fccf3f8918 None admin] RBAC: Adding query filter params (role.id=685e18230e1744c581baaf842d0fd4ca, scope.domain.id=default, user.id=9e09a8e247ab497cad13b7109b21b1c9) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:09.141057 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da42d98-6acf-4511-aef8-b6fccf3f8918 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:09.142510 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da42d98-6acf-4511-aef8-b6fccf3f8918 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:09.149370 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 11/20] 10.222.0.60 () {56 vars in 1322 bytes} [Thu Jul 21 19:14:09 2022] GET /identity/v3/role_assignments?user.id=9e09a8e247ab497cad13b7109b21b1c9&scope.domain.id=default&role.id=685e18230e1744c581baaf842d0fd4ca => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:14:09.153027 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 10/21] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:14:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:11.417953 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b05eff-e2de-4de5-8bc8-464b0241aab0 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:11.418830 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b05eff-e2de-4de5-8bc8-464b0241aab0 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:11.429484 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b05eff-e2de-4de5-8bc8-464b0241aab0 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:11.437679 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 12/22] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:11 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:14:11.442945 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507ae8c-85e5-415a-9a74-7169cef821b8 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:11.445977 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507ae8c-85e5-415a-9a74-7169cef821b8 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:11.445977 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507ae8c-85e5-415a-9a74-7169cef821b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:11.472494 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-0507ae8c-85e5-415a-9a74-7169cef821b8 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:11.473737 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-0507ae8c-85e5-415a-9a74-7169cef821b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:11.558483 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 11/23] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:14:11.592842 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b05eff-e2de-4de5-8bc8-464b0241aab0 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:11.728496 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b05eff-e2de-4de5-8bc8-464b0241aab0 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:11.770466 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8c02d-3d1c-4a56-8b07-772fbcc512c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:11.771261 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8c02d-3d1c-4a56-8b07-772fbcc512c6 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:11.771568 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8c02d-3d1c-4a56-8b07-772fbcc512c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:11.771845 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8c02d-3d1c-4a56-8b07-772fbcc512c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:11.784423 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e8c02d-3d1c-4a56-8b07-772fbcc512c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:14:11.792318 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-77e8c02d-3d1c-4a56-8b07-772fbcc512c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:14:11.792318 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:14:11.792318 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:14:11.792318 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:14:11.792318 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:14:11.792318 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:14:11.792318 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:14:11.792318 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:14:11.792318 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:14:11.792318 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:14:11.792318 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:14:11.792318 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:14:11.792318 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:14:11.792318 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:14:11.792318 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:14:11.792318 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:14:11.793151 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:14:11.793151 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:14:11.793151 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:14:11.793151 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:14:11.793151 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:14:11.793151 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:14:11.793151 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:14:11.793151 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:14:11.793151 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:14:11.793151 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:14:11.793151 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:14:11.793151 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:14:11.793151 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:14:11.793151 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:14:11.793151 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:14:11.793151 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:14:11.794337 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:14:11.794337 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:14:11.794337 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:14:11.794337 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:14:11.794337 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:14:11.794337 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:14:11.794337 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:14:11.794337 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:14:11.794337 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:14:11.794337 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:14:11.794337 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:14:11.794337 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:14:11.794337 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 13/24] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Jul 21 19:14:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:14:11.804532 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0507ae8c-85e5-415a-9a74-7169cef821b8 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:11.879821 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:11.934031 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0507ae8c-85e5-415a-9a74-7169cef821b8 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:11.970883 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12f5f1-e749-4969-8d52-0bc7abcc397a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:11.971597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12f5f1-e749-4969-8d52-0bc7abcc397a None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:11.971886 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12f5f1-e749-4969-8d52-0bc7abcc397a None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:11.972163 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12f5f1-e749-4969-8d52-0bc7abcc397a None admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:11.972922 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de12f5f1-e749-4969-8d52-0bc7abcc397a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:11.973230 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de12f5f1-e749-4969-8d52-0bc7abcc397a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:11.974629 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de12f5f1-e749-4969-8d52-0bc7abcc397a None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:11.989075 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 12/25] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:14:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:11.995333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8c02d-3d1c-4a56-8b07-772fbcc512c6 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:12.004536 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:12.054359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2dbe06-a5a7-4ccb-9fbf-61cd0d0dec48 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:12.054669 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2dbe06-a5a7-4ccb-9fbf-61cd0d0dec48 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:12.054945 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2dbe06-a5a7-4ccb-9fbf-61cd0d0dec48 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:12.056937 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 13/26] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 19:14:12.072898 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfefba3f-ec72-4265-8edf-78544adab4a3 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:12.073425 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfefba3f-ec72-4265-8edf-78544adab4a3 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:12.073846 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfefba3f-ec72-4265-8edf-78544adab4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:12.094491 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-cfefba3f-ec72-4265-8edf-78544adab4a3 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:12.096074 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-cfefba3f-ec72-4265-8edf-78544adab4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:12.138384 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8c02d-3d1c-4a56-8b07-772fbcc512c6 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:12.178590 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc9eb3-438d-4728-9ec5-0fa9774a845e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:12.180461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc9eb3-438d-4728-9ec5-0fa9774a845e None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:12.180927 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc9eb3-438d-4728-9ec5-0fa9774a845e None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:12.182490 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc9eb3-438d-4728-9ec5-0fa9774a845e None admin] PATH_INFO: `/v3/users/9e09a8e247ab497cad13b7109b21b1c9` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:12.184522 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfc9eb3-438d-4728-9ec5-0fa9774a845e None admin] RBAC: Authorizing `identity:get_user(user_id=9e09a8e247ab497cad13b7109b21b1c9)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:12.186700 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfc9eb3-438d-4728-9ec5-0fa9774a845e None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:12.188927 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 14/27] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:14:11 2022] GET /identity/v3/users/9e09a8e247ab497cad13b7109b21b1c9 => generated 247 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:14:12.190945 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f9db3-b22c-43bc-a418-0a2e89731415 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:12.191377 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f9db3-b22c-43bc-a418-0a2e89731415 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:12.191821 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f9db3-b22c-43bc-a418-0a2e89731415 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:12.193580 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 15/28] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:14:12.194717 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 14/29] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 21 19:14:12.195074 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d338f-88c5-4d95-bb08-c6394317293b None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:12.195593 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d338f-88c5-4d95-bb08-c6394317293b None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:12.195711 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfefba3f-ec72-4265-8edf-78544adab4a3 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:12.196187 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d338f-88c5-4d95-bb08-c6394317293b None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:12.198692 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 16/30] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:14:12.208853 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebc10c-4719-4cff-bd6f-1b64639ed4d3 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:12.209146 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebc10c-4719-4cff-bd6f-1b64639ed4d3 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:12.209428 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebc10c-4719-4cff-bd6f-1b64639ed4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:12.237138 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-31ebc10c-4719-4cff-bd6f-1b64639ed4d3 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:12.238334 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-31ebc10c-4719-4cff-bd6f-1b64639ed4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:12.260852 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:12.323696 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 17/31] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:14:12.325080 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d6b5d-372a-447f-9edc-c9f650a6aa23 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:12.325375 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d6b5d-372a-447f-9edc-c9f650a6aa23 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:12.325654 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d6b5d-372a-447f-9edc-c9f650a6aa23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:12.333257 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfefba3f-ec72-4265-8edf-78544adab4a3 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:12.336876 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:12.357947 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-cc6d6b5d-372a-447f-9edc-c9f650a6aa23 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:12.359142 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-cc6d6b5d-372a-447f-9edc-c9f650a6aa23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:12.376233 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee706d-c84b-446e-9033-6618d7fb1de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:12.377590 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee706d-c84b-446e-9033-6618d7fb1de9 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:12.378363 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee706d-c84b-446e-9033-6618d7fb1de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:12.378860 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee706d-c84b-446e-9033-6618d7fb1de9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:12.380884 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee706d-c84b-446e-9033-6618d7fb1de9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:12.383084 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee706d-c84b-446e-9033-6618d7fb1de9 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:12.387027 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 15/32] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:14:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:12.388292 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee706d-c84b-446e-9033-6618d7fb1de9 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:12.447473 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 18/33] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:14:12.447473 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d6b5d-372a-447f-9edc-c9f650a6aa23 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:12.543389 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee706d-c84b-446e-9033-6618d7fb1de9 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:12.553536 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:12.560677 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d6b5d-372a-447f-9edc-c9f650a6aa23 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:12.593020 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:12.597135 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d40b2-19f9-4254-ae32-c0d5f23a00f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:12.598080 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d40b2-19f9-4254-ae32-c0d5f23a00f6 None admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:12.598403 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d40b2-19f9-4254-ae32-c0d5f23a00f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:12.598676 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213fa74-c060-4249-9ec7-2f2fd194d079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:12.598802 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d40b2-19f9-4254-ae32-c0d5f23a00f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:12.599501 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d40b2-19f9-4254-ae32-c0d5f23a00f6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:12.599972 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213fa74-c060-4249-9ec7-2f2fd194d079 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:12.600426 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213fa74-c060-4249-9ec7-2f2fd194d079 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:12.600873 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213fa74-c060-4249-9ec7-2f2fd194d079 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:12.600969 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d40b2-19f9-4254-ae32-c0d5f23a00f6 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:12.612596 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d213fa74-c060-4249-9ec7-2f2fd194d079 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:12.614075 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d213fa74-c060-4249-9ec7-2f2fd194d079 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:12.634091 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-d213fa74-c060-4249-9ec7-2f2fd194d079 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:14:12.634091 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:14:12.634091 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:14:12.634091 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:14:12.634091 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:14:12.634091 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:14:12.634091 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:14:12.634091 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:14:12.634091 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:14:12.634091 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:14:12.634091 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:14:12.634091 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:14:12.634091 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:14:12.634091 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:14:12.634091 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:14:12.634996 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:14:12.634996 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:14:12.634996 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:14:12.634996 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:14:12.634996 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:14:12.634996 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:14:12.634996 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:14:12.634996 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:14:12.634996 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:14:12.634996 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:14:12.634996 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:14:12.634996 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:14:12.634996 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:14:12.634996 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:14:12.634996 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:14:12.634996 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:14:12.634996 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:14:12.636263 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:14:12.636263 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:14:12.636263 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:14:12.636263 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:14:12.639493 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 19/34] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:14:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:14:12.641125 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213fa74-c060-4249-9ec7-2f2fd194d079 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:12.752292 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213fa74-c060-4249-9ec7-2f2fd194d079 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:12.788746 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae88fb93-044c-4273-91b8-d6d9b21bfa9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:12.790003 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88fb93-044c-4273-91b8-d6d9b21bfa9a None admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:12.791006 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88fb93-044c-4273-91b8-d6d9b21bfa9a None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:12.791558 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88fb93-044c-4273-91b8-d6d9b21bfa9a None admin] PATH_INFO: `/v3/domains/default/users/9e09a8e247ab497cad13b7109b21b1c9/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:12.794038 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae88fb93-044c-4273-91b8-d6d9b21bfa9a None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=9e09a8e247ab497cad13b7109b21b1c9, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:12.795759 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae88fb93-044c-4273-91b8-d6d9b21bfa9a None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:12.813783 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 16/35] 10.222.0.60 () {60 vars in 1131 bytes} [Thu Jul 21 19:14:12 2022] POST /identity/v3/roles => generated 219 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:14:12.814824 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d40b2-19f9-4254-ae32-c0d5f23a00f6 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:12.941120 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d40b2-19f9-4254-ae32-c0d5f23a00f6 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:12.986739 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac0ced-a1e5-46e3-b485-6a42782d319d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:12.987429 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac0ced-a1e5-46e3-b485-6a42782d319d None admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:12.987839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac0ced-a1e5-46e3-b485-6a42782d319d None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:12.988119 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac0ced-a1e5-46e3-b485-6a42782d319d None admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:12.988874 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac0ced-a1e5-46e3-b485-6a42782d319d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:12.990385 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac0ced-a1e5-46e3-b485-6a42782d319d None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:13.028080 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 20/36] 10.222.0.60 () {58 vars in 1361 bytes} [Thu Jul 21 19:14:12 2022] PUT /identity/v3/domains/default/users/9e09a8e247ab497cad13b7109b21b1c9/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:14:13.029326 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae88fb93-044c-4273-91b8-d6d9b21bfa9a None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:13.090598 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:13.090766 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 17/37] 10.222.0.60 () {60 vars in 1131 bytes} [Thu Jul 21 19:14:12 2022] POST /identity/v3/roles => generated 225 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:14:13.092288 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda8240-ff54-4b10-8c34-29e2d0e9205d None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:13.092579 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda8240-ff54-4b10-8c34-29e2d0e9205d None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:13.092860 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda8240-ff54-4b10-8c34-29e2d0e9205d None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:13.094203 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 18/38] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:14:13.105017 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b496d-da2d-425e-8541-3b9edd26317c None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:13.105017 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b496d-da2d-425e-8541-3b9edd26317c None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:13.105017 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b496d-da2d-425e-8541-3b9edd26317c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:13.145592 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-909b496d-da2d-425e-8541-3b9edd26317c None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:13.151056 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-909b496d-da2d-425e-8541-3b9edd26317c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:13.203936 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:13.224658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae88fb93-044c-4273-91b8-d6d9b21bfa9a None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:13.269877 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 19/39] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 19:14:13.271011 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b289eda-2602-4ac8-9063-7560ce01c9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:13.272636 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b289eda-2602-4ac8-9063-7560ce01c9d9 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:13.272758 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabded9e-e393-4c11-b1c2-14a64c95b8d5 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:13.272758 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabded9e-e393-4c11-b1c2-14a64c95b8d5 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:13.272895 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabded9e-e393-4c11-b1c2-14a64c95b8d5 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:13.273386 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b289eda-2602-4ac8-9063-7560ce01c9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:13.273855 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b289eda-2602-4ac8-9063-7560ce01c9d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:13.274308 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 20/40] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:14:13.275528 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b289eda-2602-4ac8-9063-7560ce01c9d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:13.276071 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b289eda-2602-4ac8-9063-7560ce01c9d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:13.277903 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b289eda-2602-4ac8-9063-7560ce01c9d9 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:13.279496 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f02549-f5bf-4336-8bb7-61090aa187cc None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:13.279795 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f02549-f5bf-4336-8bb7-61090aa187cc None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:13.280147 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f02549-f5bf-4336-8bb7-61090aa187cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:13.298855 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-d6f02549-f5bf-4336-8bb7-61090aa187cc None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:13.300043 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-d6f02549-f5bf-4336-8bb7-61090aa187cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:13.304069 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 21/41] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:14:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:13.305330 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b289eda-2602-4ac8-9063-7560ce01c9d9 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:13.376335 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 21/42] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 19:14:13.377005 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f02549-f5bf-4336-8bb7-61090aa187cc None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:13.486024 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:13.502396 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f02549-f5bf-4336-8bb7-61090aa187cc None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:13.539004 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b289eda-2602-4ac8-9063-7560ce01c9d9 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:13.539538 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be985887-dfba-4264-88c6-c2de1c46496a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:13.540082 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be985887-dfba-4264-88c6-c2de1c46496a None admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:13.541003 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be985887-dfba-4264-88c6-c2de1c46496a None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:13.541187 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be985887-dfba-4264-88c6-c2de1c46496a None admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:13.541899 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be985887-dfba-4264-88c6-c2de1c46496a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:13.543104 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:13.543472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be985887-dfba-4264-88c6-c2de1c46496a None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:13.577859 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44f8f4-b42b-4d79-b86a-0097ccff4060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:13.578533 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44f8f4-b42b-4d79-b86a-0097ccff4060 None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:13.578819 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44f8f4-b42b-4d79-b86a-0097ccff4060 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:13.579100 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44f8f4-b42b-4d79-b86a-0097ccff4060 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:13.579886 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e44f8f4-b42b-4d79-b86a-0097ccff4060 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:13.581280 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e44f8f4-b42b-4d79-b86a-0097ccff4060 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:13.655364 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 22/43] 10.222.0.60 () {60 vars in 1141 bytes} [Thu Jul 21 19:14:13 2022] POST /identity/v3/projects => generated 301 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:14:13.656236 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be985887-dfba-4264-88c6-c2de1c46496a None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:13.693375 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 22/44] 10.222.0.60 () {60 vars in 1131 bytes} [Thu Jul 21 19:14:13 2022] POST /identity/v3/roles => generated 223 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:14:13.791734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be985887-dfba-4264-88c6-c2de1c46496a None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:13.840369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395fdd62-5f94-4f67-abed-fcbbad98cbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:13.841215 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395fdd62-5f94-4f67-abed-fcbbad98cbc5 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:13.841509 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395fdd62-5f94-4f67-abed-fcbbad98cbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:13.841791 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395fdd62-5f94-4f67-abed-fcbbad98cbc5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:13.843121 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395fdd62-5f94-4f67-abed-fcbbad98cbc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:13.844678 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395fdd62-5f94-4f67-abed-fcbbad98cbc5 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:13.846583 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 23/45] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:14:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:13.852383 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44f8f4-b42b-4d79-b86a-0097ccff4060 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:13.971634 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44f8f4-b42b-4d79-b86a-0097ccff4060 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:14.006507 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd88c48-2074-4c5c-9b7d-65ed7dcecd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:14.007167 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd88c48-2074-4c5c-9b7d-65ed7dcecd50 None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:14.007477 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd88c48-2074-4c5c-9b7d-65ed7dcecd50 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:14.007762 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd88c48-2074-4c5c-9b7d-65ed7dcecd50 None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:14.008463 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd88c48-2074-4c5c-9b7d-65ed7dcecd50 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:14.009985 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd88c48-2074-4c5c-9b7d-65ed7dcecd50 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:14.100438 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 23/46] 10.222.0.60 () {60 vars in 1141 bytes} [Thu Jul 21 19:14:13 2022] POST /identity/v3/projects => generated 312 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:14:15.180308 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51eccbe-f456-49c7-b087-8f87307ba966 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:15.180821 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51eccbe-f456-49c7-b087-8f87307ba966 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:15.180904 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51eccbe-f456-49c7-b087-8f87307ba966 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:15.182445 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 24/47] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:14:15.187843 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c522deb-46e1-444f-9c0b-3caa251b685e None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:15.188236 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c522deb-46e1-444f-9c0b-3caa251b685e None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:15.188531 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c522deb-46e1-444f-9c0b-3caa251b685e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:15.206765 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-8c522deb-46e1-444f-9c0b-3caa251b685e None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:15.208371 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-8c522deb-46e1-444f-9c0b-3caa251b685e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:15.221180 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:15.279469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 24/48] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:14:15.300744 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51eccbe-f456-49c7-b087-8f87307ba966 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:15.310292 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:15.507360 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51eccbe-f456-49c7-b087-8f87307ba966 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:15.540344 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a7cc5-cd3b-4177-8928-3e5a07c55f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:15.541289 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a7cc5-cd3b-4177-8928-3e5a07c55f26 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:15.541576 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a7cc5-cd3b-4177-8928-3e5a07c55f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:15.541851 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a7cc5-cd3b-4177-8928-3e5a07c55f26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:15.553063 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3a7cc5-cd3b-4177-8928-3e5a07c55f26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:14:15.562500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-7a3a7cc5-cd3b-4177-8928-3e5a07c55f26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:14:15.562500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:14:15.562500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:14:15.562500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:14:15.562500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:14:15.562500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:14:15.562500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:14:15.562500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:14:15.562500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:14:15.562500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:14:15.562500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:14:15.562500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:14:15.562500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:14:15.562500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:14:15.562500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:14:15.562500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:14:15.563327 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:14:15.563327 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:14:15.563327 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:14:15.563327 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:14:15.563327 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:14:15.563327 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:14:15.563327 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:14:15.563327 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:14:15.563327 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:14:15.563327 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:14:15.563327 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:14:15.563327 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:14:15.563327 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:14:15.563327 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:14:15.563327 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:14:15.563327 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:14:15.564113 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:14:15.564113 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:14:15.564113 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:14:15.564113 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:14:15.564113 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:14:15.564113 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:14:15.564113 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:14:15.564113 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:14:15.564113 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:14:15.564113 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:14:15.564113 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:14:15.564113 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:14:15.564113 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 25/49] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Jul 21 19:14:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:14:15.569560 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c522deb-46e1-444f-9c0b-3caa251b685e None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:15.667453 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c522deb-46e1-444f-9c0b-3caa251b685e None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:15.701080 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb754f5-1e1e-452a-8e5e-f14d3b8efcab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:15.701755 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb754f5-1e1e-452a-8e5e-f14d3b8efcab None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:15.702046 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb754f5-1e1e-452a-8e5e-f14d3b8efcab None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:15.702331 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb754f5-1e1e-452a-8e5e-f14d3b8efcab None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:15.703085 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb754f5-1e1e-452a-8e5e-f14d3b8efcab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:15.703403 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb754f5-1e1e-452a-8e5e-f14d3b8efcab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:15.704825 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb754f5-1e1e-452a-8e5e-f14d3b8efcab None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:15.713112 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 25/50] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:14:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:15.718715 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a7cc5-cd3b-4177-8928-3e5a07c55f26 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:15.782555 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:15.817549 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a7cc5-cd3b-4177-8928-3e5a07c55f26 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:15.851022 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65c3db-2c99-4a61-94a9-7d9f7e482150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:15.851942 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65c3db-2c99-4a61-94a9-7d9f7e482150 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:15.852234 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65c3db-2c99-4a61-94a9-7d9f7e482150 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:15.852516 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65c3db-2c99-4a61-94a9-7d9f7e482150 None admin] PATH_INFO: `/v3/users/9e09a8e247ab497cad13b7109b21b1c9` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:15.854466 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d65c3db-2c99-4a61-94a9-7d9f7e482150 None admin] RBAC: Authorizing `identity:get_user(user_id=9e09a8e247ab497cad13b7109b21b1c9)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:15.855984 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d65c3db-2c99-4a61-94a9-7d9f7e482150 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:15.857631 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 26/51] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:14:15 2022] GET /identity/v3/users/9e09a8e247ab497cad13b7109b21b1c9 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:15.863034 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb754f5-1e1e-452a-8e5e-f14d3b8efcab None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:15.875112 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:15.964585 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb754f5-1e1e-452a-8e5e-f14d3b8efcab None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:15.998724 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8106b87-f180-424a-acf4-4a082d2a814e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:15.999557 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8106b87-f180-424a-acf4-4a082d2a814e None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:15.999851 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8106b87-f180-424a-acf4-4a082d2a814e None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:16.000136 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8106b87-f180-424a-acf4-4a082d2a814e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:16.001342 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8106b87-f180-424a-acf4-4a082d2a814e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:16.002809 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8106b87-f180-424a-acf4-4a082d2a814e None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:16.004499 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 26/52] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:14:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:16.010485 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65c3db-2c99-4a61-94a9-7d9f7e482150 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:16.107781 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65c3db-2c99-4a61-94a9-7d9f7e482150 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:16.138522 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999ca58-10fc-45aa-8464-1c19c0822316 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:16.138824 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999ca58-10fc-45aa-8464-1c19c0822316 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:16.139113 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999ca58-10fc-45aa-8464-1c19c0822316 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:16.140271 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0df8d2-9be3-4169-9bba-81813749d051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:16.140532 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 27/53] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 19:14:16.140938 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0df8d2-9be3-4169-9bba-81813749d051 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:16.141228 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0df8d2-9be3-4169-9bba-81813749d051 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:16.141512 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0df8d2-9be3-4169-9bba-81813749d051 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:16.142346 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0df8d2-9be3-4169-9bba-81813749d051 None admin] RBAC: Adding query filter params (role.id=685e18230e1744c581baaf842d0fd4ca, scope.domain.id=default, user.id=9e09a8e247ab497cad13b7109b21b1c9) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:16.142664 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0df8d2-9be3-4169-9bba-81813749d051 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:16.144161 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0df8d2-9be3-4169-9bba-81813749d051 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:16.145355 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21840cf-0819-4416-a985-77abee9b8918 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:16.145651 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21840cf-0819-4416-a985-77abee9b8918 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:16.145937 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21840cf-0819-4416-a985-77abee9b8918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:16.146318 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:16.154778 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 27/54] 10.222.0.60 () {56 vars in 1322 bytes} [Thu Jul 21 19:14:16 2022] GET /identity/v3/role_assignments?user.id=9e09a8e247ab497cad13b7109b21b1c9&scope.domain.id=default&role.id=685e18230e1744c581baaf842d0fd4ca => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:14:16.164381 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-e21840cf-0819-4416-a985-77abee9b8918 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:16.166558 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-e21840cf-0819-4416-a985-77abee9b8918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:16.244169 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 28/55] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 19:14:16.268641 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0df8d2-9be3-4169-9bba-81813749d051 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:16.374899 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0df8d2-9be3-4169-9bba-81813749d051 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:16.408432 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6b085-45b0-415d-afc1-fa6478c684e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:16.409312 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6b085-45b0-415d-afc1-fa6478c684e7 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:16.409602 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6b085-45b0-415d-afc1-fa6478c684e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:16.409880 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6b085-45b0-415d-afc1-fa6478c684e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:16.411032 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f6b085-45b0-415d-afc1-fa6478c684e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:16.412531 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f6b085-45b0-415d-afc1-fa6478c684e7 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:16.414127 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 28/56] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:14:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:16.420359 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21840cf-0819-4416-a985-77abee9b8918 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:16.430786 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:16.520620 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21840cf-0819-4416-a985-77abee9b8918 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:16.554043 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b35da-05b9-43d5-bc0a-9bc72f38b355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:16.554693 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b35da-05b9-43d5-bc0a-9bc72f38b355 None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:16.554976 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b35da-05b9-43d5-bc0a-9bc72f38b355 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:16.555250 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b35da-05b9-43d5-bc0a-9bc72f38b355 None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:16.556007 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b35da-05b9-43d5-bc0a-9bc72f38b355 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:16.557676 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b35da-05b9-43d5-bc0a-9bc72f38b355 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:16.634065 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 29/57] 10.222.0.60 () {60 vars in 1140 bytes} [Thu Jul 21 19:14:16 2022] POST /identity/v3/projects => generated 298 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:14:18.645332 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc52b6-ee35-4563-8b86-2978639c0d33 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:18.645863 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc52b6-ee35-4563-8b86-2978639c0d33 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:18.645951 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc52b6-ee35-4563-8b86-2978639c0d33 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:18.647271 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 29/58] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:14:18.652524 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f23c2-7f4c-4b2f-9149-275fa6ab8fb9 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:18.652942 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f23c2-7f4c-4b2f-9149-275fa6ab8fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:18.653093 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f23c2-7f4c-4b2f-9149-275fa6ab8fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:18.670058 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-0c6f23c2-7f4c-4b2f-9149-275fa6ab8fb9 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:18.671233 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-0c6f23c2-7f4c-4b2f-9149-275fa6ab8fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:18.722250 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:18.735848 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 30/59] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:14:18.760695 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc52b6-ee35-4563-8b86-2978639c0d33 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:18.826149 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:18.859384 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc52b6-ee35-4563-8b86-2978639c0d33 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:18.891346 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a85463-af80-44f9-8575-c980f77ce44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:18.892151 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a85463-af80-44f9-8575-c980f77ce44f None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:18.892438 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a85463-af80-44f9-8575-c980f77ce44f None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:18.892717 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a85463-af80-44f9-8575-c980f77ce44f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:18.893872 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a85463-af80-44f9-8575-c980f77ce44f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:18.895326 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a85463-af80-44f9-8575-c980f77ce44f None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:18.896938 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 30/60] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:14:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:18.902624 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f23c2-7f4c-4b2f-9149-275fa6ab8fb9 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:18.999508 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f23c2-7f4c-4b2f-9149-275fa6ab8fb9 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:19.032198 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b288b-8868-4fe5-9d31-0cbe1aba744f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:19.032863 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b288b-8868-4fe5-9d31-0cbe1aba744f None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:19.033151 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b288b-8868-4fe5-9d31-0cbe1aba744f None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:19.033430 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b288b-8868-4fe5-9d31-0cbe1aba744f None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:19.034128 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b288b-8868-4fe5-9d31-0cbe1aba744f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:19.035607 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b288b-8868-4fe5-9d31-0cbe1aba744f None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:19.161612 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 31/61] 10.222.0.60 () {60 vars in 1132 bytes} [Thu Jul 21 19:14:18 2022] POST /identity/v3/users => generated 275 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:14:22.278067 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd91d4b-9650-4e8b-b24a-cbaed04ddbd5 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:22.278911 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd91d4b-9650-4e8b-b24a-cbaed04ddbd5 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:22.279335 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd91d4b-9650-4e8b-b24a-cbaed04ddbd5 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:22.281258 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 31/62] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:14:22.286244 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb7c5a-33e3-411f-a5e7-e5f60ebcc676 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:22.286963 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb7c5a-33e3-411f-a5e7-e5f60ebcc676 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:22.287400 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb7c5a-33e3-411f-a5e7-e5f60ebcc676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:22.312415 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-aedb7c5a-33e3-411f-a5e7-e5f60ebcc676 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:22.313838 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-aedb7c5a-33e3-411f-a5e7-e5f60ebcc676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:22.372702 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:22.412341 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 32/63] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:14:22.456903 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd91d4b-9650-4e8b-b24a-cbaed04ddbd5 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:22.481803 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1eae33-5c76-49cb-8e44-dbdabfc593a5 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:22.482152 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1eae33-5c76-49cb-8e44-dbdabfc593a5 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:22.482372 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1eae33-5c76-49cb-8e44-dbdabfc593a5 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:22.483794 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 33/64] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 19:14:22.488781 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241931b-e0ac-4ec5-9c75-d1e84f299dd4 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:22.489070 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241931b-e0ac-4ec5-9c75-d1e84f299dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:22.489348 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241931b-e0ac-4ec5-9c75-d1e84f299dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:22.515469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-9241931b-e0ac-4ec5-9c75-d1e84f299dd4 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:22.516667 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-9241931b-e0ac-4ec5-9c75-d1e84f299dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:22.607151 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd91d4b-9650-4e8b-b24a-cbaed04ddbd5 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:22.652499 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a141e-3ecf-47f2-a19e-5ede5fadd24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:22.653315 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a141e-3ecf-47f2-a19e-5ede5fadd24d None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:22.653604 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a141e-3ecf-47f2-a19e-5ede5fadd24d None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:22.653940 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a141e-3ecf-47f2-a19e-5ede5fadd24d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:22.654239 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 34/65] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 21 19:14:22.660248 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:22.661326 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48088b20-5a98-47c7-ba6f-305cb0b36d38 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:22.661635 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48088b20-5a98-47c7-ba6f-305cb0b36d38 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:22.661995 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48088b20-5a98-47c7-ba6f-305cb0b36d38 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:22.663575 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 35/66] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:22 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:14:22.669357 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f2354-54be-48d0-be2e-760db4190c42 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:22.669633 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f2354-54be-48d0-be2e-760db4190c42 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:22.673439 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f2354-54be-48d0-be2e-760db4190c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:22.673545 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a141e-3ecf-47f2-a19e-5ede5fadd24d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:14:22.678844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-953a141e-3ecf-47f2-a19e-5ede5fadd24d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 19:14:22.678844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:14:22.678844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:14:22.678844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:14:22.678844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:14:22.678844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:14:22.678844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:14:22.678844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:14:22.678844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:14:22.678844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:14:22.678844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:14:22.678844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:14:22.678844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:14:22.678844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:14:22.678844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:14:22.678844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:14:22.679771 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:14:22.679771 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:14:22.679771 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:14:22.679771 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:14:22.679771 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:14:22.679771 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:14:22.679771 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:14:22.679771 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:14:22.679771 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:14:22.679771 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:14:22.679771 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:14:22.679771 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:14:22.679771 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:14:22.679771 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:14:22.679771 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:14:22.679771 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:14:22.681447 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:14:22.681447 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:14:22.681447 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:14:22.681447 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:14:22.681447 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:14:22.681447 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:14:22.681447 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:14:22.681447 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:14:22.681447 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:14:22.681447 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:14:22.681447 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 19:14:22.681447 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:14:22.681447 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 32/67] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:14:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:14:22.687210 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a141e-3ecf-47f2-a19e-5ede5fadd24d None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:22.693677 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-144f2354-54be-48d0-be2e-760db4190c42 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:22.694871 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-144f2354-54be-48d0-be2e-760db4190c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:22.768742 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 36/68] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 19:14:22.769383 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f2354-54be-48d0-be2e-760db4190c42 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:22.808688 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a141e-3ecf-47f2-a19e-5ede5fadd24d None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:22.809495 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:22.846324 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db85bd8-3f6b-4d62-922b-0aace05068a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:22.846998 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db85bd8-3f6b-4d62-922b-0aace05068a8 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:22.847292 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db85bd8-3f6b-4d62-922b-0aace05068a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:22.847611 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db85bd8-3f6b-4d62-922b-0aace05068a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:22.848361 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db85bd8-3f6b-4d62-922b-0aace05068a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:22.848679 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db85bd8-3f6b-4d62-922b-0aace05068a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:22.850081 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db85bd8-3f6b-4d62-922b-0aace05068a8 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:22.859210 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 33/69] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Jul 21 19:14:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:14:22.860518 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5599c-18c6-4658-aef0-c72969afd5eb None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:22.860810 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5599c-18c6-4658-aef0-c72969afd5eb None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:22.861090 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5599c-18c6-4658-aef0-c72969afd5eb None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:22.862482 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 34/70] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:14:22.864184 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5599c-18c6-4658-aef0-c72969afd5eb None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:22.886028 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f2354-54be-48d0-be2e-760db4190c42 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:22.923414 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92037935-bfec-408f-85b0-31d7ec319bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:22.924236 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92037935-bfec-408f-85b0-31d7ec319bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:22.924534 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92037935-bfec-408f-85b0-31d7ec319bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:22.924816 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92037935-bfec-408f-85b0-31d7ec319bc4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:22.926100 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:22.937035 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92037935-bfec-408f-85b0-31d7ec319bc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:14:22.944761 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-92037935-bfec-408f-85b0-31d7ec319bc4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:14:22.944761 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:14:22.944761 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:14:22.944761 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:14:22.944761 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:14:22.944761 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:14:22.944761 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:14:22.944761 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:14:22.944761 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:14:22.944761 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:14:22.944761 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:14:22.944761 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:14:22.944761 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:14:22.944761 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:14:22.944761 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:14:22.944761 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:14:22.952461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:14:22.952461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:14:22.952461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:14:22.952461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:14:22.952461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:14:22.952461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:14:22.952461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:14:22.952461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:14:22.952461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:14:22.952461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:14:22.952461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:14:22.952461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:14:22.952461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:14:22.952461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:14:22.952461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:14:22.952461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:14:22.953224 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:14:22.953224 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:14:22.953224 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:14:22.953224 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:14:22.953224 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:14:22.953224 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:14:22.953224 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:14:22.953224 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:14:22.953224 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:14:22.953224 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:14:22.953224 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:14:22.953224 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:14:22.953224 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 37/71] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Jul 21 19:14:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:14:22.953224 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92037935-bfec-408f-85b0-31d7ec319bc4 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:22.983145 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5599c-18c6-4658-aef0-c72969afd5eb None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:23.016921 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd10259-c1d7-4314-b07f-e5779a115af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:23.017724 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd10259-c1d7-4314-b07f-e5779a115af5 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:23.018013 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd10259-c1d7-4314-b07f-e5779a115af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:23.018316 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd10259-c1d7-4314-b07f-e5779a115af5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:23.029998 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd10259-c1d7-4314-b07f-e5779a115af5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:14:23.037798 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-6cd10259-c1d7-4314-b07f-e5779a115af5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 19:14:23.037798 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:14:23.037798 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:14:23.037798 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:14:23.037798 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:14:23.037798 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:14:23.037798 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:14:23.037798 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:14:23.037798 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:14:23.037798 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:14:23.037798 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:14:23.037798 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:14:23.037798 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:14:23.037798 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:14:23.037798 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:14:23.037798 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:14:23.038724 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:14:23.038724 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:14:23.038724 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:14:23.038724 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:14:23.038724 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:14:23.038724 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:14:23.038724 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:14:23.038724 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:14:23.038724 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:14:23.038724 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:14:23.038724 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:14:23.038724 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:14:23.038724 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:14:23.038724 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:14:23.038724 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:14:23.038724 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:14:23.044344 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:14:23.044344 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:14:23.044344 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:14:23.044344 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:14:23.044344 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:14:23.044344 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:14:23.044344 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:14:23.044344 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:14:23.044344 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:14:23.044344 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:14:23.044344 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 19:14:23.044344 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:14:23.044344 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 35/72] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:14:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:14:23.044344 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1902516-4857-4a30-8753-b07137ea7783 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:23.045016 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1902516-4857-4a30-8753-b07137ea7783 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:23.045016 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1902516-4857-4a30-8753-b07137ea7783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:23.048628 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:23.055353 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92037935-bfec-408f-85b0-31d7ec319bc4 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:23.058994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-e1902516-4857-4a30-8753-b07137ea7783 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:23.060221 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-e1902516-4857-4a30-8753-b07137ea7783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:23.089169 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec49f53-8159-4f0d-97d7-3eaf74e911e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:23.090091 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec49f53-8159-4f0d-97d7-3eaf74e911e8 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:23.090575 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec49f53-8159-4f0d-97d7-3eaf74e911e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:23.091025 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec49f53-8159-4f0d-97d7-3eaf74e911e8 None admin] PATH_INFO: `/v3/users/c85d049ff6344e709f0b3295a93105c8` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:23.104924 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec49f53-8159-4f0d-97d7-3eaf74e911e8 None admin] RBAC: Authorizing `identity:get_user(user_id=c85d049ff6344e709f0b3295a93105c8)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:23.106388 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec49f53-8159-4f0d-97d7-3eaf74e911e8 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:23.108088 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 38/73] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:14:22 2022] GET /identity/v3/users/c85d049ff6344e709f0b3295a93105c8 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:23.108855 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec49f53-8159-4f0d-97d7-3eaf74e911e8 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:23.124997 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 36/74] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:14:23.126244 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52632fea-b96c-47e9-97c4-84f98c074188 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:23.126537 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52632fea-b96c-47e9-97c4-84f98c074188 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:23.126817 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52632fea-b96c-47e9-97c4-84f98c074188 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:23.128108 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 37/75] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:14:23.128799 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52632fea-b96c-47e9-97c4-84f98c074188 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:23.175610 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:23.217838 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec49f53-8159-4f0d-97d7-3eaf74e911e8 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:23.229795 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52632fea-b96c-47e9-97c4-84f98c074188 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:23.250735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f0a0e-48c5-4d36-9734-8b1b20958fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:23.251402 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f0a0e-48c5-4d36-9734-8b1b20958fe2 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:23.251715 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f0a0e-48c5-4d36-9734-8b1b20958fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:23.251994 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f0a0e-48c5-4d36-9734-8b1b20958fe2 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:23.252735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f0a0e-48c5-4d36-9734-8b1b20958fe2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:23.253040 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f0a0e-48c5-4d36-9734-8b1b20958fe2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:23.254430 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f0a0e-48c5-4d36-9734-8b1b20958fe2 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:23.262859 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 39/76] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:14:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:23.263666 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f0a0e-48c5-4d36-9734-8b1b20958fe2 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:23.263871 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88493bdf-5af4-45d5-980d-8e80cc8d01eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:23.264635 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88493bdf-5af4-45d5-980d-8e80cc8d01eb None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:23.264935 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88493bdf-5af4-45d5-980d-8e80cc8d01eb None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:23.265221 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88493bdf-5af4-45d5-980d-8e80cc8d01eb None admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:23.266148 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88493bdf-5af4-45d5-980d-8e80cc8d01eb None admin] RBAC: Adding query filter params (name=member) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:23.266483 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88493bdf-5af4-45d5-980d-8e80cc8d01eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:23.268657 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88493bdf-5af4-45d5-980d-8e80cc8d01eb None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:23.278162 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 38/77] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Jul 21 19:14:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:23.279487 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833bfc03-aafe-4b07-864c-818eed0e013a None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:23.279879 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833bfc03-aafe-4b07-864c-818eed0e013a None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:23.280236 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833bfc03-aafe-4b07-864c-818eed0e013a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:23.284062 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:23.296192 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-833bfc03-aafe-4b07-864c-818eed0e013a None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:23.297464 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-833bfc03-aafe-4b07-864c-818eed0e013a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:23.363066 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 39/78] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:14:23.363931 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833bfc03-aafe-4b07-864c-818eed0e013a None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:23.375559 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f0a0e-48c5-4d36-9734-8b1b20958fe2 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:23.403921 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:23.411000 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a0728-3955-41af-8fe0-b29831011309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:23.411688 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a0728-3955-41af-8fe0-b29831011309 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:23.411982 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a0728-3955-41af-8fe0-b29831011309 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:23.412267 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a0728-3955-41af-8fe0-b29831011309 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:23.468573 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833bfc03-aafe-4b07-864c-818eed0e013a None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:23.484380 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2a0728-3955-41af-8fe0-b29831011309 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:23.485876 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2a0728-3955-41af-8fe0-b29831011309 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:23.500842 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:23.503862 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6b15a-30ce-4c9a-922b-b1a8337287fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:23.504679 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6b15a-30ce-4c9a-922b-b1a8337287fa None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:23.504967 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6b15a-30ce-4c9a-922b-b1a8337287fa None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:23.505243 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6b15a-30ce-4c9a-922b-b1a8337287fa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:23.516599 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab6b15a-30ce-4c9a-922b-b1a8337287fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:14:23.524861 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-4ab6b15a-30ce-4c9a-922b-b1a8337287fa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 19:14:23.524861 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:14:23.524861 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:14:23.524861 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:14:23.524861 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:14:23.524861 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:14:23.524861 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:14:23.524861 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:14:23.524861 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:14:23.524861 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:14:23.524861 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:14:23.524861 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:14:23.524861 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:14:23.524861 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:14:23.524861 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:14:23.524861 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:14:23.525844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:14:23.525844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:14:23.525844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:14:23.525844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:14:23.525844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:14:23.525844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:14:23.525844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:14:23.525844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:14:23.525844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:14:23.525844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:14:23.525844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:14:23.525844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:14:23.525844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:14:23.525844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:14:23.525844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:14:23.525844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:14:23.526626 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:14:23.526626 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:14:23.526626 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:14:23.526626 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:14:23.526626 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:14:23.526626 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:14:23.526626 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:14:23.526626 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:14:23.526626 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:14:23.526626 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:14:23.526626 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 19:14:23.526626 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:14:23.526626 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 40/79] 10.222.0.60 () {56 vars in 1114 bytes} [Thu Jul 21 19:14:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:14:23.527273 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6b15a-30ce-4c9a-922b-b1a8337287fa None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:23.586568 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 40/80] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:14:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 19:14:23.587656 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a0728-3955-41af-8fe0-b29831011309 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:23.624440 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:23.628028 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6b15a-30ce-4c9a-922b-b1a8337287fa None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:23.660713 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d90e2-0208-4c59-adaa-b892cb15b7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:23.661611 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d90e2-0208-4c59-adaa-b892cb15b7ef None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:23.661904 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d90e2-0208-4c59-adaa-b892cb15b7ef None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:23.662182 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d90e2-0208-4c59-adaa-b892cb15b7ef None admin] PATH_INFO: `/v3/users/9e09a8e247ab497cad13b7109b21b1c9` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:23.663468 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7d90e2-0208-4c59-adaa-b892cb15b7ef None admin] RBAC: Authorizing `identity:get_user(user_id=9e09a8e247ab497cad13b7109b21b1c9)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:23.665077 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7d90e2-0208-4c59-adaa-b892cb15b7ef None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:23.667531 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 41/81] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:14:23 2022] GET /identity/v3/users/9e09a8e247ab497cad13b7109b21b1c9 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:23.668681 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d90e2-0208-4c59-adaa-b892cb15b7ef None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:23.688261 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a0728-3955-41af-8fe0-b29831011309 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:23.704055 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:23.723280 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9ba75-a346-43ff-98bc-11486e7904f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:23.724192 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9ba75-a346-43ff-98bc-11486e7904f9 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:23.724481 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9ba75-a346-43ff-98bc-11486e7904f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:23.724762 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9ba75-a346-43ff-98bc-11486e7904f9 None admin] PATH_INFO: `/v3/users/c85d049ff6344e709f0b3295a93105c8` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:23.725966 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf9ba75-a346-43ff-98bc-11486e7904f9 None admin] RBAC: Authorizing `identity:get_user(user_id=c85d049ff6344e709f0b3295a93105c8)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:23.727498 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf9ba75-a346-43ff-98bc-11486e7904f9 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:23.729524 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 41/82] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:14:23 2022] GET /identity/v3/users/c85d049ff6344e709f0b3295a93105c8 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:23.730301 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9ba75-a346-43ff-98bc-11486e7904f9 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:23.766775 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d90e2-0208-4c59-adaa-b892cb15b7ef None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:23.799442 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7003c9d7-9842-4192-9deb-7ad84f531e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:23.800254 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003c9d7-9842-4192-9deb-7ad84f531e94 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:23.800537 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003c9d7-9842-4192-9deb-7ad84f531e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:23.800818 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003c9d7-9842-4192-9deb-7ad84f531e94 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:23.801999 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7003c9d7-9842-4192-9deb-7ad84f531e94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:23.803742 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7003c9d7-9842-4192-9deb-7ad84f531e94 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:23.805345 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 42/83] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:14:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:23.806638 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7003c9d7-9842-4192-9deb-7ad84f531e94 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:23.832731 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9ba75-a346-43ff-98bc-11486e7904f9 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:23.841956 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:23.867906 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f89d1f-b390-4fcd-b47b-7d821507f763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:23.869377 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f89d1f-b390-4fcd-b47b-7d821507f763 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:23.869659 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f89d1f-b390-4fcd-b47b-7d821507f763 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:23.869953 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f89d1f-b390-4fcd-b47b-7d821507f763 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:23.870737 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f89d1f-b390-4fcd-b47b-7d821507f763 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:23.871049 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f89d1f-b390-4fcd-b47b-7d821507f763 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:23.872458 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f89d1f-b390-4fcd-b47b-7d821507f763 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:23.880400 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 42/84] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:14:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:23.881136 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f89d1f-b390-4fcd-b47b-7d821507f763 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:23.906701 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7003c9d7-9842-4192-9deb-7ad84f531e94 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:23.926929 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:23.942729 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f842f-616d-459c-9ef0-bd3e120bab11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:23.943651 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f842f-616d-459c-9ef0-bd3e120bab11 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:23.943945 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f842f-616d-459c-9ef0-bd3e120bab11 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:23.944228 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f842f-616d-459c-9ef0-bd3e120bab11 None admin] PATH_INFO: `/v3/projects/0180b37d7e6843eaa90e0d081ade9da8` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:23.945447 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4f842f-616d-459c-9ef0-bd3e120bab11 None admin] RBAC: Authorizing `identity:get_project(project_id=0180b37d7e6843eaa90e0d081ade9da8)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:23.947000 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4f842f-616d-459c-9ef0-bd3e120bab11 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:23.948734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 43/85] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:14:23 2022] GET /identity/v3/projects/0180b37d7e6843eaa90e0d081ade9da8 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:23.949511 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f842f-616d-459c-9ef0-bd3e120bab11 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:23.982971 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f89d1f-b390-4fcd-b47b-7d821507f763 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:24.023419 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09fb48c-23e7-429b-9f66-a552a59a8e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:24.024102 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fb48c-23e7-429b-9f66-a552a59a8e29 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:24.024394 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fb48c-23e7-429b-9f66-a552a59a8e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:24.024724 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fb48c-23e7-429b-9f66-a552a59a8e29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:24.048301 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f842f-616d-459c-9ef0-bd3e120bab11 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:24.049791 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:24.082694 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a0a935-855a-4125-8e88-3d451cd62644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:24.083355 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0a935-855a-4125-8e88-3d451cd62644 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:24.083672 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0a935-855a-4125-8e88-3d451cd62644 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:24.083952 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0a935-855a-4125-8e88-3d451cd62644 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:24.093840 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09fb48c-23e7-429b-9f66-a552a59a8e29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:24.095320 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09fb48c-23e7-429b-9f66-a552a59a8e29 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:24.139490 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:24.150101 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a0a935-855a-4125-8e88-3d451cd62644 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:24.151586 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a0a935-855a-4125-8e88-3d451cd62644 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:24.193943 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 43/86] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:14:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 19:14:24.196402 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09fb48c-23e7-429b-9f66-a552a59a8e29 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:24.248008 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 44/87] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:14:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 19:14:24.248845 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a0a935-855a-4125-8e88-3d451cd62644 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:24.254592 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:24.298607 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09fb48c-23e7-429b-9f66-a552a59a8e29 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:24.333256 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6ebdc-b96d-41e8-9363-af5716c44400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:24.333933 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6ebdc-b96d-41e8-9363-af5716c44400 None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:24.334223 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6ebdc-b96d-41e8-9363-af5716c44400 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:24.334508 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6ebdc-b96d-41e8-9363-af5716c44400 None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:24.335225 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6ebdc-b96d-41e8-9363-af5716c44400 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:24.336733 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6ebdc-b96d-41e8-9363-af5716c44400 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:24.350415 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a0a935-855a-4125-8e88-3d451cd62644 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:24.383145 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49677653-3d9f-41ae-900e-1a331dca1daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:24.384338 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49677653-3d9f-41ae-900e-1a331dca1daf None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:24.384624 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49677653-3d9f-41ae-900e-1a331dca1daf None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:24.384906 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49677653-3d9f-41ae-900e-1a331dca1daf None admin] PATH_INFO: `/v3/users/c85d049ff6344e709f0b3295a93105c8` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:24.386099 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49677653-3d9f-41ae-900e-1a331dca1daf None admin] RBAC: Authorizing `identity:get_user(user_id=c85d049ff6344e709f0b3295a93105c8)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:24.387583 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49677653-3d9f-41ae-900e-1a331dca1daf None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:24.389241 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 45/88] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:14:24 2022] GET /identity/v3/users/c85d049ff6344e709f0b3295a93105c8 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:24.394669 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49677653-3d9f-41ae-900e-1a331dca1daf None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:24.415010 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:24.421682 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 44/89] 10.222.0.60 () {60 vars in 1132 bytes} [Thu Jul 21 19:14:24 2022] POST /identity/v3/users => generated 289 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:14:24.421682 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6ebdc-b96d-41e8-9363-af5716c44400 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:24.484164 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:24.517452 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49677653-3d9f-41ae-900e-1a331dca1daf None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:24.535291 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6ebdc-b96d-41e8-9363-af5716c44400 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:24.557877 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d85367-555e-44e1-b673-4defc3e7446f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:24.558559 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d85367-555e-44e1-b673-4defc3e7446f None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:24.558860 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d85367-555e-44e1-b673-4defc3e7446f None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:24.559140 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d85367-555e-44e1-b673-4defc3e7446f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:24.560033 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d85367-555e-44e1-b673-4defc3e7446f None admin] RBAC: Adding query filter params (role.id=0af30c087b3541a4847d708dd68464d6, scope.project.id=0180b37d7e6843eaa90e0d081ade9da8, user.id=c85d049ff6344e709f0b3295a93105c8) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:24.560351 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d85367-555e-44e1-b673-4defc3e7446f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:24.562114 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d85367-555e-44e1-b673-4defc3e7446f None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:24.568235 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 46/90] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:14:24 2022] GET /identity/v3/role_assignments?user.id=c85d049ff6344e709f0b3295a93105c8&scope.project.id=0180b37d7e6843eaa90e0d081ade9da8&role.id=0af30c087b3541a4847d708dd68464d6 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:24.568844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d85367-555e-44e1-b673-4defc3e7446f None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:24.577330 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7d61a-d2f0-454c-815a-3f690bdce45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:24.578704 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7d61a-d2f0-454c-815a-3f690bdce45c None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:24.579198 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7d61a-d2f0-454c-815a-3f690bdce45c None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:24.579704 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7d61a-d2f0-454c-815a-3f690bdce45c None admin] PATH_INFO: `/v3/projects/0180b37d7e6843eaa90e0d081ade9da8` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:24.581438 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b7d61a-d2f0-454c-815a-3f690bdce45c None admin] RBAC: Authorizing `identity:get_project(project_id=0180b37d7e6843eaa90e0d081ade9da8)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:24.583271 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b7d61a-d2f0-454c-815a-3f690bdce45c None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:24.585680 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 45/91] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:14:24 2022] GET /identity/v3/projects/0180b37d7e6843eaa90e0d081ade9da8 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:24.586730 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7d61a-d2f0-454c-815a-3f690bdce45c None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:24.684420 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:24.709324 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d85367-555e-44e1-b673-4defc3e7446f None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:24.739044 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7d61a-d2f0-454c-815a-3f690bdce45c None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:24.764331 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be1becc-3fd7-47e3-a1dd-df0833cb4ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:24.765681 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1becc-3fd7-47e3-a1dd-df0833cb4ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:24.766178 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1becc-3fd7-47e3-a1dd-df0833cb4ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:24.766667 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1becc-3fd7-47e3-a1dd-df0833cb4ac0 None admin] PATH_INFO: `/v3/projects/8ef327054d074c54ba32059ee735417c` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:24.767935 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be1becc-3fd7-47e3-a1dd-df0833cb4ac0 None admin] RBAC: Authorizing `identity:get_project(project_id=8ef327054d074c54ba32059ee735417c)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:24.769517 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be1becc-3fd7-47e3-a1dd-df0833cb4ac0 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:24.771407 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 47/92] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:14:24 2022] GET /identity/v3/projects/8ef327054d074c54ba32059ee735417c => generated 312 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:24.772151 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be1becc-3fd7-47e3-a1dd-df0833cb4ac0 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:24.775557 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:24.787475 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317eaa7-2f11-4499-af3f-87c5f5194b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:24.788140 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317eaa7-2f11-4499-af3f-87c5f5194b30 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:24.792172 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317eaa7-2f11-4499-af3f-87c5f5194b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:24.792172 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317eaa7-2f11-4499-af3f-87c5f5194b30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:24.880926 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7317eaa7-2f11-4499-af3f-87c5f5194b30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:24.882966 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7317eaa7-2f11-4499-af3f-87c5f5194b30 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:24.891028 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be1becc-3fd7-47e3-a1dd-df0833cb4ac0 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:24.938982 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de917e-ed6c-4a33-a66f-01262d80f3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:24.939608 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de917e-ed6c-4a33-a66f-01262d80f3c6 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:24.940161 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de917e-ed6c-4a33-a66f-01262d80f3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:24.940452 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de917e-ed6c-4a33-a66f-01262d80f3c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:24.941787 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de917e-ed6c-4a33-a66f-01262d80f3c6 None admin] RBAC: Adding query filter params (role.id=685e18230e1744c581baaf842d0fd4ca, scope.project.id=0180b37d7e6843eaa90e0d081ade9da8, user.id=9e09a8e247ab497cad13b7109b21b1c9) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:24.942383 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de917e-ed6c-4a33-a66f-01262d80f3c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:24.944156 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de917e-ed6c-4a33-a66f-01262d80f3c6 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:24.952110 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 48/93] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:14:24 2022] GET /identity/v3/role_assignments?user.id=9e09a8e247ab497cad13b7109b21b1c9&scope.project.id=0180b37d7e6843eaa90e0d081ade9da8&role.id=685e18230e1744c581baaf842d0fd4ca => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:24.953440 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de917e-ed6c-4a33-a66f-01262d80f3c6 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:24.979333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:25.023003 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 46/94] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:14:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 19:14:25.029402 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317eaa7-2f11-4499-af3f-87c5f5194b30 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:25.040625 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:25.088275 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de917e-ed6c-4a33-a66f-01262d80f3c6 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:25.133040 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ba117-30b9-420f-acd3-131018dffc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:25.134809 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ba117-30b9-420f-acd3-131018dffc48 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:25.135104 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ba117-30b9-420f-acd3-131018dffc48 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:25.135389 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ba117-30b9-420f-acd3-131018dffc48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:25.136799 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ba117-30b9-420f-acd3-131018dffc48 None admin] RBAC: Adding query filter params (role.id=0af30c087b3541a4847d708dd68464d6, scope.project.id=8ef327054d074c54ba32059ee735417c, user.id=c85d049ff6344e709f0b3295a93105c8) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:25.137151 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ba117-30b9-420f-acd3-131018dffc48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:25.139147 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ba117-30b9-420f-acd3-131018dffc48 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:25.145994 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317eaa7-2f11-4499-af3f-87c5f5194b30 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:25.147081 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 49/95] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:14:24 2022] GET /identity/v3/role_assignments?user.id=c85d049ff6344e709f0b3295a93105c8&scope.project.id=8ef327054d074c54ba32059ee735417c&role.id=0af30c087b3541a4847d708dd68464d6 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:25.199372 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf93218-5404-4db0-afe7-de4098b006fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:25.200315 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf93218-5404-4db0-afe7-de4098b006fa None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:25.200599 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf93218-5404-4db0-afe7-de4098b006fa None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:25.200878 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf93218-5404-4db0-afe7-de4098b006fa None admin] PATH_INFO: `/v3/projects/0180b37d7e6843eaa90e0d081ade9da8` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:25.202328 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf93218-5404-4db0-afe7-de4098b006fa None admin] RBAC: Authorizing `identity:get_project(project_id=0180b37d7e6843eaa90e0d081ade9da8)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:25.203874 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf93218-5404-4db0-afe7-de4098b006fa None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:25.205678 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 47/96] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:14:25 2022] GET /identity/v3/projects/0180b37d7e6843eaa90e0d081ade9da8 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:25.212205 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ba117-30b9-420f-acd3-131018dffc48 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:25.328220 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ba117-30b9-420f-acd3-131018dffc48 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:25.359094 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:25.366760 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf7c64-b1b6-4fa1-8284-7f7def4d5f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:25.385268 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf7c64-b1b6-4fa1-8284-7f7def4d5f8d None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:25.385268 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf7c64-b1b6-4fa1-8284-7f7def4d5f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:25.385268 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf7c64-b1b6-4fa1-8284-7f7def4d5f8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:25.385268 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf7c64-b1b6-4fa1-8284-7f7def4d5f8d None admin] RBAC: Adding query filter params (role.id=3ad609555dec437d92e5c7291b1c939a, scope.project.id=0180b37d7e6843eaa90e0d081ade9da8, user.id=c85d049ff6344e709f0b3295a93105c8) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:25.385268 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf7c64-b1b6-4fa1-8284-7f7def4d5f8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:25.385268 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf7c64-b1b6-4fa1-8284-7f7def4d5f8d None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:25.386206 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 50/97] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:14:25 2022] GET /identity/v3/role_assignments?user.id=c85d049ff6344e709f0b3295a93105c8&scope.project.id=0180b37d7e6843eaa90e0d081ade9da8&role.id=3ad609555dec437d92e5c7291b1c939a => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:27.024023 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4edf5-50cf-4f65-b048-3bd46dc6279d None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:27.025095 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4edf5-50cf-4f65-b048-3bd46dc6279d None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:27.025593 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4edf5-50cf-4f65-b048-3bd46dc6279d None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:27.027542 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 48/98] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:14:27.033270 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c8cad-4dc8-4d79-a480-d8243b20ff37 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:27.034107 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c8cad-4dc8-4d79-a480-d8243b20ff37 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:27.034669 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c8cad-4dc8-4d79-a480-d8243b20ff37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:27.056454 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-db8c8cad-4dc8-4d79-a480-d8243b20ff37 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:27.058002 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-db8c8cad-4dc8-4d79-a480-d8243b20ff37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:27.143954 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 51/99] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:14:27.182774 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4edf5-50cf-4f65-b048-3bd46dc6279d None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:27.236254 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:27.354902 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4edf5-50cf-4f65-b048-3bd46dc6279d None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:27.403494 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c1c79-32a8-43da-b8ec-de0123de1b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:27.404651 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c1c79-32a8-43da-b8ec-de0123de1b11 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:27.405162 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c1c79-32a8-43da-b8ec-de0123de1b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:27.405636 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c1c79-32a8-43da-b8ec-de0123de1b11 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:27.420590 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89c1c79-32a8-43da-b8ec-de0123de1b11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:14:27.428949 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-a89c1c79-32a8-43da-b8ec-de0123de1b11 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 19:14:27.428949 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:14:27.428949 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:14:27.428949 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:14:27.428949 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:14:27.428949 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:14:27.428949 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:14:27.428949 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:14:27.428949 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:14:27.428949 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:14:27.428949 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:14:27.428949 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:14:27.428949 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:14:27.428949 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:14:27.428949 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:14:27.428949 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:14:27.429840 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:14:27.429840 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:14:27.429840 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:14:27.429840 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:14:27.429840 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:14:27.429840 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:14:27.429840 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:14:27.429840 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:14:27.429840 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:14:27.429840 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:14:27.429840 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:14:27.429840 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:14:27.429840 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:14:27.429840 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:14:27.429840 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:14:27.429840 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:14:27.430681 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:14:27.430681 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:14:27.430681 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:14:27.430681 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:14:27.430681 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:14:27.430681 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:14:27.430681 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:14:27.430681 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:14:27.430681 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:14:27.430681 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:14:27.430681 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 19:14:27.430681 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:14:27.430681 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 49/100] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:14:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:14:27.436000 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c8cad-4dc8-4d79-a480-d8243b20ff37 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:27.561523 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42e3f5-fb61-43d5-b2bf-1c9533dbbf3f None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:27.561871 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42e3f5-fb61-43d5-b2bf-1c9533dbbf3f None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:27.562086 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42e3f5-fb61-43d5-b2bf-1c9533dbbf3f None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:27.563477 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 50/101] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:14:27.568832 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bba75-b6e3-4362-80e5-58dec1cad171 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:27.569123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bba75-b6e3-4362-80e5-58dec1cad171 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:27.569402 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bba75-b6e3-4362-80e5-58dec1cad171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:27.598400 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c8cad-4dc8-4d79-a480-d8243b20ff37 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:27.603945 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-196bba75-b6e3-4362-80e5-58dec1cad171 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:27.605246 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-196bba75-b6e3-4362-80e5-58dec1cad171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:27.665079 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:27.697415 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74990f18-a7aa-4db5-9097-24673593f82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:27.698315 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74990f18-a7aa-4db5-9097-24673593f82d None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:27.698612 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74990f18-a7aa-4db5-9097-24673593f82d None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:27.698948 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74990f18-a7aa-4db5-9097-24673593f82d None admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:27.699745 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74990f18-a7aa-4db5-9097-24673593f82d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:27.700067 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74990f18-a7aa-4db5-9097-24673593f82d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:27.701528 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74990f18-a7aa-4db5-9097-24673593f82d None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:27.722771 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 52/102] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Jul 21 19:14:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:27.728711 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74990f18-a7aa-4db5-9097-24673593f82d None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:27.789485 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 51/103] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:14:27.816790 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459845c-7d1b-4235-a796-a13b8808ebd4 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:27.817330 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459845c-7d1b-4235-a796-a13b8808ebd4 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:27.817769 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459845c-7d1b-4235-a796-a13b8808ebd4 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:27.819424 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 52/104] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 19:14:27.825792 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033c484-1863-485f-b5ed-d1c46383113d None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:27.826271 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033c484-1863-485f-b5ed-d1c46383113d None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:27.826704 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033c484-1863-485f-b5ed-d1c46383113d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:27.852008 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-3033c484-1863-485f-b5ed-d1c46383113d None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:27.856674 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3033c484-1863-485f-b5ed-d1c46383113d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:27.903804 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:27.939221 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74990f18-a7aa-4db5-9097-24673593f82d None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:27.995865 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 53/105] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:14:27.996750 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033c484-1863-485f-b5ed-d1c46383113d None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:28.018793 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83e5a1-5e12-4c1b-92db-8f942046d000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:28.019733 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83e5a1-5e12-4c1b-92db-8f942046d000 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:28.020022 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83e5a1-5e12-4c1b-92db-8f942046d000 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:28.020304 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83e5a1-5e12-4c1b-92db-8f942046d000 None admin] PATH_INFO: `/v3/users/14244fc2bbdc43c489492090c4f6e5a7` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:28.040207 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a83e5a1-5e12-4c1b-92db-8f942046d000 None admin] RBAC: Authorizing `identity:get_user(user_id=14244fc2bbdc43c489492090c4f6e5a7)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:28.042638 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a83e5a1-5e12-4c1b-92db-8f942046d000 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:28.045951 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 53/106] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:14:27 2022] GET /identity/v3/users/14244fc2bbdc43c489492090c4f6e5a7 => generated 289 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:14:28.047761 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83e5a1-5e12-4c1b-92db-8f942046d000 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:28.128306 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033c484-1863-485f-b5ed-d1c46383113d None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:28.140136 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:28.180445 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf00380-2411-4cd0-8f44-b832a850125c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:28.181871 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf00380-2411-4cd0-8f44-b832a850125c None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:28.182162 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf00380-2411-4cd0-8f44-b832a850125c None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:28.182441 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf00380-2411-4cd0-8f44-b832a850125c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:28.200891 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf00380-2411-4cd0-8f44-b832a850125c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:14:28.215333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-cdf00380-2411-4cd0-8f44-b832a850125c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 19:14:28.215333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:14:28.215333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:14:28.215333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:14:28.215333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:14:28.215333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:14:28.215333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:14:28.215333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:14:28.215333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:14:28.215333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:14:28.215333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:14:28.215333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:14:28.215333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:14:28.215333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:14:28.215333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:14:28.215333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:14:28.218812 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:14:28.218812 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:14:28.218812 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:14:28.218812 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:14:28.218812 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:14:28.218812 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:14:28.218812 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:14:28.218812 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:14:28.218812 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:14:28.218812 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:14:28.218812 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:14:28.218812 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:14:28.218812 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:14:28.218812 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:14:28.218812 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:14:28.218812 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:14:28.219587 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:14:28.219587 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:14:28.219587 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:14:28.219587 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:14:28.219587 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:14:28.219587 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:14:28.219587 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:14:28.219587 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:14:28.219587 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:14:28.219587 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:14:28.219587 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 19:14:28.219587 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:14:28.221207 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 54/107] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:14:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:14:28.225392 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf00380-2411-4cd0-8f44-b832a850125c None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:28.231294 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83e5a1-5e12-4c1b-92db-8f942046d000 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:28.257944 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:28.293660 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92409b-087c-4afc-824d-aa83f178695c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:28.295360 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92409b-087c-4afc-824d-aa83f178695c None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:28.296110 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92409b-087c-4afc-824d-aa83f178695c None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:28.296791 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92409b-087c-4afc-824d-aa83f178695c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:28.299624 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a92409b-087c-4afc-824d-aa83f178695c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:28.304247 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a92409b-087c-4afc-824d-aa83f178695c None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:28.309262 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 54/108] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:14:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:28.310904 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92409b-087c-4afc-824d-aa83f178695c None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:28.359205 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf00380-2411-4cd0-8f44-b832a850125c None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:28.398721 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f0332-c7e9-4509-9162-881f2ab32899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:28.400024 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f0332-c7e9-4509-9162-881f2ab32899 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:28.400588 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f0332-c7e9-4509-9162-881f2ab32899 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:28.401125 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f0332-c7e9-4509-9162-881f2ab32899 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:28.478562 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92409b-087c-4afc-824d-aa83f178695c None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:28.479648 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f0332-c7e9-4509-9162-881f2ab32899 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:28.481158 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f0332-c7e9-4509-9162-881f2ab32899 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:28.491911 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:28.499058 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:28.514466 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167c756-6d18-435f-ba86-cdcef1a9f9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:28.515144 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167c756-6d18-435f-ba86-cdcef1a9f9e7 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:28.515504 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167c756-6d18-435f-ba86-cdcef1a9f9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:28.515795 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167c756-6d18-435f-ba86-cdcef1a9f9e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:28.516559 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3167c756-6d18-435f-ba86-cdcef1a9f9e7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:28.516922 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3167c756-6d18-435f-ba86-cdcef1a9f9e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:28.518360 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3167c756-6d18-435f-ba86-cdcef1a9f9e7 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:28.527031 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 55/109] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Jul 21 19:14:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:28.528725 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954cb1b-c5dd-491a-81e6-32dff90c001f None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:28.529540 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954cb1b-c5dd-491a-81e6-32dff90c001f None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:28.529891 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954cb1b-c5dd-491a-81e6-32dff90c001f None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:28.531235 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 56/110] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:14:28.532137 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954cb1b-c5dd-491a-81e6-32dff90c001f None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:28.603990 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 55/111] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:14:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 19:14:28.605654 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302f14d-3d9a-4e0e-8d80-b8551a2c61c0 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:28.605948 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302f14d-3d9a-4e0e-8d80-b8551a2c61c0 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:28.606231 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302f14d-3d9a-4e0e-8d80-b8551a2c61c0 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:28.608305 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 56/112] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:14:28.608519 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302f14d-3d9a-4e0e-8d80-b8551a2c61c0 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:28.642916 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954cb1b-c5dd-491a-81e6-32dff90c001f None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:28.679154 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c5e84-aa2d-44c9-b78d-8e53c1c52c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:28.679774 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c5e84-aa2d-44c9-b78d-8e53c1c52c06 None admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:28.680068 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c5e84-aa2d-44c9-b78d-8e53c1c52c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:28.680354 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c5e84-aa2d-44c9-b78d-8e53c1c52c06 None admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:28.681726 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c5e84-aa2d-44c9-b78d-8e53c1c52c06 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:28.683178 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c5e84-aa2d-44c9-b78d-8e53c1c52c06 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:28.729810 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302f14d-3d9a-4e0e-8d80-b8551a2c61c0 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:28.746693 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:28.763592 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139363b-111d-4298-b2a8-94598a356c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:28.764462 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139363b-111d-4298-b2a8-94598a356c5d None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:28.764750 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139363b-111d-4298-b2a8-94598a356c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:28.765031 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139363b-111d-4298-b2a8-94598a356c5d None admin] PATH_INFO: `/v3/users/c85d049ff6344e709f0b3295a93105c8` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:28.766256 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139363b-111d-4298-b2a8-94598a356c5d None admin] RBAC: Authorizing `identity:get_user(user_id=c85d049ff6344e709f0b3295a93105c8)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:28.767741 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139363b-111d-4298-b2a8-94598a356c5d None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:28.769366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 57/113] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:14:28 2022] GET /identity/v3/users/c85d049ff6344e709f0b3295a93105c8 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:28.770485 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70569f1d-8aff-43cf-aeac-237a8003a0c0 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:28.770773 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70569f1d-8aff-43cf-aeac-237a8003a0c0 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:28.771053 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70569f1d-8aff-43cf-aeac-237a8003a0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:28.780872 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 57/114] 10.222.0.60 () {60 vars in 1141 bytes} [Thu Jul 21 19:14:28 2022] POST /identity/v3/projects => generated 302 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:14:28.784790 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c5e84-aa2d-44c9-b78d-8e53c1c52c06 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:28.802575 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-70569f1d-8aff-43cf-aeac-237a8003a0c0 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:28.803875 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-70569f1d-8aff-43cf-aeac-237a8003a0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:28.813560 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:28.886544 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 58/115] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:14:28.891671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d30aa-3c74-41b2-988e-5b516fb81126 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:28.891671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d30aa-3c74-41b2-988e-5b516fb81126 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:28.891671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d30aa-3c74-41b2-988e-5b516fb81126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:28.904173 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c5e84-aa2d-44c9-b78d-8e53c1c52c06 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:28.921829 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-e37d30aa-3c74-41b2-988e-5b516fb81126 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:28.923071 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-e37d30aa-3c74-41b2-988e-5b516fb81126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:28.949097 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef61f1-d0f8-4356-9816-f91e6abff1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:28.949896 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef61f1-d0f8-4356-9816-f91e6abff1af None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:28.950186 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef61f1-d0f8-4356-9816-f91e6abff1af None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:28.950469 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef61f1-d0f8-4356-9816-f91e6abff1af None admin] PATH_INFO: `/v3/projects/0180b37d7e6843eaa90e0d081ade9da8` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:28.952533 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ef61f1-d0f8-4356-9816-f91e6abff1af None admin] RBAC: Authorizing `identity:get_project(project_id=0180b37d7e6843eaa90e0d081ade9da8)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:28.953994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ef61f1-d0f8-4356-9816-f91e6abff1af None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:28.956134 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 58/116] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:14:28 2022] GET /identity/v3/projects/0180b37d7e6843eaa90e0d081ade9da8 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:28.956978 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0444e60-e7df-4fe4-8c6c-3ceeac24156d None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:28.957267 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0444e60-e7df-4fe4-8c6c-3ceeac24156d None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:28.957545 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0444e60-e7df-4fe4-8c6c-3ceeac24156d None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:28.958911 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 59/117] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:14:28.959478 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0444e60-e7df-4fe4-8c6c-3ceeac24156d None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:29.006756 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 59/118] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:14:29.011468 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d30aa-3c74-41b2-988e-5b516fb81126 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:29.064156 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:29.065519 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:29.074217 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0444e60-e7df-4fe4-8c6c-3ceeac24156d None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:29.109529 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d9e22-38f8-4836-9704-3e94681c923c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:29.118499 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d9e22-38f8-4836-9704-3e94681c923c None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:29.118499 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d9e22-38f8-4836-9704-3e94681c923c None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:29.118499 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d9e22-38f8-4836-9704-3e94681c923c None admin] PATH_INFO: `/v3/projects/0180b37d7e6843eaa90e0d081ade9da8` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:29.118499 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d9e22-38f8-4836-9704-3e94681c923c None admin] RBAC: Authorizing `identity:get_project(project_id=0180b37d7e6843eaa90e0d081ade9da8)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:29.118499 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d9e22-38f8-4836-9704-3e94681c923c None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:29.118499 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 60/119] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:14:28 2022] GET /identity/v3/projects/0180b37d7e6843eaa90e0d081ade9da8 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:29.119005 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d9e22-38f8-4836-9704-3e94681c923c None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:29.123102 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d30aa-3c74-41b2-988e-5b516fb81126 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:29.159380 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110749c4-eb40-4494-8a9e-2d8943a5bce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:29.160225 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110749c4-eb40-4494-8a9e-2d8943a5bce6 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:29.160516 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110749c4-eb40-4494-8a9e-2d8943a5bce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:29.160800 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110749c4-eb40-4494-8a9e-2d8943a5bce6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:29.171973 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110749c4-eb40-4494-8a9e-2d8943a5bce6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:14:29.180216 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-110749c4-eb40-4494-8a9e-2d8943a5bce6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 19:14:29.180216 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:14:29.180216 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:14:29.180216 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:14:29.180216 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:14:29.180216 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:14:29.180216 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:14:29.180216 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:14:29.180216 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:14:29.180216 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:14:29.180216 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:14:29.180216 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:14:29.180216 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:14:29.180216 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:14:29.180216 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:14:29.180216 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:14:29.181141 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:14:29.181141 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:14:29.181141 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:14:29.181141 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:14:29.181141 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:14:29.181141 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:14:29.181141 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:14:29.181141 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:14:29.181141 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:14:29.181141 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:14:29.181141 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:14:29.181141 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:14:29.181141 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:14:29.181141 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:14:29.181141 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:14:29.181141 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:14:29.181896 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:14:29.181896 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:14:29.181896 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:14:29.181896 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:14:29.181896 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:14:29.181896 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:14:29.181896 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:14:29.181896 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:14:29.181896 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:14:29.181896 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:14:29.181896 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 19:14:29.181896 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:14:29.181896 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 60/120] 10.222.0.60 () {56 vars in 1114 bytes} [Thu Jul 21 19:14:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:14:29.183214 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62793ce3-6670-4fe5-90ce-37d023929341 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:29.183214 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62793ce3-6670-4fe5-90ce-37d023929341 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:29.183214 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62793ce3-6670-4fe5-90ce-37d023929341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:29.204383 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-62793ce3-6670-4fe5-90ce-37d023929341 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:29.204383 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-62793ce3-6670-4fe5-90ce-37d023929341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:29.289869 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d9e22-38f8-4836-9704-3e94681c923c None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:29.327348 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4249df-cb5c-4f9f-a411-23c49de503fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:29.328067 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4249df-cb5c-4f9f-a411-23c49de503fb None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:29.328357 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4249df-cb5c-4f9f-a411-23c49de503fb None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:29.328640 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4249df-cb5c-4f9f-a411-23c49de503fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:29.329480 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4249df-cb5c-4f9f-a411-23c49de503fb None admin] RBAC: Adding query filter params (role.id=9d25a11a44b24a3eb36a9ecd8d89321d, scope.project.id=0180b37d7e6843eaa90e0d081ade9da8, user.id=14244fc2bbdc43c489492090c4f6e5a7) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:29.329800 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4249df-cb5c-4f9f-a411-23c49de503fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:29.331246 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4249df-cb5c-4f9f-a411-23c49de503fb None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:29.334287 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 61/121] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:14:29.335350 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62793ce3-6670-4fe5-90ce-37d023929341 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:29.347469 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 61/122] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:14:29 2022] GET /identity/v3/role_assignments?user.id=14244fc2bbdc43c489492090c4f6e5a7&scope.project.id=0180b37d7e6843eaa90e0d081ade9da8&role.id=9d25a11a44b24a3eb36a9ecd8d89321d => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:29.348418 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4249df-cb5c-4f9f-a411-23c49de503fb None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:29.377045 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:29.388180 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:29.468612 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62793ce3-6670-4fe5-90ce-37d023929341 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:29.504966 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4249df-cb5c-4f9f-a411-23c49de503fb None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:29.517177 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351962d-18dd-4b87-b9ec-bc054ca0b10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:29.518047 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351962d-18dd-4b87-b9ec-bc054ca0b10b None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:29.518346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351962d-18dd-4b87-b9ec-bc054ca0b10b None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:29.518626 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351962d-18dd-4b87-b9ec-bc054ca0b10b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:29.535420 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a351962d-18dd-4b87-b9ec-bc054ca0b10b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:14:29.543871 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-a351962d-18dd-4b87-b9ec-bc054ca0b10b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:14:29.543871 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:14:29.543871 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:14:29.543871 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:14:29.543871 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:14:29.543871 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:14:29.543871 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:14:29.543871 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:14:29.543871 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:14:29.543871 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:14:29.543871 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:14:29.543871 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:14:29.543871 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:14:29.543871 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:14:29.543871 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:14:29.543871 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:14:29.544738 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:14:29.544738 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:14:29.544738 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:14:29.544738 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:14:29.544738 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:14:29.544738 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:14:29.544738 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:14:29.544738 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:14:29.544738 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:14:29.544738 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:14:29.544738 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:14:29.544738 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:14:29.544738 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:14:29.544738 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:14:29.544738 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:14:29.544738 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:14:29.545489 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:14:29.545489 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:14:29.545489 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:14:29.545489 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:14:29.545489 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:14:29.545489 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:14:29.545489 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:14:29.545489 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:14:29.545489 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:14:29.545489 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:14:29.545489 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:14:29.545489 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:14:29.545489 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 62/123] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Jul 21 19:14:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:14:29.546122 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351962d-18dd-4b87-b9ec-bc054ca0b10b None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:29.554349 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525afaf-b5ff-4d34-ac03-b620066b7db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:29.556054 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525afaf-b5ff-4d34-ac03-b620066b7db4 None admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:29.556499 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525afaf-b5ff-4d34-ac03-b620066b7db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:29.556923 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525afaf-b5ff-4d34-ac03-b620066b7db4 None admin] PATH_INFO: `/v3/projects/0180b37d7e6843eaa90e0d081ade9da8/users/c85d049ff6344e709f0b3295a93105c8/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:29.560055 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3525afaf-b5ff-4d34-ac03-b620066b7db4 None admin] RBAC: Authorizing `identity:create_grant(project_id=0180b37d7e6843eaa90e0d081ade9da8, user_id=c85d049ff6344e709f0b3295a93105c8, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:29.562276 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3525afaf-b5ff-4d34-ac03-b620066b7db4 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:29.645976 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:29.653484 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351962d-18dd-4b87-b9ec-bc054ca0b10b None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:29.658930 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 62/124] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Jul 21 19:14:29 2022] PUT /identity/v3/projects/0180b37d7e6843eaa90e0d081ade9da8/users/c85d049ff6344e709f0b3295a93105c8/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:14:29.660088 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525afaf-b5ff-4d34-ac03-b620066b7db4 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:29.692465 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49a88d-4628-4e31-a36a-95e8218424f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:29.693191 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49a88d-4628-4e31-a36a-95e8218424f9 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:29.693482 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49a88d-4628-4e31-a36a-95e8218424f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:29.693810 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49a88d-4628-4e31-a36a-95e8218424f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:29.694610 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49a88d-4628-4e31-a36a-95e8218424f9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:29.694929 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49a88d-4628-4e31-a36a-95e8218424f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:29.697342 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49a88d-4628-4e31-a36a-95e8218424f9 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:29.707115 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 63/125] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:14:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:29.708007 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49a88d-4628-4e31-a36a-95e8218424f9 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:29.793941 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:29.815735 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525afaf-b5ff-4d34-ac03-b620066b7db4 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:29.826759 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49a88d-4628-4e31-a36a-95e8218424f9 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:29.856895 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c42599-97c3-46e3-88bd-9f658f04062a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:29.858116 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c42599-97c3-46e3-88bd-9f658f04062a None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:29.858600 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c42599-97c3-46e3-88bd-9f658f04062a None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:29.859072 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c42599-97c3-46e3-88bd-9f658f04062a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:29.865730 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c664f4f-116e-48ed-9220-18e6b9255480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:29.866431 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c664f4f-116e-48ed-9220-18e6b9255480 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:29.866702 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c664f4f-116e-48ed-9220-18e6b9255480 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:29.866990 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c664f4f-116e-48ed-9220-18e6b9255480 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:29.867772 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c664f4f-116e-48ed-9220-18e6b9255480 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:29.868818 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c664f4f-116e-48ed-9220-18e6b9255480 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:29.870397 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c664f4f-116e-48ed-9220-18e6b9255480 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:29.873583 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c42599-97c3-46e3-88bd-9f658f04062a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:14:29.880511 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 64/126] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:14:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:29.881452 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c664f4f-116e-48ed-9220-18e6b9255480 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:29.892492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-55c42599-97c3-46e3-88bd-9f658f04062a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 19:14:29.892492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:14:29.892492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:14:29.892492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:14:29.892492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:14:29.892492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:14:29.892492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:14:29.892492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:14:29.892492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:14:29.892492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:14:29.892492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:14:29.892492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:14:29.892492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:14:29.892492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:14:29.892492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:14:29.892492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:14:29.900698 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:14:29.900698 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:14:29.900698 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:14:29.900698 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:14:29.900698 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:14:29.900698 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:14:29.900698 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:14:29.900698 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:14:29.900698 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:14:29.900698 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:14:29.900698 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:14:29.900698 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:14:29.900698 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:14:29.900698 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:14:29.900698 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:14:29.900698 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:14:29.901666 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:14:29.901666 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:14:29.901666 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:14:29.901666 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:14:29.901666 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:14:29.901666 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:14:29.901666 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:14:29.901666 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:14:29.901666 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:14:29.901666 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:14:29.901666 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 19:14:29.901666 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:14:29.901666 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 63/127] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:14:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:14:29.901666 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c42599-97c3-46e3-88bd-9f658f04062a None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:29.903724 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:29.993712 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c664f4f-116e-48ed-9220-18e6b9255480 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:30.005680 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c42599-97c3-46e3-88bd-9f658f04062a None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:30.031349 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb6d50-4e63-4918-98d4-843ff81a5214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:30.032273 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb6d50-4e63-4918-98d4-843ff81a5214 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:30.032557 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb6d50-4e63-4918-98d4-843ff81a5214 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:30.033679 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb6d50-4e63-4918-98d4-843ff81a5214 None admin] PATH_INFO: `/v3/users/c85d049ff6344e709f0b3295a93105c8` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:30.034940 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb6d50-4e63-4918-98d4-843ff81a5214 None admin] RBAC: Authorizing `identity:get_user(user_id=c85d049ff6344e709f0b3295a93105c8)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:30.036441 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb6d50-4e63-4918-98d4-843ff81a5214 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:30.038268 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 65/128] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:14:29 2022] GET /identity/v3/users/c85d049ff6344e709f0b3295a93105c8 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:30.038937 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb6d50-4e63-4918-98d4-843ff81a5214 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:30.046731 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112016a-0d34-4df8-9605-917e1d4ed2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:30.047597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112016a-0d34-4df8-9605-917e1d4ed2d5 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:30.047886 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112016a-0d34-4df8-9605-917e1d4ed2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:30.048165 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112016a-0d34-4df8-9605-917e1d4ed2d5 None admin] PATH_INFO: `/v3/users/9e09a8e247ab497cad13b7109b21b1c9` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:30.049389 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0112016a-0d34-4df8-9605-917e1d4ed2d5 None admin] RBAC: Authorizing `identity:get_user(user_id=9e09a8e247ab497cad13b7109b21b1c9)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:30.050853 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0112016a-0d34-4df8-9605-917e1d4ed2d5 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:30.052777 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 64/129] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:14:29 2022] GET /identity/v3/users/9e09a8e247ab497cad13b7109b21b1c9 => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:30.053542 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112016a-0d34-4df8-9605-917e1d4ed2d5 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:30.071919 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:30.148739 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:30.164710 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb6d50-4e63-4918-98d4-843ff81a5214 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:30.166438 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112016a-0d34-4df8-9605-917e1d4ed2d5 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:30.215264 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2cf9f-83a3-4f88-a83e-5e70bb854dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:30.216214 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2cf9f-83a3-4f88-a83e-5e70bb854dbb None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:30.216502 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2cf9f-83a3-4f88-a83e-5e70bb854dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:30.216779 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2cf9f-83a3-4f88-a83e-5e70bb854dbb None admin] PATH_INFO: `/v3/projects/0180b37d7e6843eaa90e0d081ade9da8` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:30.221613 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d2cf9f-83a3-4f88-a83e-5e70bb854dbb None admin] RBAC: Authorizing `identity:get_project(project_id=0180b37d7e6843eaa90e0d081ade9da8)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:30.223088 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d2cf9f-83a3-4f88-a83e-5e70bb854dbb None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:30.227165 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 65/130] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:14:30 2022] GET /identity/v3/projects/0180b37d7e6843eaa90e0d081ade9da8 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:30.228031 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2cf9f-83a3-4f88-a83e-5e70bb854dbb None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:30.229523 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e44bca-0882-4754-b598-c76ad6a9a7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:30.230243 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e44bca-0882-4754-b598-c76ad6a9a7e0 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:30.230528 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e44bca-0882-4754-b598-c76ad6a9a7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:30.230905 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e44bca-0882-4754-b598-c76ad6a9a7e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:30.231707 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e44bca-0882-4754-b598-c76ad6a9a7e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:30.232018 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e44bca-0882-4754-b598-c76ad6a9a7e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:30.233398 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e44bca-0882-4754-b598-c76ad6a9a7e0 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:30.254098 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 66/131] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Jul 21 19:14:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:30.254926 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e44bca-0882-4754-b598-c76ad6a9a7e0 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:30.404522 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e44bca-0882-4754-b598-c76ad6a9a7e0 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:30.443872 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:30.450753 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8c308-2ae2-4cb2-9ea9-fd775cdd03f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:30.451701 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8c308-2ae2-4cb2-9ea9-fd775cdd03f0 None admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:30.452142 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8c308-2ae2-4cb2-9ea9-fd775cdd03f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:30.452243 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8c308-2ae2-4cb2-9ea9-fd775cdd03f0 None admin] PATH_INFO: `/v3/projects/0180b37d7e6843eaa90e0d081ade9da8/users/c85d049ff6344e709f0b3295a93105c8/roles/3ad609555dec437d92e5c7291b1c939a` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:30.458687 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8c308-2ae2-4cb2-9ea9-fd775cdd03f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=0180b37d7e6843eaa90e0d081ade9da8, user_id=c85d049ff6344e709f0b3295a93105c8, role_id=3ad609555dec437d92e5c7291b1c939a)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:30.461733 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8c308-2ae2-4cb2-9ea9-fd775cdd03f0 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:30.475118 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2cf9f-83a3-4f88-a83e-5e70bb854dbb None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:30.511774 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed69730-40f8-4a7f-af0d-769996c828a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:30.512653 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed69730-40f8-4a7f-af0d-769996c828a4 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:30.512944 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed69730-40f8-4a7f-af0d-769996c828a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:30.513299 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed69730-40f8-4a7f-af0d-769996c828a4 None admin] PATH_INFO: `/v3/projects/0180b37d7e6843eaa90e0d081ade9da8` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:30.514476 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed69730-40f8-4a7f-af0d-769996c828a4 None admin] RBAC: Authorizing `identity:get_project(project_id=0180b37d7e6843eaa90e0d081ade9da8)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:30.516043 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed69730-40f8-4a7f-af0d-769996c828a4 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:30.517918 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 66/132] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:14:30 2022] GET /identity/v3/projects/0180b37d7e6843eaa90e0d081ade9da8 => generated 298 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:30.518563 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed69730-40f8-4a7f-af0d-769996c828a4 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:30.620234 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed69730-40f8-4a7f-af0d-769996c828a4 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:30.642344 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 67/133] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Jul 21 19:14:30 2022] PUT /identity/v3/projects/0180b37d7e6843eaa90e0d081ade9da8/users/c85d049ff6344e709f0b3295a93105c8/roles/3ad609555dec437d92e5c7291b1c939a => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:14:30.642959 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8c308-2ae2-4cb2-9ea9-fd775cdd03f0 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:30.662342 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:30.667473 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610cccc4-a852-4916-acc4-258dd67631e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:30.668366 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cccc4-a852-4916-acc4-258dd67631e8 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:30.668654 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cccc4-a852-4916-acc4-258dd67631e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:30.668934 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cccc4-a852-4916-acc4-258dd67631e8 None admin] PATH_INFO: `/v3/users/c85d049ff6344e709f0b3295a93105c8` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:30.670237 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610cccc4-a852-4916-acc4-258dd67631e8 None admin] RBAC: Authorizing `identity:get_user(user_id=c85d049ff6344e709f0b3295a93105c8)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:30.671812 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610cccc4-a852-4916-acc4-258dd67631e8 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:30.675493 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 67/134] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:14:30 2022] GET /identity/v3/users/c85d049ff6344e709f0b3295a93105c8 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:30.684609 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610cccc4-a852-4916-acc4-258dd67631e8 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:30.729206 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:30.865626 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8c308-2ae2-4cb2-9ea9-fd775cdd03f0 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:30.896887 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610cccc4-a852-4916-acc4-258dd67631e8 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:30.932487 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342929d-4753-46f0-b3c8-996fe807b2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:30.933353 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342929d-4753-46f0-b3c8-996fe807b2a3 None admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:30.933644 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342929d-4753-46f0-b3c8-996fe807b2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:30.933934 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342929d-4753-46f0-b3c8-996fe807b2a3 None admin] PATH_INFO: `/v3/projects/0180b37d7e6843eaa90e0d081ade9da8/users/9e09a8e247ab497cad13b7109b21b1c9/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:30.936293 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2342929d-4753-46f0-b3c8-996fe807b2a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=0180b37d7e6843eaa90e0d081ade9da8, user_id=9e09a8e247ab497cad13b7109b21b1c9, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:30.937781 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2342929d-4753-46f0-b3c8-996fe807b2a3 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:30.943751 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fdfc93-5012-4b96-88c0-fe172d932d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:30.945282 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdfc93-5012-4b96-88c0-fe172d932d17 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:30.945577 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdfc93-5012-4b96-88c0-fe172d932d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:30.945866 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdfc93-5012-4b96-88c0-fe172d932d17 None admin] PATH_INFO: `/v3/projects/8ef327054d074c54ba32059ee735417c` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:30.949083 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fdfc93-5012-4b96-88c0-fe172d932d17 None admin] RBAC: Authorizing `identity:get_project(project_id=8ef327054d074c54ba32059ee735417c)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:30.950632 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fdfc93-5012-4b96-88c0-fe172d932d17 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:30.957231 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 68/135] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:14:30 2022] GET /identity/v3/projects/8ef327054d074c54ba32059ee735417c => generated 312 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:30.958549 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fdfc93-5012-4b96-88c0-fe172d932d17 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:31.054314 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 68/136] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Jul 21 19:14:30 2022] PUT /identity/v3/projects/0180b37d7e6843eaa90e0d081ade9da8/users/9e09a8e247ab497cad13b7109b21b1c9/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:14:31.085262 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:31.106544 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fdfc93-5012-4b96-88c0-fe172d932d17 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:31.157199 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd0a8a-d991-48ad-a780-00928071d731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:31.158144 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd0a8a-d991-48ad-a780-00928071d731 None admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:31.158511 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd0a8a-d991-48ad-a780-00928071d731 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:31.158802 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd0a8a-d991-48ad-a780-00928071d731 None admin] PATH_INFO: `/v3/projects/8ef327054d074c54ba32059ee735417c/users/c85d049ff6344e709f0b3295a93105c8/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:31.160993 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd0a8a-d991-48ad-a780-00928071d731 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ef327054d074c54ba32059ee735417c, user_id=c85d049ff6344e709f0b3295a93105c8, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:31.184804 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd0a8a-d991-48ad-a780-00928071d731 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:31.346352 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042185b-feac-42ff-83c1-9c11d63d36e6 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:31.346871 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042185b-feac-42ff-83c1-9c11d63d36e6 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:31.346952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042185b-feac-42ff-83c1-9c11d63d36e6 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:31.348364 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 69/137] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 19:14:31.356370 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c47470-d2c4-4ae5-9609-9ef370be9be5 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:31.356370 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c47470-d2c4-4ae5-9609-9ef370be9be5 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:31.356370 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c47470-d2c4-4ae5-9609-9ef370be9be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:31.375290 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-92c47470-d2c4-4ae5-9609-9ef370be9be5 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:31.376592 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-92c47470-d2c4-4ae5-9609-9ef370be9be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:31.376825 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 69/138] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Jul 21 19:14:30 2022] PUT /identity/v3/projects/8ef327054d074c54ba32059ee735417c/users/c85d049ff6344e709f0b3295a93105c8/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:14:31.458045 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:31.465340 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 70/139] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 19:14:31.491396 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd0a8a-d991-48ad-a780-00928071d731 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:31.642945 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd0a8a-d991-48ad-a780-00928071d731 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:31.686984 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793e14e-739a-45eb-bfea-5780107cadab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:31.687823 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793e14e-739a-45eb-bfea-5780107cadab None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:31.688114 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793e14e-739a-45eb-bfea-5780107cadab None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:31.688395 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793e14e-739a-45eb-bfea-5780107cadab None admin] PATH_INFO: `/v3/domains/default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:31.692163 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793e14e-739a-45eb-bfea-5780107cadab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:31.693683 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793e14e-739a-45eb-bfea-5780107cadab None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:31.695350 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 70/140] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:14:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:31.701481 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c47470-d2c4-4ae5-9609-9ef370be9be5 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:31.825949 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c47470-d2c4-4ae5-9609-9ef370be9be5 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:31.872835 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ed47f-a820-450e-97a2-8de954d2f511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:31.873534 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ed47f-a820-450e-97a2-8de954d2f511 None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:31.873825 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ed47f-a820-450e-97a2-8de954d2f511 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:31.874109 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ed47f-a820-450e-97a2-8de954d2f511 None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:31.874837 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ed47f-a820-450e-97a2-8de954d2f511 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:31.876454 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ed47f-a820-450e-97a2-8de954d2f511 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:32.025916 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 71/141] 10.222.0.60 () {60 vars in 1132 bytes} [Thu Jul 21 19:14:31 2022] POST /identity/v3/users => generated 283 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:14:32.191785 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe0fda-2c2c-4a80-a2d6-008cd2a376fe None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:32.192283 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe0fda-2c2c-4a80-a2d6-008cd2a376fe None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:32.192356 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe0fda-2c2c-4a80-a2d6-008cd2a376fe None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:32.193788 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 71/142] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:14:32.209197 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73afd45-79bc-4d5b-ad3a-dff5c3aa0e8d None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:32.209579 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73afd45-79bc-4d5b-ad3a-dff5c3aa0e8d None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:32.209910 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73afd45-79bc-4d5b-ad3a-dff5c3aa0e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:32.236779 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-e73afd45-79bc-4d5b-ad3a-dff5c3aa0e8d None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:32.238179 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-e73afd45-79bc-4d5b-ad3a-dff5c3aa0e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:32.312174 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:32.338207 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 72/143] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:14:32.380941 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe0fda-2c2c-4a80-a2d6-008cd2a376fe None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:32.406437 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:32.479104 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f803b6-b6ae-4716-babf-9a0941a69e92 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:32.479642 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f803b6-b6ae-4716-babf-9a0941a69e92 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:32.479642 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f803b6-b6ae-4716-babf-9a0941a69e92 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:32.481142 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 73/144] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 19:14:32.486486 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2d6ac-7229-4ebc-b58e-ae4d1f06ad70 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:32.486772 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2d6ac-7229-4ebc-b58e-ae4d1f06ad70 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:32.487052 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2d6ac-7229-4ebc-b58e-ae4d1f06ad70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:32.509215 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-91d2d6ac-7229-4ebc-b58e-ae4d1f06ad70 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:32.510388 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-91d2d6ac-7229-4ebc-b58e-ae4d1f06ad70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:32.541799 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe0fda-2c2c-4a80-a2d6-008cd2a376fe None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:32.608922 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be0fe1-a027-4cd6-b29f-d21d8f9c0295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:32.609729 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be0fe1-a027-4cd6-b29f-d21d8f9c0295 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:32.610013 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be0fe1-a027-4cd6-b29f-d21d8f9c0295 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:32.610289 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be0fe1-a027-4cd6-b29f-d21d8f9c0295 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:32.632416 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be0fe1-a027-4cd6-b29f-d21d8f9c0295 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:14:32.643203 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-b2be0fe1-a027-4cd6-b29f-d21d8f9c0295 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 19:14:32.643203 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:14:32.643203 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:14:32.643203 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:14:32.643203 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:14:32.643203 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:14:32.643203 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:14:32.643203 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:14:32.643203 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:14:32.643203 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:14:32.643203 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:14:32.643203 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:14:32.643203 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:14:32.643203 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:14:32.643203 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:14:32.643203 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:14:32.644114 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:14:32.644114 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:14:32.644114 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:14:32.644114 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:14:32.644114 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:14:32.644114 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:14:32.644114 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:14:32.644114 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:14:32.644114 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:14:32.644114 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:14:32.644114 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:14:32.644114 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:14:32.644114 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:14:32.644114 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:14:32.644114 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:14:32.644114 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:14:32.644879 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:14:32.644879 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:14:32.644879 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:14:32.644879 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:14:32.644879 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:14:32.644879 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:14:32.644879 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:14:32.644879 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:14:32.644879 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:14:32.644879 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:14:32.644879 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 19:14:32.644879 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:14:32.652528 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 74/145] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 19:14:32.654413 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 72/146] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:14:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:14:32.660477 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2d6ac-7229-4ebc-b58e-ae4d1f06ad70 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:32.676551 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be0fe1-a027-4cd6-b29f-d21d8f9c0295 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:32.789027 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2d6ac-7229-4ebc-b58e-ae4d1f06ad70 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:32.817652 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:32.830796 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:32.834828 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3bc75d-5086-46a3-a7f9-cbfa09e84e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:32.835904 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3bc75d-5086-46a3-a7f9-cbfa09e84e62 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:32.836189 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3bc75d-5086-46a3-a7f9-cbfa09e84e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:32.836468 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3bc75d-5086-46a3-a7f9-cbfa09e84e62 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:32.838109 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3bc75d-5086-46a3-a7f9-cbfa09e84e62 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:32.838424 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3bc75d-5086-46a3-a7f9-cbfa09e84e62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:32.839864 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3bc75d-5086-46a3-a7f9-cbfa09e84e62 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:32.863626 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 75/147] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Jul 21 19:14:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:32.872849 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3bc75d-5086-46a3-a7f9-cbfa09e84e62 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:32.882482 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be0fe1-a027-4cd6-b29f-d21d8f9c0295 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:32.925169 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad2a27-d757-4600-8c98-5f6d00a1586d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:32.926030 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad2a27-d757-4600-8c98-5f6d00a1586d None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:32.926325 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad2a27-d757-4600-8c98-5f6d00a1586d None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:32.926605 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad2a27-d757-4600-8c98-5f6d00a1586d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:32.944077 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad2a27-d757-4600-8c98-5f6d00a1586d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:14:32.952905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-67ad2a27-d757-4600-8c98-5f6d00a1586d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 19:14:32.952905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:14:32.952905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:14:32.952905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:14:32.952905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:14:32.952905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:14:32.952905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:14:32.952905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:14:32.952905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:14:32.952905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:14:32.952905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:14:32.952905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:14:32.952905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:14:32.952905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:14:32.952905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:14:32.952905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:14:32.953774 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:14:32.953774 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:14:32.953774 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:14:32.953774 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:14:32.953774 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:14:32.953774 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:14:32.953774 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:14:32.953774 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:14:32.953774 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:14:32.953774 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:14:32.953774 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:14:32.953774 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:14:32.953774 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:14:32.953774 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:14:32.953774 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:14:32.953774 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:14:32.954602 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:14:32.954602 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:14:32.954602 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:14:32.954602 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:14:32.954602 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:14:32.954602 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:14:32.954602 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:14:32.954602 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:14:32.954602 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:14:32.954602 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:14:32.954602 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 19:14:32.954602 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:14:32.954602 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 73/148] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:14:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:14:32.962217 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad2a27-d757-4600-8c98-5f6d00a1586d None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:33.035403 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3bc75d-5086-46a3-a7f9-cbfa09e84e62 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:33.105243 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c513840-fa8d-42fa-adc9-9de3c7e84834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:33.106069 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c513840-fa8d-42fa-adc9-9de3c7e84834 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:33.106351 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c513840-fa8d-42fa-adc9-9de3c7e84834 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:33.106631 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c513840-fa8d-42fa-adc9-9de3c7e84834 None admin] PATH_INFO: `/v3/users/14244fc2bbdc43c489492090c4f6e5a7` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:33.112186 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c513840-fa8d-42fa-adc9-9de3c7e84834 None admin] RBAC: Authorizing `identity:get_user(user_id=14244fc2bbdc43c489492090c4f6e5a7)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:33.113663 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c513840-fa8d-42fa-adc9-9de3c7e84834 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:33.115513 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 76/149] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:14:32 2022] GET /identity/v3/users/14244fc2bbdc43c489492090c4f6e5a7 => generated 289 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:33.121989 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c513840-fa8d-42fa-adc9-9de3c7e84834 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:33.194747 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:33.209401 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad2a27-d757-4600-8c98-5f6d00a1586d None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:33.266842 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c513840-fa8d-42fa-adc9-9de3c7e84834 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:33.303689 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0559c8df-2807-4ff0-8122-3e0b8d5e3815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:33.304373 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559c8df-2807-4ff0-8122-3e0b8d5e3815 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:33.304660 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559c8df-2807-4ff0-8122-3e0b8d5e3815 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:33.304947 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559c8df-2807-4ff0-8122-3e0b8d5e3815 None admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:33.306261 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0559c8df-2807-4ff0-8122-3e0b8d5e3815 None admin] RBAC: Adding query filter params (name=member) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:33.306578 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0559c8df-2807-4ff0-8122-3e0b8d5e3815 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:33.308030 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0559c8df-2807-4ff0-8122-3e0b8d5e3815 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:33.309862 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:33.316635 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e2de1-6f23-4aae-b7d0-6b959a61c8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:33.321803 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e2de1-6f23-4aae-b7d0-6b959a61c8c5 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:33.321803 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e2de1-6f23-4aae-b7d0-6b959a61c8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:33.321803 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e2de1-6f23-4aae-b7d0-6b959a61c8c5 None admin] PATH_INFO: `/v3/projects/0180b37d7e6843eaa90e0d081ade9da8` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:33.321803 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833e2de1-6f23-4aae-b7d0-6b959a61c8c5 None admin] RBAC: Authorizing `identity:get_project(project_id=0180b37d7e6843eaa90e0d081ade9da8)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:33.322266 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833e2de1-6f23-4aae-b7d0-6b959a61c8c5 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:33.324287 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 77/150] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:14:33 2022] GET /identity/v3/projects/0180b37d7e6843eaa90e0d081ade9da8 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:14:33.325572 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 74/151] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Jul 21 19:14:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:14:33.329962 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e2de1-6f23-4aae-b7d0-6b959a61c8c5 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:33.331548 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0559c8df-2807-4ff0-8122-3e0b8d5e3815 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:33.471517 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e2de1-6f23-4aae-b7d0-6b959a61c8c5 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:33.491826 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:33.520890 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0559c8df-2807-4ff0-8122-3e0b8d5e3815 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:33.522882 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeffe1b-1ad8-40f9-87e4-cec43f694e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:33.523900 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeffe1b-1ad8-40f9-87e4-cec43f694e24 None admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:33.524219 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeffe1b-1ad8-40f9-87e4-cec43f694e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:33.524500 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeffe1b-1ad8-40f9-87e4-cec43f694e24 None admin] PATH_INFO: `/v3/projects/0180b37d7e6843eaa90e0d081ade9da8/users/14244fc2bbdc43c489492090c4f6e5a7/roles/9d25a11a44b24a3eb36a9ecd8d89321d` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:33.532866 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeffe1b-1ad8-40f9-87e4-cec43f694e24 None admin] RBAC: Authorizing `identity:create_grant(project_id=0180b37d7e6843eaa90e0d081ade9da8, user_id=14244fc2bbdc43c489492090c4f6e5a7, role_id=9d25a11a44b24a3eb36a9ecd8d89321d)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:33.534352 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeffe1b-1ad8-40f9-87e4-cec43f694e24 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:33.572731 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7424984-5df0-49e8-804d-08adc06e8ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:33.573632 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7424984-5df0-49e8-804d-08adc06e8ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:33.573922 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7424984-5df0-49e8-804d-08adc06e8ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:33.574204 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7424984-5df0-49e8-804d-08adc06e8ec8 None admin] PATH_INFO: `/v3/users/c85d049ff6344e709f0b3295a93105c8` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:33.579571 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7424984-5df0-49e8-804d-08adc06e8ec8 None admin] RBAC: Authorizing `identity:get_user(user_id=c85d049ff6344e709f0b3295a93105c8)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:33.581118 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7424984-5df0-49e8-804d-08adc06e8ec8 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:33.583226 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 75/152] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:14:33 2022] GET /identity/v3/users/c85d049ff6344e709f0b3295a93105c8 => generated 275 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:14:33.588682 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7424984-5df0-49e8-804d-08adc06e8ec8 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:33.621979 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 78/153] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Jul 21 19:14:33 2022] PUT /identity/v3/projects/0180b37d7e6843eaa90e0d081ade9da8/users/14244fc2bbdc43c489492090c4f6e5a7/roles/9d25a11a44b24a3eb36a9ecd8d89321d => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:14:33.663138 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:33.711278 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7424984-5df0-49e8-804d-08adc06e8ec8 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:33.758470 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f70f3-b29f-442b-b5f2-d0bf20c99753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:33.759314 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f70f3-b29f-442b-b5f2-d0bf20c99753 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:33.759640 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f70f3-b29f-442b-b5f2-d0bf20c99753 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:33.759921 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f70f3-b29f-442b-b5f2-d0bf20c99753 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:33.773096 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad7afd-23f7-4ecf-b2a0-596d0d572e19 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:33.773382 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad7afd-23f7-4ecf-b2a0-596d0d572e19 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:33.773663 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad7afd-23f7-4ecf-b2a0-596d0d572e19 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:33.775154 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 79/154] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:14:33.804984 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8b0fa-1081-4899-972d-facfa82733b5 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:33.805349 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8b0fa-1081-4899-972d-facfa82733b5 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:33.806151 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8b0fa-1081-4899-972d-facfa82733b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:33.853051 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-07c8b0fa-1081-4899-972d-facfa82733b5 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:33.854278 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-07c8b0fa-1081-4899-972d-facfa82733b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:33.855690 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430f70f3-b29f-442b-b5f2-d0bf20c99753 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:33.857418 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430f70f3-b29f-442b-b5f2-d0bf20c99753 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:33.980381 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 80/155] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:14:33.990792 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:34.025376 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8b0fa-1081-4899-972d-facfa82733b5 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:34.048755 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 76/156] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:14:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 19:14:34.054466 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f70f3-b29f-442b-b5f2-d0bf20c99753 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:34.155507 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8b0fa-1081-4899-972d-facfa82733b5 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:34.163873 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:34.185571 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f70f3-b29f-442b-b5f2-d0bf20c99753 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:34.209162 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6e215-fb60-4fdb-83d9-4218a911ee66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:34.209995 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6e215-fb60-4fdb-83d9-4218a911ee66 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:34.210281 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6e215-fb60-4fdb-83d9-4218a911ee66 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:34.210558 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6e215-fb60-4fdb-83d9-4218a911ee66 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:34.223259 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc135cf-4e21-49e3-bb8c-1d1b2fa226d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:34.224316 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc135cf-4e21-49e3-bb8c-1d1b2fa226d5 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:34.224602 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc135cf-4e21-49e3-bb8c-1d1b2fa226d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:34.224884 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc135cf-4e21-49e3-bb8c-1d1b2fa226d5 None admin] PATH_INFO: `/v3/projects/0180b37d7e6843eaa90e0d081ade9da8` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:34.226375 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc135cf-4e21-49e3-bb8c-1d1b2fa226d5 None admin] RBAC: Authorizing `identity:get_project(project_id=0180b37d7e6843eaa90e0d081ade9da8)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:34.228099 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc135cf-4e21-49e3-bb8c-1d1b2fa226d5 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:34.229504 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6e215-fb60-4fdb-83d9-4218a911ee66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:14:34.230157 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 77/157] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:14:34 2022] GET /identity/v3/projects/0180b37d7e6843eaa90e0d081ade9da8 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:14:34.240518 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc135cf-4e21-49e3-bb8c-1d1b2fa226d5 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:34.245779 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-40e6e215-fb60-4fdb-83d9-4218a911ee66 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 19:14:34.245779 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:14:34.245779 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:14:34.245779 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:14:34.245779 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:14:34.245779 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:14:34.245779 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:14:34.245779 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:14:34.245779 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:14:34.245779 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:14:34.245779 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:14:34.245779 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:14:34.245779 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:14:34.245779 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:14:34.245779 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:14:34.245779 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:14:34.248748 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:14:34.248748 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:14:34.248748 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:14:34.248748 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:14:34.248748 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:14:34.248748 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:14:34.248748 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:14:34.248748 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:14:34.248748 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:14:34.248748 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:14:34.248748 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:14:34.248748 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:14:34.248748 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:14:34.248748 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:14:34.248748 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:14:34.248748 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:14:34.249524 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:14:34.249524 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:14:34.249524 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:14:34.249524 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:14:34.249524 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:14:34.249524 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:14:34.249524 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:14:34.249524 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:14:34.249524 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:14:34.249524 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:14:34.249524 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 19:14:34.249524 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:14:34.255872 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 81/158] 10.222.0.60 () {56 vars in 1114 bytes} [Thu Jul 21 19:14:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:14:34.278332 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6e215-fb60-4fdb-83d9-4218a911ee66 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:34.287254 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:34.393391 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc135cf-4e21-49e3-bb8c-1d1b2fa226d5 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:34.435427 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6e215-fb60-4fdb-83d9-4218a911ee66 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:34.455941 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da5fb4-6d1a-484b-a959-da1054d93a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:34.456705 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da5fb4-6d1a-484b-a959-da1054d93a72 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:34.456993 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da5fb4-6d1a-484b-a959-da1054d93a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:34.457271 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da5fb4-6d1a-484b-a959-da1054d93a72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:34.458121 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24da5fb4-6d1a-484b-a959-da1054d93a72 None admin] RBAC: Adding query filter params (role.id=0af30c087b3541a4847d708dd68464d6, scope.project.id=0180b37d7e6843eaa90e0d081ade9da8, user.id=c85d049ff6344e709f0b3295a93105c8) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:34.458434 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24da5fb4-6d1a-484b-a959-da1054d93a72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:34.460020 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24da5fb4-6d1a-484b-a959-da1054d93a72 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:34.466772 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 78/159] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:14:34 2022] GET /identity/v3/role_assignments?user.id=c85d049ff6344e709f0b3295a93105c8&scope.project.id=0180b37d7e6843eaa90e0d081ade9da8&role.id=0af30c087b3541a4847d708dd68464d6 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:34.500290 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8d7df-7bed-4a2e-a81f-c3b611cdfe53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:34.500935 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8d7df-7bed-4a2e-a81f-c3b611cdfe53 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:34.501190 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8d7df-7bed-4a2e-a81f-c3b611cdfe53 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:34.501467 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8d7df-7bed-4a2e-a81f-c3b611cdfe53 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:34.502236 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8d7df-7bed-4a2e-a81f-c3b611cdfe53 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:34.502545 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8d7df-7bed-4a2e-a81f-c3b611cdfe53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:34.503982 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8d7df-7bed-4a2e-a81f-c3b611cdfe53 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:34.523161 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 82/160] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:14:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:14:34.528401 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da5fb4-6d1a-484b-a959-da1054d93a72 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:34.688098 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da5fb4-6d1a-484b-a959-da1054d93a72 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:34.695789 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:34.725311 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff8449-13ef-4700-a0a2-6115881239ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:34.726216 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff8449-13ef-4700-a0a2-6115881239ba None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:34.726501 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff8449-13ef-4700-a0a2-6115881239ba None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:34.726778 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff8449-13ef-4700-a0a2-6115881239ba None admin] PATH_INFO: `/v3/users/c85d049ff6344e709f0b3295a93105c8` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:34.728082 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff8449-13ef-4700-a0a2-6115881239ba None admin] RBAC: Authorizing `identity:get_user(user_id=c85d049ff6344e709f0b3295a93105c8)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:34.729566 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff8449-13ef-4700-a0a2-6115881239ba None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:34.731214 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 79/161] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:14:34 2022] GET /identity/v3/users/c85d049ff6344e709f0b3295a93105c8 => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:34.736718 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8d7df-7bed-4a2e-a81f-c3b611cdfe53 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:34.768073 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:34.854658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8d7df-7bed-4a2e-a81f-c3b611cdfe53 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:34.894727 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a53f42-a72f-4681-b32b-883b8d602caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:34.895761 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a53f42-a72f-4681-b32b-883b8d602caf None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:34.896238 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a53f42-a72f-4681-b32b-883b8d602caf None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:34.896701 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a53f42-a72f-4681-b32b-883b8d602caf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:34.984689 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a53f42-a72f-4681-b32b-883b8d602caf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:34.986498 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a53f42-a72f-4681-b32b-883b8d602caf None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:35.018854 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:35.108750 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 83/162] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:14:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 19:14:35.114442 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff8449-13ef-4700-a0a2-6115881239ba None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:35.198608 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c1dbf-bfb3-4032-be8f-517c6a80e0ce None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:35.199246 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c1dbf-bfb3-4032-be8f-517c6a80e0ce None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:35.199735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c1dbf-bfb3-4032-be8f-517c6a80e0ce None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:35.201414 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 84/163] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 19:14:35.213393 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a904cac-6f24-4972-a2b7-26f9d5486505 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:35.214004 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a904cac-6f24-4972-a2b7-26f9d5486505 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:35.214625 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a904cac-6f24-4972-a2b7-26f9d5486505 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:35.216207 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 85/164] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 19:14:35.220764 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b7ced-3cb9-4f34-84b8-6536ecde1776 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:35.221327 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b7ced-3cb9-4f34-84b8-6536ecde1776 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:35.221793 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b7ced-3cb9-4f34-84b8-6536ecde1776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:35.238670 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff8449-13ef-4700-a0a2-6115881239ba None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:35.253058 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-bf8b7ced-3cb9-4f34-84b8-6536ecde1776 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:35.254535 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-bf8b7ced-3cb9-4f34-84b8-6536ecde1776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:35.280440 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a5278-f0fd-4f66-9f6b-7cc9209a5054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:35.281240 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a5278-f0fd-4f66-9f6b-7cc9209a5054 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:35.281525 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a5278-f0fd-4f66-9f6b-7cc9209a5054 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:35.281803 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a5278-f0fd-4f66-9f6b-7cc9209a5054 None admin] PATH_INFO: `/v3/projects/0180b37d7e6843eaa90e0d081ade9da8` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:35.284754 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a5278-f0fd-4f66-9f6b-7cc9209a5054 None admin] RBAC: Authorizing `identity:get_project(project_id=0180b37d7e6843eaa90e0d081ade9da8)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:35.286222 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a5278-f0fd-4f66-9f6b-7cc9209a5054 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:35.288499 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 80/165] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:14:35 2022] GET /identity/v3/projects/0180b37d7e6843eaa90e0d081ade9da8 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:35.290328 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eed139-668c-40bf-aacf-47ca5bef5e17 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:35.290762 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eed139-668c-40bf-aacf-47ca5bef5e17 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:35.291048 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eed139-668c-40bf-aacf-47ca5bef5e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:35.313373 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-99eed139-668c-40bf-aacf-47ca5bef5e17 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:35.314675 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-99eed139-668c-40bf-aacf-47ca5bef5e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:35.342493 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:35.387538 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 81/166] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:14:35.388412 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eed139-668c-40bf-aacf-47ca5bef5e17 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:35.390233 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 86/167] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:14:35.432590 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b7ced-3cb9-4f34-84b8-6536ecde1776 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:35.528767 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eed139-668c-40bf-aacf-47ca5bef5e17 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:35.530581 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:35.595192 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba005e-6fb9-4f48-a058-a63406dd7987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:35.595904 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba005e-6fb9-4f48-a058-a63406dd7987 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:35.596192 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba005e-6fb9-4f48-a058-a63406dd7987 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:35.596473 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba005e-6fb9-4f48-a058-a63406dd7987 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:35.597336 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ba005e-6fb9-4f48-a058-a63406dd7987 None admin] RBAC: Adding query filter params (role.id=3ad609555dec437d92e5c7291b1c939a, scope.project.id=0180b37d7e6843eaa90e0d081ade9da8, user.id=c85d049ff6344e709f0b3295a93105c8) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:35.597652 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ba005e-6fb9-4f48-a058-a63406dd7987 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:35.599147 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ba005e-6fb9-4f48-a058-a63406dd7987 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:35.599343 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b7ced-3cb9-4f34-84b8-6536ecde1776 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:35.615543 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 82/168] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:14:35 2022] GET /identity/v3/role_assignments?user.id=c85d049ff6344e709f0b3295a93105c8&scope.project.id=0180b37d7e6843eaa90e0d081ade9da8&role.id=3ad609555dec437d92e5c7291b1c939a => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:35.616438 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba005e-6fb9-4f48-a058-a63406dd7987 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:35.669547 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:35.696197 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095506d6-a672-40be-8645-7141e83b1872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:35.697021 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095506d6-a672-40be-8645-7141e83b1872 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:35.697316 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095506d6-a672-40be-8645-7141e83b1872 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:35.697582 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095506d6-a672-40be-8645-7141e83b1872 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:35.726828 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095506d6-a672-40be-8645-7141e83b1872 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:14:35.743727 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-095506d6-a672-40be-8645-7141e83b1872 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 19:14:35.743727 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:14:35.743727 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:14:35.743727 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:14:35.743727 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:14:35.743727 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:14:35.743727 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:14:35.743727 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:14:35.743727 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:14:35.743727 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:14:35.743727 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:14:35.743727 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:14:35.743727 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:14:35.743727 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:14:35.743727 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:14:35.743727 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:14:35.744811 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:14:35.744811 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:14:35.744811 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:14:35.744811 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:14:35.744811 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:14:35.744811 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:14:35.744811 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:14:35.744811 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:14:35.744811 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:14:35.744811 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:14:35.744811 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:14:35.744811 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:14:35.744811 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:14:35.744811 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:14:35.744811 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:14:35.744811 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:14:35.745593 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:14:35.745593 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:14:35.745593 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:14:35.745593 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:14:35.745593 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:14:35.745593 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:14:35.745593 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:14:35.745593 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:14:35.745593 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:14:35.745593 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:14:35.745593 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 19:14:35.745593 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:14:35.745593 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 87/169] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:14:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:14:35.750818 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095506d6-a672-40be-8645-7141e83b1872 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:35.808288 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba005e-6fb9-4f48-a058-a63406dd7987 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:35.872183 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b3f6c-51d7-4186-873f-a83b1542ec38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:35.873298 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b3f6c-51d7-4186-873f-a83b1542ec38 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:35.873737 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b3f6c-51d7-4186-873f-a83b1542ec38 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:35.874169 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b3f6c-51d7-4186-873f-a83b1542ec38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:35.895854 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871b3f6c-51d7-4186-873f-a83b1542ec38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:14:35.904476 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-871b3f6c-51d7-4186-873f-a83b1542ec38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:14:35.904476 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:14:35.904476 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:14:35.904476 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:14:35.904476 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:14:35.904476 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:14:35.904476 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:14:35.904476 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:14:35.904476 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:14:35.904476 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:14:35.904476 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:14:35.904476 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:14:35.904476 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:14:35.904476 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:14:35.904476 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:14:35.904476 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:14:35.905382 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:14:35.905382 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:14:35.905382 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:14:35.905382 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:14:35.905382 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:14:35.905382 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:14:35.905382 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:14:35.905382 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:14:35.905382 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:14:35.905382 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:14:35.905382 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:14:35.905382 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:14:35.905382 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:14:35.905382 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:14:35.905382 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:14:35.905382 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:14:35.906179 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:14:35.906179 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:14:35.906179 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:14:35.906179 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:14:35.906179 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:14:35.906179 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:14:35.906179 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:14:35.906179 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:14:35.906179 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:14:35.906179 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:14:35.906179 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:14:35.906179 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:14:35.908573 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 83/170] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Jul 21 19:14:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:14:35.920512 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b3f6c-51d7-4186-873f-a83b1542ec38 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:36.048580 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095506d6-a672-40be-8645-7141e83b1872 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:36.050890 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:36.070669 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b3f6c-51d7-4186-873f-a83b1542ec38 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:36.087844 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:36.108384 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161aed2-2204-4227-ba11-be7a42d67e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:36.109853 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161aed2-2204-4227-ba11-be7a42d67e5a None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:36.110539 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161aed2-2204-4227-ba11-be7a42d67e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:36.110992 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161aed2-2204-4227-ba11-be7a42d67e5a None admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:36.112101 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7161aed2-2204-4227-ba11-be7a42d67e5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:36.112589 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7161aed2-2204-4227-ba11-be7a42d67e5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:36.114169 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7161aed2-2204-4227-ba11-be7a42d67e5a None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:36.125148 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 84/171] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:14:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:14:36.132498 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161aed2-2204-4227-ba11-be7a42d67e5a None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:36.137073 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb4d4e-ae21-4dcb-94e4-4bcfa3ffd9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:36.138002 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb4d4e-ae21-4dcb-94e4-4bcfa3ffd9e9 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:36.138459 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb4d4e-ae21-4dcb-94e4-4bcfa3ffd9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:36.138927 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb4d4e-ae21-4dcb-94e4-4bcfa3ffd9e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:36.139889 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fb4d4e-ae21-4dcb-94e4-4bcfa3ffd9e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:36.140368 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fb4d4e-ae21-4dcb-94e4-4bcfa3ffd9e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:36.141925 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fb4d4e-ae21-4dcb-94e4-4bcfa3ffd9e9 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:36.161956 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 88/172] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Jul 21 19:14:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:36.167346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb4d4e-ae21-4dcb-94e4-4bcfa3ffd9e9 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:36.247322 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161aed2-2204-4227-ba11-be7a42d67e5a None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:36.285238 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96b037-998d-425c-892a-f81d037cfe92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:36.285783 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96b037-998d-425c-892a-f81d037cfe92 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:36.286072 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96b037-998d-425c-892a-f81d037cfe92 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:36.286347 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96b037-998d-425c-892a-f81d037cfe92 None admin] PATH_INFO: `/v3/users/9e09a8e247ab497cad13b7109b21b1c9` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:36.291504 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a96b037-998d-425c-892a-f81d037cfe92 None admin] RBAC: Authorizing `identity:get_user(user_id=9e09a8e247ab497cad13b7109b21b1c9)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:36.291504 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a96b037-998d-425c-892a-f81d037cfe92 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:36.292026 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 85/173] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:14:36 2022] GET /identity/v3/users/9e09a8e247ab497cad13b7109b21b1c9 => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:36.303552 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96b037-998d-425c-892a-f81d037cfe92 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:36.347936 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:36.379711 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb4d4e-ae21-4dcb-94e4-4bcfa3ffd9e9 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:36.433654 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96b037-998d-425c-892a-f81d037cfe92 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:36.433950 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b84aa-ddc2-4f85-9ef1-3d9c887abb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:36.435021 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b84aa-ddc2-4f85-9ef1-3d9c887abb85 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:36.435542 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b84aa-ddc2-4f85-9ef1-3d9c887abb85 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:36.435991 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b84aa-ddc2-4f85-9ef1-3d9c887abb85 None admin] PATH_INFO: `/v3/users/c85d049ff6344e709f0b3295a93105c8` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:36.439109 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b84aa-ddc2-4f85-9ef1-3d9c887abb85 None admin] RBAC: Authorizing `identity:get_user(user_id=c85d049ff6344e709f0b3295a93105c8)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:36.440825 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b84aa-ddc2-4f85-9ef1-3d9c887abb85 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:36.442973 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 89/174] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:14:36 2022] GET /identity/v3/users/c85d049ff6344e709f0b3295a93105c8 => generated 275 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:36.444430 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5dcbf-1aa9-4722-9dc3-8ac0d6fd96d3 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:36.444889 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5dcbf-1aa9-4722-9dc3-8ac0d6fd96d3 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:36.445336 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5dcbf-1aa9-4722-9dc3-8ac0d6fd96d3 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:36.447424 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 90/175] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:14:36.452456 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5dcbf-1aa9-4722-9dc3-8ac0d6fd96d3 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:36.477732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b035f79-82a3-4825-bb6a-8726f650c875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:36.478405 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b035f79-82a3-4825-bb6a-8726f650c875 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:36.478693 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b035f79-82a3-4825-bb6a-8726f650c875 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:36.478975 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b035f79-82a3-4825-bb6a-8726f650c875 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:36.506087 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:36.565457 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5dcbf-1aa9-4722-9dc3-8ac0d6fd96d3 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:36.574229 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b035f79-82a3-4825-bb6a-8726f650c875 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:36.576180 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b035f79-82a3-4825-bb6a-8726f650c875 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:36.598463 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:36.608834 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9188fb-96ac-47fd-a9ed-ec2b24aaf53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:36.610086 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9188fb-96ac-47fd-a9ed-ec2b24aaf53d None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:36.610749 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9188fb-96ac-47fd-a9ed-ec2b24aaf53d None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:36.611572 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9188fb-96ac-47fd-a9ed-ec2b24aaf53d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:36.703454 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9188fb-96ac-47fd-a9ed-ec2b24aaf53d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:36.704942 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9188fb-96ac-47fd-a9ed-ec2b24aaf53d None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:36.724252 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 86/176] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:14:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 19:14:36.725623 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b05f53-1103-47e1-9582-b148fdc2ced0 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:36.725912 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b05f53-1103-47e1-9582-b148fdc2ced0 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:36.726190 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b05f53-1103-47e1-9582-b148fdc2ced0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:36.759667 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-d3b05f53-1103-47e1-9582-b148fdc2ced0 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:36.760895 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-d3b05f53-1103-47e1-9582-b148fdc2ced0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:36.783222 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:36.843003 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 87/177] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:14:36.852670 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b05f53-1103-47e1-9582-b148fdc2ced0 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:36.878936 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 91/178] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:14:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 19:14:36.880651 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22646859-786d-4983-81d9-60fb93605070 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:36.881113 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22646859-786d-4983-81d9-60fb93605070 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:36.881635 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22646859-786d-4983-81d9-60fb93605070 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:36.883559 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 92/179] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:14:36.888352 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22646859-786d-4983-81d9-60fb93605070 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:36.902399 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:36.959291 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b05f53-1103-47e1-9582-b148fdc2ced0 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:36.995006 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e8f35-c184-4331-9e60-1bbde4c31dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:36.995953 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e8f35-c184-4331-9e60-1bbde4c31dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:36.996239 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e8f35-c184-4331-9e60-1bbde4c31dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:36.996511 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e8f35-c184-4331-9e60-1bbde4c31dd2 None admin] PATH_INFO: `/v3/projects/0180b37d7e6843eaa90e0d081ade9da8` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:36.997706 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e8f35-c184-4331-9e60-1bbde4c31dd2 None admin] RBAC: Authorizing `identity:get_project(project_id=0180b37d7e6843eaa90e0d081ade9da8)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:36.999870 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e8f35-c184-4331-9e60-1bbde4c31dd2 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:37.001636 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 88/180] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:14:36 2022] GET /identity/v3/projects/0180b37d7e6843eaa90e0d081ade9da8 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:37.002329 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e8f35-c184-4331-9e60-1bbde4c31dd2 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:37.011286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22646859-786d-4983-81d9-60fb93605070 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:37.050018 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d3ecb-814d-48f5-a9fe-8d8527b5b3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:37.050818 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d3ecb-814d-48f5-a9fe-8d8527b5b3c3 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:37.051103 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d3ecb-814d-48f5-a9fe-8d8527b5b3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:37.051379 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d3ecb-814d-48f5-a9fe-8d8527b5b3c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:37.062873 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d3ecb-814d-48f5-a9fe-8d8527b5b3c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:14:37.070630 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-d54d3ecb-814d-48f5-a9fe-8d8527b5b3c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:14:37.070630 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:14:37.070630 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:14:37.070630 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:14:37.070630 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:14:37.070630 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:14:37.070630 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:14:37.070630 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:14:37.070630 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:14:37.070630 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:14:37.070630 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:14:37.070630 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:14:37.070630 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:14:37.070630 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:14:37.070630 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:14:37.070630 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:14:37.072098 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:14:37.072098 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:14:37.072098 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:14:37.072098 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:14:37.072098 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:14:37.072098 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:14:37.072098 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:14:37.072098 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:14:37.072098 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:14:37.072098 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:14:37.072098 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:14:37.072098 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:14:37.072098 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:14:37.072098 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:14:37.072098 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:14:37.072098 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:14:37.072885 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:14:37.072885 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:14:37.072885 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:14:37.072885 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:14:37.072885 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:14:37.072885 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:14:37.072885 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:14:37.072885 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:14:37.072885 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:14:37.072885 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:14:37.072885 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:14:37.072885 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:14:37.072885 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 93/181] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Jul 21 19:14:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:14:37.074068 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28041e-bcaf-4ba5-9415-43aad463998c None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:37.074068 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28041e-bcaf-4ba5-9415-43aad463998c None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:37.074199 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28041e-bcaf-4ba5-9415-43aad463998c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:37.080093 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:37.091116 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-0a28041e-bcaf-4ba5-9415-43aad463998c None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:37.092368 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-0a28041e-bcaf-4ba5-9415-43aad463998c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:37.115702 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e8f35-c184-4331-9e60-1bbde4c31dd2 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:37.131397 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:37.154414 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2a9a4-4fab-49f7-99c6-cddfc6a2be48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:37.170333 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2a9a4-4fab-49f7-99c6-cddfc6a2be48 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:37.170333 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2a9a4-4fab-49f7-99c6-cddfc6a2be48 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:37.170333 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2a9a4-4fab-49f7-99c6-cddfc6a2be48 None admin] PATH_INFO: `/v3/projects/8ef327054d074c54ba32059ee735417c` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:37.170333 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d2a9a4-4fab-49f7-99c6-cddfc6a2be48 None admin] RBAC: Authorizing `identity:get_project(project_id=8ef327054d074c54ba32059ee735417c)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:37.170333 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d2a9a4-4fab-49f7-99c6-cddfc6a2be48 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:37.170333 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 89/182] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:14:37 2022] GET /identity/v3/projects/8ef327054d074c54ba32059ee735417c => generated 312 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:37.170752 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2a9a4-4fab-49f7-99c6-cddfc6a2be48 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:37.170818 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 94/183] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:14:37.170818 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d195a2-b705-4108-96eb-6b25f59226ac None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:37.170818 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d195a2-b705-4108-96eb-6b25f59226ac None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:37.171006 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d195a2-b705-4108-96eb-6b25f59226ac None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:37.172311 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 95/184] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:14:37.172935 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d195a2-b705-4108-96eb-6b25f59226ac None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:37.272253 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2a9a4-4fab-49f7-99c6-cddfc6a2be48 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:37.284637 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d195a2-b705-4108-96eb-6b25f59226ac None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:37.308809 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45fe073-026a-4963-a3bc-3ea2de410f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:37.309579 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45fe073-026a-4963-a3bc-3ea2de410f7a None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:37.309867 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45fe073-026a-4963-a3bc-3ea2de410f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:37.310149 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45fe073-026a-4963-a3bc-3ea2de410f7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:37.310983 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45fe073-026a-4963-a3bc-3ea2de410f7a None admin] RBAC: Adding query filter params (role.id=685e18230e1744c581baaf842d0fd4ca, scope.project.id=0180b37d7e6843eaa90e0d081ade9da8, user.id=9e09a8e247ab497cad13b7109b21b1c9) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:37.311302 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45fe073-026a-4963-a3bc-3ea2de410f7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:37.312991 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45fe073-026a-4963-a3bc-3ea2de410f7a None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:37.319472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 90/185] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:14:37 2022] GET /identity/v3/role_assignments?user.id=9e09a8e247ab497cad13b7109b21b1c9&scope.project.id=0180b37d7e6843eaa90e0d081ade9da8&role.id=685e18230e1744c581baaf842d0fd4ca => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:37.320277 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45fe073-026a-4963-a3bc-3ea2de410f7a None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:37.324730 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc55f995-598e-45a2-91c4-8f448330138a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:37.325429 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55f995-598e-45a2-91c4-8f448330138a None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:37.325719 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55f995-598e-45a2-91c4-8f448330138a None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:37.326002 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55f995-598e-45a2-91c4-8f448330138a None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:37.326771 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc55f995-598e-45a2-91c4-8f448330138a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:37.327088 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc55f995-598e-45a2-91c4-8f448330138a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:37.328626 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc55f995-598e-45a2-91c4-8f448330138a None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:37.330340 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:37.340445 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 96/186] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:14:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:37.341607 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339491d-a82d-4fdf-800f-fd6e1d518838 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:37.342057 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339491d-a82d-4fdf-800f-fd6e1d518838 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:37.342184 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339491d-a82d-4fdf-800f-fd6e1d518838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:37.361131 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-2339491d-a82d-4fdf-800f-fd6e1d518838 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:37.362379 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-2339491d-a82d-4fdf-800f-fd6e1d518838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:37.382801 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:37.445097 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45fe073-026a-4963-a3bc-3ea2de410f7a None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:37.448799 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 97/187] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:14:37.449964 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339491d-a82d-4fdf-800f-fd6e1d518838 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:37.513850 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ff18d-6fb0-4d47-a2cc-9fa32081fd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:37.514627 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ff18d-6fb0-4d47-a2cc-9fa32081fd8b None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:37.515002 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ff18d-6fb0-4d47-a2cc-9fa32081fd8b None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:37.515290 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ff18d-6fb0-4d47-a2cc-9fa32081fd8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:37.516263 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0ff18d-6fb0-4d47-a2cc-9fa32081fd8b None admin] RBAC: Adding query filter params (role.id=0af30c087b3541a4847d708dd68464d6, scope.project.id=8ef327054d074c54ba32059ee735417c, user.id=c85d049ff6344e709f0b3295a93105c8) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:37.516646 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0ff18d-6fb0-4d47-a2cc-9fa32081fd8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:37.518181 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0ff18d-6fb0-4d47-a2cc-9fa32081fd8b None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:37.525463 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 91/188] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:14:37 2022] GET /identity/v3/role_assignments?user.id=c85d049ff6344e709f0b3295a93105c8&scope.project.id=8ef327054d074c54ba32059ee735417c&role.id=0af30c087b3541a4847d708dd68464d6 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:37.526329 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ff18d-6fb0-4d47-a2cc-9fa32081fd8b None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:37.578678 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339491d-a82d-4fdf-800f-fd6e1d518838 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:37.611778 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:37.625178 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68b11b-e367-41ad-8edc-3b3ea54f01f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:37.627214 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68b11b-e367-41ad-8edc-3b3ea54f01f5 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:37.627214 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68b11b-e367-41ad-8edc-3b3ea54f01f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:37.627214 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68b11b-e367-41ad-8edc-3b3ea54f01f5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:37.642770 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68b11b-e367-41ad-8edc-3b3ea54f01f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:14:37.652952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-7a68b11b-e367-41ad-8edc-3b3ea54f01f5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 19:14:37.652952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:14:37.652952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:14:37.652952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:14:37.652952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:14:37.652952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:14:37.652952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:14:37.652952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:14:37.652952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:14:37.652952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:14:37.652952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:14:37.652952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:14:37.652952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:14:37.652952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:14:37.652952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:14:37.652952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:14:37.654090 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:14:37.654090 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:14:37.654090 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:14:37.654090 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:14:37.654090 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:14:37.654090 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:14:37.654090 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:14:37.654090 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:14:37.654090 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:14:37.654090 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:14:37.654090 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:14:37.654090 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:14:37.654090 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:14:37.654090 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:14:37.654090 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:14:37.654090 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:14:37.655072 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:14:37.655072 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:14:37.655072 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:14:37.655072 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:14:37.655072 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:14:37.655072 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:14:37.655072 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:14:37.655072 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:14:37.655072 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:14:37.655072 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:14:37.655072 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 19:14:37.655072 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:14:37.655809 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 98/189] 10.222.0.60 () {56 vars in 1114 bytes} [Thu Jul 21 19:14:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:14:37.657496 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68b11b-e367-41ad-8edc-3b3ea54f01f5 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:37.658486 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ff18d-6fb0-4d47-a2cc-9fa32081fd8b None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:37.675710 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:37.705281 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41bfee7-de84-4a8d-aab8-ac2cfae117d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:37.706175 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41bfee7-de84-4a8d-aab8-ac2cfae117d1 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:37.706460 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41bfee7-de84-4a8d-aab8-ac2cfae117d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:37.706742 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41bfee7-de84-4a8d-aab8-ac2cfae117d1 None admin] PATH_INFO: `/v3/users/e08b3c894b23421aabdc51fe682d0738` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:37.724754 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41bfee7-de84-4a8d-aab8-ac2cfae117d1 None admin] RBAC: Authorizing `identity:get_user(user_id=e08b3c894b23421aabdc51fe682d0738)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:37.726224 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41bfee7-de84-4a8d-aab8-ac2cfae117d1 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:37.728830 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 92/190] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:14:37 2022] GET /identity/v3/users/e08b3c894b23421aabdc51fe682d0738 => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:37.730078 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667358d-ddaf-4c15-9fd2-fd590a706e42 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:37.730436 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667358d-ddaf-4c15-9fd2-fd590a706e42 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:37.730680 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667358d-ddaf-4c15-9fd2-fd590a706e42 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:37.731910 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 93/191] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:14:37.732662 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667358d-ddaf-4c15-9fd2-fd590a706e42 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:37.785497 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68b11b-e367-41ad-8edc-3b3ea54f01f5 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:37.819415 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950569c-6aaf-4678-ae26-f8190ab8fa0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:37.820229 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950569c-6aaf-4678-ae26-f8190ab8fa0b None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:37.820515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950569c-6aaf-4678-ae26-f8190ab8fa0b None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:37.820863 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950569c-6aaf-4678-ae26-f8190ab8fa0b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:37.822766 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5950569c-6aaf-4678-ae26-f8190ab8fa0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:37.824253 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5950569c-6aaf-4678-ae26-f8190ab8fa0b None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:37.825881 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 99/192] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:14:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:37.826640 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950569c-6aaf-4678-ae26-f8190ab8fa0b None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:37.842798 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667358d-ddaf-4c15-9fd2-fd590a706e42 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:37.875788 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad7fad-8c90-410b-ac47-21f7275a6c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:37.876441 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad7fad-8c90-410b-ac47-21f7275a6c4c None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:37.876721 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad7fad-8c90-410b-ac47-21f7275a6c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:37.876994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad7fad-8c90-410b-ac47-21f7275a6c4c None admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:37.877733 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad7fad-8c90-410b-ac47-21f7275a6c4c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:37.878037 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad7fad-8c90-410b-ac47-21f7275a6c4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:37.879404 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad7fad-8c90-410b-ac47-21f7275a6c4c None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:37.880992 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:37.887808 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 94/193] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:14:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:37.889070 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81841e-0543-420b-bcf7-9cccc53e748b None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:37.889365 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81841e-0543-420b-bcf7-9cccc53e748b None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:37.889649 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81841e-0543-420b-bcf7-9cccc53e748b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:37.905923 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-3a81841e-0543-420b-bcf7-9cccc53e748b None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:37.907033 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-3a81841e-0543-420b-bcf7-9cccc53e748b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:37.927776 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950569c-6aaf-4678-ae26-f8190ab8fa0b None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:37.930079 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:37.961758 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab284f-813b-4953-af2f-d514c73f9d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:37.962407 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab284f-813b-4953-af2f-d514c73f9d12 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:37.962743 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab284f-813b-4953-af2f-d514c73f9d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:37.963018 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab284f-813b-4953-af2f-d514c73f9d12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:37.972439 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 95/194] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:14:37.973152 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a81841e-0543-420b-bcf7-9cccc53e748b None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:38.049828 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab284f-813b-4953-af2f-d514c73f9d12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:38.051320 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab284f-813b-4953-af2f-d514c73f9d12 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:38.068845 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a81841e-0543-420b-bcf7-9cccc53e748b None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:38.101440 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33bee3-0545-4ade-97f6-fbfd8c3abcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:38.102622 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33bee3-0545-4ade-97f6-fbfd8c3abcd7 None admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:38.102912 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33bee3-0545-4ade-97f6-fbfd8c3abcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:38.103258 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33bee3-0545-4ade-97f6-fbfd8c3abcd7 None admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:38.103989 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad33bee3-0545-4ade-97f6-fbfd8c3abcd7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:38.105088 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:38.105431 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad33bee3-0545-4ade-97f6-fbfd8c3abcd7 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:38.152267 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 100/195] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:14:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 19:14:38.153107 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab284f-813b-4953-af2f-d514c73f9d12 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:38.231323 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 96/196] 10.222.0.60 () {60 vars in 1132 bytes} [Thu Jul 21 19:14:37 2022] POST /identity/v3/users => generated 297 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:14:38.232311 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33bee3-0545-4ade-97f6-fbfd8c3abcd7 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:38.252040 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:38.253791 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab284f-813b-4953-af2f-d514c73f9d12 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:38.296734 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0042b01-30f2-4775-a36c-75a84bbb2fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:38.298387 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0042b01-30f2-4775-a36c-75a84bbb2fcc None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:38.298683 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0042b01-30f2-4775-a36c-75a84bbb2fcc None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:38.298962 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0042b01-30f2-4775-a36c-75a84bbb2fcc None admin] PATH_INFO: `/v3/users/e08b3c894b23421aabdc51fe682d0738` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:38.301095 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0042b01-30f2-4775-a36c-75a84bbb2fcc None admin] RBAC: Authorizing `identity:get_user(user_id=e08b3c894b23421aabdc51fe682d0738)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:38.302857 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0042b01-30f2-4775-a36c-75a84bbb2fcc None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:38.310822 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 101/197] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:14:38 2022] GET /identity/v3/users/e08b3c894b23421aabdc51fe682d0738 => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:38.310822 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0042b01-30f2-4775-a36c-75a84bbb2fcc None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:38.340210 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:38.349612 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33bee3-0545-4ade-97f6-fbfd8c3abcd7 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:38.389657 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc83d29-6cf1-42ef-969f-a9a2309aca2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:38.390846 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc83d29-6cf1-42ef-969f-a9a2309aca2f None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:38.390846 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc83d29-6cf1-42ef-969f-a9a2309aca2f None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:38.391048 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc83d29-6cf1-42ef-969f-a9a2309aca2f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:38.406450 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc83d29-6cf1-42ef-969f-a9a2309aca2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:14:38.415367 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-ebc83d29-6cf1-42ef-969f-a9a2309aca2f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 19:14:38.415367 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:14:38.415367 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:14:38.415367 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:14:38.415367 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:14:38.415367 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:14:38.415367 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:14:38.415367 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:14:38.415367 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:14:38.415367 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:14:38.415367 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:14:38.415367 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:14:38.415367 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:14:38.415367 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:14:38.415367 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:14:38.415367 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:14:38.416324 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:14:38.416324 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:14:38.416324 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:14:38.416324 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:14:38.416324 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:14:38.416324 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:14:38.416324 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:14:38.416324 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:14:38.416324 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:14:38.416324 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:14:38.416324 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:14:38.416324 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:14:38.416324 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:14:38.416324 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:14:38.416324 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:14:38.416324 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:14:38.417100 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:14:38.417100 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:14:38.417100 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:14:38.417100 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:14:38.417100 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:14:38.417100 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:14:38.417100 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:14:38.417100 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:14:38.417100 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:14:38.417100 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:14:38.417100 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 19:14:38.417100 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:14:38.417100 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 97/198] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:14:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:14:38.417764 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc83d29-6cf1-42ef-969f-a9a2309aca2f None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:38.428415 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0042b01-30f2-4775-a36c-75a84bbb2fcc None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:38.474317 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132681e0-450a-4f86-8909-d7602f00bd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:38.475031 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132681e0-450a-4f86-8909-d7602f00bd6d None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:38.475031 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132681e0-450a-4f86-8909-d7602f00bd6d None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:38.475317 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132681e0-450a-4f86-8909-d7602f00bd6d None admin] PATH_INFO: `/v3/projects/d47c3e61323f489c977cc4785142f555` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:38.479156 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132681e0-450a-4f86-8909-d7602f00bd6d None admin] RBAC: Authorizing `identity:get_project(project_id=d47c3e61323f489c977cc4785142f555)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:38.480781 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132681e0-450a-4f86-8909-d7602f00bd6d None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:38.482768 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 102/199] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:14:38 2022] GET /identity/v3/projects/d47c3e61323f489c977cc4785142f555 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:38.484585 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132681e0-450a-4f86-8909-d7602f00bd6d None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:38.515376 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:38.546129 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc83d29-6cf1-42ef-969f-a9a2309aca2f None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:38.583345 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33a95a-b849-49fb-89db-e248db596744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:38.584036 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33a95a-b849-49fb-89db-e248db596744 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:38.584318 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33a95a-b849-49fb-89db-e248db596744 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:38.584592 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33a95a-b849-49fb-89db-e248db596744 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:38.603720 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:38.612131 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132681e0-450a-4f86-8909-d7602f00bd6d None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:38.650669 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96faa108-46e8-4eb7-9d7a-ac8c505de176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:38.651738 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96faa108-46e8-4eb7-9d7a-ac8c505de176 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:38.652200 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96faa108-46e8-4eb7-9d7a-ac8c505de176 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:38.652652 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96faa108-46e8-4eb7-9d7a-ac8c505de176 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:38.653694 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96faa108-46e8-4eb7-9d7a-ac8c505de176 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:38.654270 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96faa108-46e8-4eb7-9d7a-ac8c505de176 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:38.655927 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96faa108-46e8-4eb7-9d7a-ac8c505de176 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:38.665923 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 103/200] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Jul 21 19:14:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:38.670503 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b33a95a-b849-49fb-89db-e248db596744 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:38.670634 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b33a95a-b849-49fb-89db-e248db596744 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:38.671746 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96faa108-46e8-4eb7-9d7a-ac8c505de176 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:38.767464 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:38.780289 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96faa108-46e8-4eb7-9d7a-ac8c505de176 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:38.796053 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 98/201] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:14:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 19:14:38.799608 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33a95a-b849-49fb-89db-e248db596744 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:38.830526 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e641b-f1f1-44c9-bdc8-161d80381ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:38.831617 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e641b-f1f1-44c9-bdc8-161d80381ef0 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:38.831910 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e641b-f1f1-44c9-bdc8-161d80381ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:38.832190 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e641b-f1f1-44c9-bdc8-161d80381ef0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:38.833305 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59e641b-f1f1-44c9-bdc8-161d80381ef0 None admin] RBAC: Adding query filter params (role.id=685e18230e1744c581baaf842d0fd4ca, scope.project.id=d47c3e61323f489c977cc4785142f555, user.id=e08b3c894b23421aabdc51fe682d0738) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:38.833622 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59e641b-f1f1-44c9-bdc8-161d80381ef0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:38.835771 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59e641b-f1f1-44c9-bdc8-161d80381ef0 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:38.843114 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 104/202] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:14:38 2022] GET /identity/v3/role_assignments?user.id=e08b3c894b23421aabdc51fe682d0738&scope.project.id=d47c3e61323f489c977cc4785142f555&role.id=685e18230e1744c581baaf842d0fd4ca => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:38.843989 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e641b-f1f1-44c9-bdc8-161d80381ef0 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:38.871075 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:38.914007 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33a95a-b849-49fb-89db-e248db596744 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:38.953270 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ca5fe-b318-4a50-8ffb-ca33fa2257e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:38.954605 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ca5fe-b318-4a50-8ffb-ca33fa2257e4 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:38.955134 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ca5fe-b318-4a50-8ffb-ca33fa2257e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:38.955635 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ca5fe-b318-4a50-8ffb-ca33fa2257e4 None admin] PATH_INFO: `/v3/users/14244fc2bbdc43c489492090c4f6e5a7` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:38.957077 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ca5fe-b318-4a50-8ffb-ca33fa2257e4 None admin] RBAC: Authorizing `identity:get_user(user_id=14244fc2bbdc43c489492090c4f6e5a7)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:38.958828 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ca5fe-b318-4a50-8ffb-ca33fa2257e4 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:38.960971 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 99/203] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:14:38 2022] GET /identity/v3/users/14244fc2bbdc43c489492090c4f6e5a7 => generated 289 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:38.967478 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ca5fe-b318-4a50-8ffb-ca33fa2257e4 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:38.981322 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e641b-f1f1-44c9-bdc8-161d80381ef0 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:39.018566 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:39.030696 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b586c-16b3-40da-9cd0-f39aa5c13f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:39.035359 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b586c-16b3-40da-9cd0-f39aa5c13f28 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:39.037702 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b586c-16b3-40da-9cd0-f39aa5c13f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:39.037702 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b586c-16b3-40da-9cd0-f39aa5c13f28 None admin] PATH_INFO: `/v3/projects/d47c3e61323f489c977cc4785142f555` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:39.038341 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0b586c-16b3-40da-9cd0-f39aa5c13f28 None admin] RBAC: Authorizing `identity:get_project(project_id=d47c3e61323f489c977cc4785142f555)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:39.042732 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0b586c-16b3-40da-9cd0-f39aa5c13f28 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:39.046844 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 105/204] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:14:38 2022] GET /identity/v3/projects/d47c3e61323f489c977cc4785142f555 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:39.053624 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b586c-16b3-40da-9cd0-f39aa5c13f28 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:39.114510 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ca5fe-b318-4a50-8ffb-ca33fa2257e4 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:39.164236 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed821a2-538d-416f-8341-8941a77ef8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:39.165919 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed821a2-538d-416f-8341-8941a77ef8cb None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:39.168730 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed821a2-538d-416f-8341-8941a77ef8cb None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:39.168730 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed821a2-538d-416f-8341-8941a77ef8cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:39.181077 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:39.220425 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b586c-16b3-40da-9cd0-f39aa5c13f28 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:39.248644 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed821a2-538d-416f-8341-8941a77ef8cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:39.250294 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed821a2-538d-416f-8341-8941a77ef8cb None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:39.298976 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619ae6a-408e-4890-8609-972aa8e71fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:39.299653 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619ae6a-408e-4890-8609-972aa8e71fba None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:39.299939 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619ae6a-408e-4890-8609-972aa8e71fba None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:39.300267 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619ae6a-408e-4890-8609-972aa8e71fba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:39.300853 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:39.301407 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d619ae6a-408e-4890-8609-972aa8e71fba None admin] RBAC: Adding query filter params (role.id=3ad609555dec437d92e5c7291b1c939a, scope.project.id=d47c3e61323f489c977cc4785142f555, user.id=e08b3c894b23421aabdc51fe682d0738) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:39.301407 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d619ae6a-408e-4890-8609-972aa8e71fba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:39.303112 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d619ae6a-408e-4890-8609-972aa8e71fba None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:39.321389 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 106/205] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:14:39 2022] GET /identity/v3/role_assignments?user.id=e08b3c894b23421aabdc51fe682d0738&scope.project.id=d47c3e61323f489c977cc4785142f555&role.id=3ad609555dec437d92e5c7291b1c939a => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:39.361740 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 100/206] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:14:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 19:14:39.368001 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619ae6a-408e-4890-8609-972aa8e71fba None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:39.536757 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619ae6a-408e-4890-8609-972aa8e71fba None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:39.573357 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a645e47-6d89-4098-a4f8-e25c0d54a1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:39.574571 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a645e47-6d89-4098-a4f8-e25c0d54a1ee None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:39.575074 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a645e47-6d89-4098-a4f8-e25c0d54a1ee None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:39.575588 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a645e47-6d89-4098-a4f8-e25c0d54a1ee None admin] PATH_INFO: `/v3/projects/0180b37d7e6843eaa90e0d081ade9da8` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:39.576991 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a645e47-6d89-4098-a4f8-e25c0d54a1ee None admin] RBAC: Authorizing `identity:get_project(project_id=0180b37d7e6843eaa90e0d081ade9da8)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:39.578643 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a645e47-6d89-4098-a4f8-e25c0d54a1ee None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:39.580598 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 107/207] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:14:39 2022] GET /identity/v3/projects/0180b37d7e6843eaa90e0d081ade9da8 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:39.587055 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed821a2-538d-416f-8341-8941a77ef8cb None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:39.718714 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed821a2-538d-416f-8341-8941a77ef8cb None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:39.768279 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c2688a-6307-452b-b794-1943f4359aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:39.769303 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2688a-6307-452b-b794-1943f4359aeb None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:39.769813 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2688a-6307-452b-b794-1943f4359aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:39.770286 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2688a-6307-452b-b794-1943f4359aeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:39.771330 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c2688a-6307-452b-b794-1943f4359aeb None admin] RBAC: Adding query filter params (role.id=9d25a11a44b24a3eb36a9ecd8d89321d, scope.project.id=0180b37d7e6843eaa90e0d081ade9da8, user.id=14244fc2bbdc43c489492090c4f6e5a7) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:39.771868 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c2688a-6307-452b-b794-1943f4359aeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:39.773531 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c2688a-6307-452b-b794-1943f4359aeb None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:39.780769 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 101/208] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:14:39 2022] GET /identity/v3/role_assignments?user.id=14244fc2bbdc43c489492090c4f6e5a7&scope.project.id=0180b37d7e6843eaa90e0d081ade9da8&role.id=9d25a11a44b24a3eb36a9ecd8d89321d => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:14:40.650995 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46ebce-a56b-4924-ac69-8a66acaf7a31 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:40.651534 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46ebce-a56b-4924-ac69-8a66acaf7a31 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:40.651610 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46ebce-a56b-4924-ac69-8a66acaf7a31 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:40.653106 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 108/209] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:14:40.658482 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacccdb-14b1-459c-9322-2121ee7fabfd None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:40.659268 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacccdb-14b1-459c-9322-2121ee7fabfd None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:40.659769 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacccdb-14b1-459c-9322-2121ee7fabfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:40.678357 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-9bacccdb-14b1-459c-9322-2121ee7fabfd None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:40.679503 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-9bacccdb-14b1-459c-9322-2121ee7fabfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:40.682406 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:40.685781 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95f203-c9b4-4d8b-93e6-28813d02e6b6 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:40.686076 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95f203-c9b4-4d8b-93e6-28813d02e6b6 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:40.686360 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95f203-c9b4-4d8b-93e6-28813d02e6b6 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:40.688082 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 109/210] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:14:40.693255 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1bbe2-8dee-4579-ac9b-55ac9d0d153d None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:40.695108 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1bbe2-8dee-4579-ac9b-55ac9d0d153d None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:40.695108 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1bbe2-8dee-4579-ac9b-55ac9d0d153d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:40.713925 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-72d1bbe2-8dee-4579-ac9b-55ac9d0d153d None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:40.715143 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-72d1bbe2-8dee-4579-ac9b-55ac9d0d153d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:40.727719 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:40.755813 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 102/211] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:14:40.780691 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bacccdb-14b1-459c-9322-2121ee7fabfd None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:40.801553 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 110/212] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 19:14:40.825085 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1bbe2-8dee-4579-ac9b-55ac9d0d153d None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:40.887964 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bacccdb-14b1-459c-9322-2121ee7fabfd None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:40.934458 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c731f6-bc75-4b37-9c60-1c7673fadbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:40.935732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c731f6-bc75-4b37-9c60-1c7673fadbf7 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:40.936121 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c731f6-bc75-4b37-9c60-1c7673fadbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:40.936500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c731f6-bc75-4b37-9c60-1c7673fadbf7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:40.937823 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c731f6-bc75-4b37-9c60-1c7673fadbf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:40.939977 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c731f6-bc75-4b37-9c60-1c7673fadbf7 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:40.942911 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 103/213] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:14:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:14:40.947848 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c731f6-bc75-4b37-9c60-1c7673fadbf7 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:40.956353 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1bbe2-8dee-4579-ac9b-55ac9d0d153d None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:40.960723 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:41.005704 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a714ee4-df40-439e-9883-b97b10968be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:41.006811 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a714ee4-df40-439e-9883-b97b10968be8 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:41.007107 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a714ee4-df40-439e-9883-b97b10968be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:41.007390 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a714ee4-df40-439e-9883-b97b10968be8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:41.022689 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a714ee4-df40-439e-9883-b97b10968be8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:14:41.034458 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-8a714ee4-df40-439e-9883-b97b10968be8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 19:14:41.034458 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:14:41.034458 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:14:41.034458 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:14:41.034458 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:14:41.034458 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:14:41.034458 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:14:41.034458 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:14:41.034458 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:14:41.034458 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:14:41.034458 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:14:41.034458 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:14:41.034458 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:14:41.034458 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:14:41.034458 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:14:41.034458 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:14:41.035331 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:14:41.035331 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:14:41.035331 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:14:41.035331 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:14:41.035331 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:14:41.035331 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:14:41.035331 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:14:41.035331 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:14:41.035331 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:14:41.035331 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:14:41.035331 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:14:41.035331 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:14:41.035331 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:14:41.035331 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:14:41.035331 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:14:41.035331 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:14:41.036156 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:14:41.036156 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:14:41.036156 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:14:41.036156 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:14:41.036156 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:14:41.036156 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:14:41.036156 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:14:41.036156 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:14:41.036156 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:14:41.036156 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:14:41.036156 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 19:14:41.036156 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:14:41.036156 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 111/214] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:14:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:14:41.041946 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a714ee4-df40-439e-9883-b97b10968be8 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:41.056496 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:41.075284 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c731f6-bc75-4b37-9c60-1c7673fadbf7 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:41.118500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb255f8-ae69-4e58-8365-757a62b2516b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:41.120102 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb255f8-ae69-4e58-8365-757a62b2516b None admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:41.120541 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb255f8-ae69-4e58-8365-757a62b2516b None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:41.121221 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb255f8-ae69-4e58-8365-757a62b2516b None admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:41.122083 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb255f8-ae69-4e58-8365-757a62b2516b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:41.124608 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb255f8-ae69-4e58-8365-757a62b2516b None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:41.169982 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a714ee4-df40-439e-9883-b97b10968be8 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:41.203739 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfaff5f-7a13-45b6-8c89-d0f9a3ec857f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:41.204345 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfaff5f-7a13-45b6-8c89-d0f9a3ec857f None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:41.204628 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfaff5f-7a13-45b6-8c89-d0f9a3ec857f None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:41.204904 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfaff5f-7a13-45b6-8c89-d0f9a3ec857f None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:41.205641 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfaff5f-7a13-45b6-8c89-d0f9a3ec857f None admin] RBAC: Adding query filter params (name=member) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:41.205947 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfaff5f-7a13-45b6-8c89-d0f9a3ec857f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:41.207381 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfaff5f-7a13-45b6-8c89-d0f9a3ec857f None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:41.216060 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 112/215] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Jul 21 19:14:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:41.217323 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd831768-4dea-4b64-9810-719258ecc807 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:41.217616 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd831768-4dea-4b64-9810-719258ecc807 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:41.217898 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd831768-4dea-4b64-9810-719258ecc807 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:41.219290 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 113/216] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:14:41.223973 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd831768-4dea-4b64-9810-719258ecc807 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:41.225197 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 104/217] 10.222.0.60 () {60 vars in 1132 bytes} [Thu Jul 21 19:14:40 2022] POST /identity/v3/users => generated 297 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 19:14:41.237115 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde3e2b-1bb4-4e8c-a171-60ae491dec76 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:41.237477 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde3e2b-1bb4-4e8c-a171-60ae491dec76 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:41.237836 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde3e2b-1bb4-4e8c-a171-60ae491dec76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:41.262375 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-0dde3e2b-1bb4-4e8c-a171-60ae491dec76 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:41.264892 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-0dde3e2b-1bb4-4e8c-a171-60ae491dec76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:41.306537 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:41.348720 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd831768-4dea-4b64-9810-719258ecc807 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:41.352562 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:41.366175 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 105/218] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:14:41.391904 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde3e2b-1bb4-4e8c-a171-60ae491dec76 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:41.400638 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933a0c3-05cf-40c1-b9e5-d784e803ffde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:41.401875 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933a0c3-05cf-40c1-b9e5-d784e803ffde None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:41.402340 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933a0c3-05cf-40c1-b9e5-d784e803ffde None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:41.402847 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933a0c3-05cf-40c1-b9e5-d784e803ffde None admin] PATH_INFO: `/v3/users/00357edc3bc7442d8202042c70b1e518` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:41.430235 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933a0c3-05cf-40c1-b9e5-d784e803ffde None admin] RBAC: Authorizing `identity:get_user(user_id=00357edc3bc7442d8202042c70b1e518)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:41.435019 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933a0c3-05cf-40c1-b9e5-d784e803ffde None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:41.437151 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 114/219] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:14:41 2022] GET /identity/v3/users/00357edc3bc7442d8202042c70b1e518 => generated 297 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:41.442830 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933a0c3-05cf-40c1-b9e5-d784e803ffde None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:41.532548 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde3e2b-1bb4-4e8c-a171-60ae491dec76 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:41.570577 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933a0c3-05cf-40c1-b9e5-d784e803ffde None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:41.583693 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b1ad2-b212-4be8-9e74-c49f6ea528ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:41.584549 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b1ad2-b212-4be8-9e74-c49f6ea528ed None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:41.584832 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b1ad2-b212-4be8-9e74-c49f6ea528ed None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:41.585104 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b1ad2-b212-4be8-9e74-c49f6ea528ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:41.598899 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3b1ad2-b212-4be8-9e74-c49f6ea528ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:14:41.603373 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:41.606961 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-3a3b1ad2-b212-4be8-9e74-c49f6ea528ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:14:41.606961 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:14:41.606961 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:14:41.606961 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:14:41.606961 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:14:41.606961 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:14:41.606961 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:14:41.606961 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:14:41.606961 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:14:41.606961 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:14:41.606961 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:14:41.606961 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:14:41.606961 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:14:41.606961 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:14:41.606961 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:14:41.606961 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:14:41.607894 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:14:41.607894 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:14:41.607894 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:14:41.607894 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:14:41.607894 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:14:41.607894 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:14:41.607894 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:14:41.607894 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:14:41.607894 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:14:41.607894 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:14:41.607894 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:14:41.607894 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:14:41.607894 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:14:41.607894 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:14:41.607894 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:14:41.607894 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:14:41.608734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:14:41.608734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:14:41.608734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:14:41.608734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:14:41.608734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:14:41.608734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:14:41.608734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:14:41.608734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:14:41.608734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:14:41.608734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:14:41.608734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:14:41.608734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:14:41.608734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 106/220] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Jul 21 19:14:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:14:41.615257 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b1ad2-b212-4be8-9e74-c49f6ea528ed None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:41.620350 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d370a37-5903-4502-a8fd-62732e6dad37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:41.621081 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d370a37-5903-4502-a8fd-62732e6dad37 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:41.621325 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d370a37-5903-4502-a8fd-62732e6dad37 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:41.621664 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d370a37-5903-4502-a8fd-62732e6dad37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:41.683639 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:41.711715 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d370a37-5903-4502-a8fd-62732e6dad37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:41.713217 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d370a37-5903-4502-a8fd-62732e6dad37 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:41.748039 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b1ad2-b212-4be8-9e74-c49f6ea528ed None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:41.785806 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0146ae2-4155-4fb3-8d57-d8adc3c03ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:41.786889 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0146ae2-4155-4fb3-8d57-d8adc3c03ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:41.787525 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0146ae2-4155-4fb3-8d57-d8adc3c03ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:41.788005 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0146ae2-4155-4fb3-8d57-d8adc3c03ba2 None admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:41.788956 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0146ae2-4155-4fb3-8d57-d8adc3c03ba2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:41.789498 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0146ae2-4155-4fb3-8d57-d8adc3c03ba2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:41.791215 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0146ae2-4155-4fb3-8d57-d8adc3c03ba2 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:41.800726 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 107/221] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:14:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:41.807420 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0146ae2-4155-4fb3-8d57-d8adc3c03ba2 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:41.820045 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 115/222] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:14:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 19:14:41.837083 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d370a37-5903-4502-a8fd-62732e6dad37 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:41.880281 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:41.923398 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0146ae2-4155-4fb3-8d57-d8adc3c03ba2 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:41.939267 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:41.960803 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d370a37-5903-4502-a8fd-62732e6dad37 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:41.961956 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e590fa-6607-4ade-81fc-2378b7aacd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:41.963035 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e590fa-6607-4ade-81fc-2378b7aacd30 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:41.963423 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e590fa-6607-4ade-81fc-2378b7aacd30 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:41.963818 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e590fa-6607-4ade-81fc-2378b7aacd30 None admin] PATH_INFO: `/v3/users/e08b3c894b23421aabdc51fe682d0738` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:41.965267 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e590fa-6607-4ade-81fc-2378b7aacd30 None admin] RBAC: Authorizing `identity:get_user(user_id=e08b3c894b23421aabdc51fe682d0738)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:41.966815 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e590fa-6607-4ade-81fc-2378b7aacd30 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:41.968665 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 108/223] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:14:41 2022] GET /identity/v3/users/e08b3c894b23421aabdc51fe682d0738 => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:41.974842 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e590fa-6607-4ade-81fc-2378b7aacd30 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:42.002149 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f15198-c92c-4ed2-81f4-0a002cb07a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:42.003351 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f15198-c92c-4ed2-81f4-0a002cb07a72 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:42.003895 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f15198-c92c-4ed2-81f4-0a002cb07a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:42.004307 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f15198-c92c-4ed2-81f4-0a002cb07a72 None admin] PATH_INFO: `/v3/projects/d47c3e61323f489c977cc4785142f555` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:42.005669 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f15198-c92c-4ed2-81f4-0a002cb07a72 None admin] RBAC: Authorizing `identity:get_project(project_id=d47c3e61323f489c977cc4785142f555)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:42.007606 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f15198-c92c-4ed2-81f4-0a002cb07a72 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:42.010175 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 116/224] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:14:41 2022] GET /identity/v3/projects/d47c3e61323f489c977cc4785142f555 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:14:42.020549 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f15198-c92c-4ed2-81f4-0a002cb07a72 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:42.089776 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e590fa-6607-4ade-81fc-2378b7aacd30 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:42.131854 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03bd4bc-945f-45d5-a550-ff2bccf6a329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:42.134072 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03bd4bc-945f-45d5-a550-ff2bccf6a329 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:42.134553 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03bd4bc-945f-45d5-a550-ff2bccf6a329 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:42.135385 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03bd4bc-945f-45d5-a550-ff2bccf6a329 None admin] PATH_INFO: `/v3/projects/d47c3e61323f489c977cc4785142f555` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:42.137130 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03bd4bc-945f-45d5-a550-ff2bccf6a329 None admin] RBAC: Authorizing `identity:get_project(project_id=d47c3e61323f489c977cc4785142f555)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:42.139537 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03bd4bc-945f-45d5-a550-ff2bccf6a329 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:42.142581 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 109/225] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:14:41 2022] GET /identity/v3/projects/d47c3e61323f489c977cc4785142f555 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:14:42.144119 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2007625-5132-42d6-bd57-8900a421010f None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:42.144606 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2007625-5132-42d6-bd57-8900a421010f None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:42.145076 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2007625-5132-42d6-bd57-8900a421010f None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:42.146734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 110/226] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:14:42.147661 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2007625-5132-42d6-bd57-8900a421010f None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:42.156581 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:42.164177 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f15198-c92c-4ed2-81f4-0a002cb07a72 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:42.202897 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ffc2c-a093-4748-ba96-027726235fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:42.203646 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ffc2c-a093-4748-ba96-027726235fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:42.203935 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ffc2c-a093-4748-ba96-027726235fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:42.204266 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ffc2c-a093-4748-ba96-027726235fb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:42.205108 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ffc2c-a093-4748-ba96-027726235fb5 None admin] RBAC: Adding query filter params (role.id=0af30c087b3541a4847d708dd68464d6, scope.project.id=d47c3e61323f489c977cc4785142f555, user.id=00357edc3bc7442d8202042c70b1e518) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:42.205425 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ffc2c-a093-4748-ba96-027726235fb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:42.206978 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ffc2c-a093-4748-ba96-027726235fb5 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:42.217582 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:42.219745 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 117/227] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:14:42 2022] GET /identity/v3/role_assignments?user.id=00357edc3bc7442d8202042c70b1e518&scope.project.id=d47c3e61323f489c977cc4785142f555&role.id=0af30c087b3541a4847d708dd68464d6 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:42.221448 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d386b-1a96-4099-949c-ad21fee13a5f None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:42.221743 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d386b-1a96-4099-949c-ad21fee13a5f None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:42.222025 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d386b-1a96-4099-949c-ad21fee13a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:42.252184 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-d03d386b-1a96-4099-949c-ad21fee13a5f None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:42.253663 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-d03d386b-1a96-4099-949c-ad21fee13a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:42.282223 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2007625-5132-42d6-bd57-8900a421010f None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:42.331685 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf0104-c8ff-48ed-86e8-d70632068548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:42.333272 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf0104-c8ff-48ed-86e8-d70632068548 None admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:42.333788 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf0104-c8ff-48ed-86e8-d70632068548 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:42.334265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf0104-c8ff-48ed-86e8-d70632068548 None admin] PATH_INFO: `/v3/projects/d47c3e61323f489c977cc4785142f555/users/e08b3c894b23421aabdc51fe682d0738/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:42.337928 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf0104-c8ff-48ed-86e8-d70632068548 None admin] RBAC: Authorizing `identity:create_grant(project_id=d47c3e61323f489c977cc4785142f555, user_id=e08b3c894b23421aabdc51fe682d0738, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:42.339686 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf0104-c8ff-48ed-86e8-d70632068548 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:42.385328 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 118/228] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:14:42.409362 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d386b-1a96-4099-949c-ad21fee13a5f None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:42.447344 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 111/229] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Jul 21 19:14:42 2022] PUT /identity/v3/projects/d47c3e61323f489c977cc4785142f555/users/e08b3c894b23421aabdc51fe682d0738/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:14:42.528458 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:42.542688 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d386b-1a96-4099-949c-ad21fee13a5f None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:42.588113 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98479c9-f9ab-4e8a-a31b-f4847f63fc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:42.589359 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98479c9-f9ab-4e8a-a31b-f4847f63fc37 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:42.589847 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98479c9-f9ab-4e8a-a31b-f4847f63fc37 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:42.590339 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98479c9-f9ab-4e8a-a31b-f4847f63fc37 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:42.607330 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98479c9-f9ab-4e8a-a31b-f4847f63fc37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:14:42.616003 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-f98479c9-f9ab-4e8a-a31b-f4847f63fc37 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 19:14:42.616003 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:14:42.616003 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:14:42.616003 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:14:42.616003 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:14:42.616003 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:14:42.616003 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:14:42.616003 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:14:42.616003 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:14:42.616003 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:14:42.616003 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:14:42.616003 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:14:42.616003 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:14:42.616003 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:14:42.616003 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:14:42.616003 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:14:42.616920 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:14:42.616920 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:14:42.616920 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:14:42.616920 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:14:42.616920 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:14:42.616920 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:14:42.616920 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:14:42.616920 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:14:42.616920 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:14:42.616920 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:14:42.616920 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:14:42.616920 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:14:42.616920 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:14:42.616920 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:14:42.616920 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:14:42.616920 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:14:42.618583 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:14:42.618583 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:14:42.618583 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:14:42.618583 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:14:42.618583 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:14:42.618583 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:14:42.618583 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:14:42.618583 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:14:42.618583 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:14:42.618583 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:14:42.618583 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 19:14:42.618583 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:14:42.621396 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 119/230] 10.222.0.60 () {56 vars in 1114 bytes} [Thu Jul 21 19:14:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:14:42.626842 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf0104-c8ff-48ed-86e8-d70632068548 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:42.745342 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf0104-c8ff-48ed-86e8-d70632068548 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:42.758471 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:42.786623 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905bb4a9-b7ad-4bc8-b45e-e4a443906a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:42.787320 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905bb4a9-b7ad-4bc8-b45e-e4a443906a60 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:42.787641 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905bb4a9-b7ad-4bc8-b45e-e4a443906a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:42.787922 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905bb4a9-b7ad-4bc8-b45e-e4a443906a60 None admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:42.788689 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905bb4a9-b7ad-4bc8-b45e-e4a443906a60 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:42.789001 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905bb4a9-b7ad-4bc8-b45e-e4a443906a60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:42.791274 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905bb4a9-b7ad-4bc8-b45e-e4a443906a60 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:42.808235 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 112/231] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:14:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:42.814029 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98479c9-f9ab-4e8a-a31b-f4847f63fc37 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:42.935661 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98479c9-f9ab-4e8a-a31b-f4847f63fc37 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:42.972334 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f1432-e005-429c-ae22-a8969dfca71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:42.973557 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f1432-e005-429c-ae22-a8969dfca71e None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:42.974044 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f1432-e005-429c-ae22-a8969dfca71e None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:42.974516 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f1432-e005-429c-ae22-a8969dfca71e None admin] PATH_INFO: `/v3/users/e08b3c894b23421aabdc51fe682d0738` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:42.975952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f1432-e005-429c-ae22-a8969dfca71e None admin] RBAC: Authorizing `identity:get_user(user_id=e08b3c894b23421aabdc51fe682d0738)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:42.977775 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f1432-e005-429c-ae22-a8969dfca71e None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:42.979937 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 120/232] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:14:42 2022] GET /identity/v3/users/e08b3c894b23421aabdc51fe682d0738 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:42.985649 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905bb4a9-b7ad-4bc8-b45e-e4a443906a60 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:43.107521 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905bb4a9-b7ad-4bc8-b45e-e4a443906a60 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:43.149641 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7483f9f-cd76-4b71-a3b2-e82a5469327a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:43.150884 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7483f9f-cd76-4b71-a3b2-e82a5469327a None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:43.151375 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7483f9f-cd76-4b71-a3b2-e82a5469327a None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:43.151867 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7483f9f-cd76-4b71-a3b2-e82a5469327a None admin] PATH_INFO: `/v3/projects/d47c3e61323f489c977cc4785142f555` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:43.156165 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7483f9f-cd76-4b71-a3b2-e82a5469327a None admin] RBAC: Authorizing `identity:get_project(project_id=d47c3e61323f489c977cc4785142f555)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:43.158160 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7483f9f-cd76-4b71-a3b2-e82a5469327a None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:43.160256 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 113/233] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:14:42 2022] GET /identity/v3/projects/d47c3e61323f489c977cc4785142f555 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:43.166778 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f1432-e005-429c-ae22-a8969dfca71e None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:43.192175 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:43.301418 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f1432-e005-429c-ae22-a8969dfca71e None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:43.337147 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a1d14-44a9-4600-8441-26031915bc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:43.338395 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a1d14-44a9-4600-8441-26031915bc45 None admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:43.338881 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a1d14-44a9-4600-8441-26031915bc45 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:43.339405 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a1d14-44a9-4600-8441-26031915bc45 None admin] PATH_INFO: `/v3/projects/d47c3e61323f489c977cc4785142f555/users/e08b3c894b23421aabdc51fe682d0738/roles/3ad609555dec437d92e5c7291b1c939a` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:43.341956 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a1d14-44a9-4600-8441-26031915bc45 None admin] RBAC: Authorizing `identity:create_grant(project_id=d47c3e61323f489c977cc4785142f555, user_id=e08b3c894b23421aabdc51fe682d0738, role_id=3ad609555dec437d92e5c7291b1c939a)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:43.343642 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a1d14-44a9-4600-8441-26031915bc45 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:43.437843 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 121/234] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Jul 21 19:14:43 2022] PUT /identity/v3/projects/d47c3e61323f489c977cc4785142f555/users/e08b3c894b23421aabdc51fe682d0738/roles/3ad609555dec437d92e5c7291b1c939a => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:14:43.851293 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab7b3d-96a4-45d3-a101-44ce70770ced None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:43.852951 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab7b3d-96a4-45d3-a101-44ce70770ced None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:43.853461 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab7b3d-96a4-45d3-a101-44ce70770ced None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:43.855174 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 114/235] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:14:43.862037 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782db22a-63a7-45bb-b923-c7edac3c5b94 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:43.862884 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782db22a-63a7-45bb-b923-c7edac3c5b94 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:43.863368 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782db22a-63a7-45bb-b923-c7edac3c5b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:43.880901 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-782db22a-63a7-45bb-b923-c7edac3c5b94 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:43.882407 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-782db22a-63a7-45bb-b923-c7edac3c5b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:43.956868 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 122/236] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 19:14:43.981349 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab7b3d-96a4-45d3-a101-44ce70770ced None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:44.016806 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b52431-0e99-4ab2-adf4-6fc35e917f5b None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:44.017092 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b52431-0e99-4ab2-adf4-6fc35e917f5b None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:44.017542 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b52431-0e99-4ab2-adf4-6fc35e917f5b None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:44.018926 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 123/237] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:14:44.025137 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4f961-4fd3-41e1-b1ce-17ddcc0bfda9 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:44.025425 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4f961-4fd3-41e1-b1ce-17ddcc0bfda9 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:44.025706 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4f961-4fd3-41e1-b1ce-17ddcc0bfda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:44.035529 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:44.038536 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:44.044966 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-f8e4f961-4fd3-41e1-b1ce-17ddcc0bfda9 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:44.046630 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f8e4f961-4fd3-41e1-b1ce-17ddcc0bfda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:44.097100 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab7b3d-96a4-45d3-a101-44ce70770ced None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:44.126874 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 124/238] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 19:14:44.145028 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a21cec-8815-4b02-aaf3-14dce2e3b643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:44.145841 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a21cec-8815-4b02-aaf3-14dce2e3b643 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:44.146130 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a21cec-8815-4b02-aaf3-14dce2e3b643 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:44.146410 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a21cec-8815-4b02-aaf3-14dce2e3b643 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:44.165247 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a21cec-8815-4b02-aaf3-14dce2e3b643 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:14:44.173133 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-42a21cec-8815-4b02-aaf3-14dce2e3b643 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 19:14:44.173133 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:14:44.173133 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:14:44.173133 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:14:44.173133 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:14:44.173133 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:14:44.173133 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:14:44.173133 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:14:44.173133 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:14:44.173133 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:14:44.173133 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:14:44.173133 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:14:44.173133 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:14:44.173133 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:14:44.173133 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:14:44.173133 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:14:44.174006 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:14:44.174006 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:14:44.174006 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:14:44.174006 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:14:44.174006 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:14:44.174006 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:14:44.174006 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:14:44.174006 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:14:44.174006 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:14:44.174006 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:14:44.174006 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:14:44.174006 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:14:44.174006 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:14:44.174006 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:14:44.174006 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:14:44.174006 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:14:44.174834 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:14:44.174834 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:14:44.174834 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:14:44.174834 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:14:44.174834 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:14:44.174834 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:14:44.174834 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:14:44.174834 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:14:44.174834 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:14:44.174834 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:14:44.174834 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 19:14:44.174834 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:14:44.179929 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 115/239] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:14:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:14:44.181753 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4f961-4fd3-41e1-b1ce-17ddcc0bfda9 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:44.193288 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a21cec-8815-4b02-aaf3-14dce2e3b643 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:44.314419 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a21cec-8815-4b02-aaf3-14dce2e3b643 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:44.319367 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:44.355031 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108fed47-d132-44ce-b372-c7e3b442d2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:44.355741 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108fed47-d132-44ce-b372-c7e3b442d2a2 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:44.356033 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108fed47-d132-44ce-b372-c7e3b442d2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:44.356320 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108fed47-d132-44ce-b372-c7e3b442d2a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:44.357091 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108fed47-d132-44ce-b372-c7e3b442d2a2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:44.357395 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108fed47-d132-44ce-b372-c7e3b442d2a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:44.358800 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108fed47-d132-44ce-b372-c7e3b442d2a2 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:44.359574 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4f961-4fd3-41e1-b1ce-17ddcc0bfda9 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:44.367454 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 116/240] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Jul 21 19:14:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:14:44.373933 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108fed47-d132-44ce-b372-c7e3b442d2a2 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:44.436808 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c00c10-feb3-4d81-a72d-b9e66d92e093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:44.437646 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c00c10-feb3-4d81-a72d-b9e66d92e093 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:44.437887 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c00c10-feb3-4d81-a72d-b9e66d92e093 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:44.438166 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c00c10-feb3-4d81-a72d-b9e66d92e093 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:44.439467 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c00c10-feb3-4d81-a72d-b9e66d92e093 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:44.440938 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c00c10-feb3-4d81-a72d-b9e66d92e093 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:44.442913 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 125/241] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:14:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:44.462322 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c00c10-feb3-4d81-a72d-b9e66d92e093 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:44.466261 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:44.583670 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108fed47-d132-44ce-b372-c7e3b442d2a2 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:44.621181 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c00c10-feb3-4d81-a72d-b9e66d92e093 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:44.634789 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06866078-e521-48d7-8503-88c99a17ea39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:44.635825 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06866078-e521-48d7-8503-88c99a17ea39 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:44.636116 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06866078-e521-48d7-8503-88c99a17ea39 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:44.636393 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06866078-e521-48d7-8503-88c99a17ea39 None admin] PATH_INFO: `/v3/users/7645c66412de4713a810c394ff0b8301` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:44.653217 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06866078-e521-48d7-8503-88c99a17ea39 None admin] RBAC: Authorizing `identity:get_user(user_id=7645c66412de4713a810c394ff0b8301)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:44.655366 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06866078-e521-48d7-8503-88c99a17ea39 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:44.657961 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 117/242] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:14:44 2022] GET /identity/v3/users/7645c66412de4713a810c394ff0b8301 => generated 297 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:44.659495 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4e4d5-c7e3-4312-95d8-e82454bb8cf5 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:44.660044 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4e4d5-c7e3-4312-95d8-e82454bb8cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:44.660506 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4e4d5-c7e3-4312-95d8-e82454bb8cf5 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:44.661050 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e4d94-39c6-4394-a2e5-c18bee918b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:44.661795 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e4d94-39c6-4394-a2e5-c18bee918b2f None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:44.662151 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e4d94-39c6-4394-a2e5-c18bee918b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:44.662555 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e4d94-39c6-4394-a2e5-c18bee918b2f None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:44.667138 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e4d94-39c6-4394-a2e5-c18bee918b2f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:44.667138 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e4d94-39c6-4394-a2e5-c18bee918b2f None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:44.667637 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 118/243] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:44 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:14:44.668593 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b4e4d5-c7e3-4312-95d8-e82454bb8cf5 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:44.693148 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:44.745925 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 126/244] 10.222.0.60 () {60 vars in 1132 bytes} [Thu Jul 21 19:14:44 2022] POST /identity/v3/users => generated 293 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 19:14:44.754949 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f653c-10b3-4a37-869e-b3ff67b87916 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:44.754949 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f653c-10b3-4a37-869e-b3ff67b87916 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:44.754949 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f653c-10b3-4a37-869e-b3ff67b87916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:44.799550 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-e05f653c-10b3-4a37-869e-b3ff67b87916 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:44.803205 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-e05f653c-10b3-4a37-869e-b3ff67b87916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:44.845743 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b4e4d5-c7e3-4312-95d8-e82454bb8cf5 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:44.926724 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:44.929716 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e8c0f-9833-46f3-a104-75e0d69b98ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:44.930991 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e8c0f-9833-46f3-a104-75e0d69b98ef None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:44.931524 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e8c0f-9833-46f3-a104-75e0d69b98ef None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:44.931976 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e8c0f-9833-46f3-a104-75e0d69b98ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:44.958425 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 127/245] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:14:45.020704 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f653c-10b3-4a37-869e-b3ff67b87916 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:45.075375 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e8c0f-9833-46f3-a104-75e0d69b98ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:45.077188 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e8c0f-9833-46f3-a104-75e0d69b98ef None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:45.120149 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:45.194798 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f653c-10b3-4a37-869e-b3ff67b87916 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:45.266212 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515719be-c2f5-459e-afe1-4301eced05d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:45.266212 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515719be-c2f5-459e-afe1-4301eced05d9 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:45.266212 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515719be-c2f5-459e-afe1-4301eced05d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:45.266212 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515719be-c2f5-459e-afe1-4301eced05d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:45.267534 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 119/246] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:14:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 19:14:45.269081 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57caab03-e0ec-47a9-9333-b83072f6da56 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:45.271099 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57caab03-e0ec-47a9-9333-b83072f6da56 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:45.271414 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57caab03-e0ec-47a9-9333-b83072f6da56 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:45.279476 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 120/247] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:45 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:14:45.280405 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57caab03-e0ec-47a9-9333-b83072f6da56 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:45.282820 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515719be-c2f5-459e-afe1-4301eced05d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:14:45.292611 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-515719be-c2f5-459e-afe1-4301eced05d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 19:14:45.292611 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:14:45.292611 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:14:45.292611 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:14:45.292611 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:14:45.292611 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:14:45.292611 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:14:45.292611 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:14:45.292611 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:14:45.292611 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:14:45.292611 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:14:45.292611 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:14:45.292611 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:14:45.292611 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:14:45.292611 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:14:45.292611 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:14:45.293561 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:14:45.293561 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:14:45.293561 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:14:45.293561 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:14:45.293561 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:14:45.293561 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:14:45.293561 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:14:45.293561 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:14:45.293561 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:14:45.293561 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:14:45.293561 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:14:45.293561 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:14:45.293561 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:14:45.293561 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:14:45.293561 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:14:45.293561 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:14:45.294353 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:14:45.294353 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:14:45.294353 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:14:45.294353 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:14:45.294353 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:14:45.294353 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:14:45.294353 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:14:45.294353 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:14:45.294353 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:14:45.294353 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:14:45.294353 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 19:14:45.294353 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:14:45.294353 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 128/248] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:14:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:14:45.295772 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a242a41-bf1f-437d-a4a3-e955330e4c0c None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:45.301451 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a242a41-bf1f-437d-a4a3-e955330e4c0c None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:45.302010 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a242a41-bf1f-437d-a4a3-e955330e4c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:45.323706 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-2a242a41-bf1f-437d-a4a3-e955330e4c0c None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:45.325105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-2a242a41-bf1f-437d-a4a3-e955330e4c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:45.388172 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:45.417716 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57caab03-e0ec-47a9-9333-b83072f6da56 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:45.418079 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 129/249] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:14:45.424416 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a242a41-bf1f-437d-a4a3-e955330e4c0c None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:45.460851 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:45.477109 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9048dd-e433-4c45-ac8d-e6de7cdf6821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:45.478175 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9048dd-e433-4c45-ac8d-e6de7cdf6821 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:45.478463 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9048dd-e433-4c45-ac8d-e6de7cdf6821 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:45.478745 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9048dd-e433-4c45-ac8d-e6de7cdf6821 None admin] PATH_INFO: `/v3/projects/d47c3e61323f489c977cc4785142f555` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:45.480029 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9048dd-e433-4c45-ac8d-e6de7cdf6821 None admin] RBAC: Authorizing `identity:get_project(project_id=d47c3e61323f489c977cc4785142f555)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:45.481492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9048dd-e433-4c45-ac8d-e6de7cdf6821 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:45.484045 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 121/250] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:14:45 2022] GET /identity/v3/projects/d47c3e61323f489c977cc4785142f555 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:45.485917 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9048dd-e433-4c45-ac8d-e6de7cdf6821 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:45.570122 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a242a41-bf1f-437d-a4a3-e955330e4c0c None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:45.605230 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9048dd-e433-4c45-ac8d-e6de7cdf6821 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:45.614182 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16935bb8-fca8-4d7e-ba6a-003975f5abc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:45.615296 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16935bb8-fca8-4d7e-ba6a-003975f5abc2 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:45.615615 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16935bb8-fca8-4d7e-ba6a-003975f5abc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:45.615894 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16935bb8-fca8-4d7e-ba6a-003975f5abc2 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:45.617038 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16935bb8-fca8-4d7e-ba6a-003975f5abc2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:45.617541 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16935bb8-fca8-4d7e-ba6a-003975f5abc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:45.619773 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16935bb8-fca8-4d7e-ba6a-003975f5abc2 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:45.631081 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 130/251] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Jul 21 19:14:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:45.632295 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16935bb8-fca8-4d7e-ba6a-003975f5abc2 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:45.644430 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee780d9-54ff-4d11-b73c-8958ab3410d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:45.645227 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee780d9-54ff-4d11-b73c-8958ab3410d8 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:45.645617 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee780d9-54ff-4d11-b73c-8958ab3410d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:45.645899 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee780d9-54ff-4d11-b73c-8958ab3410d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:45.657298 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee780d9-54ff-4d11-b73c-8958ab3410d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:14:45.666086 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-5ee780d9-54ff-4d11-b73c-8958ab3410d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:14:45.666086 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:14:45.666086 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:14:45.666086 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:14:45.666086 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:14:45.666086 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:14:45.666086 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:14:45.666086 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:14:45.666086 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:14:45.666086 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:14:45.666086 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:14:45.666086 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:14:45.666086 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:14:45.666086 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:14:45.666086 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:14:45.666086 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:14:45.666974 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:14:45.666974 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:14:45.666974 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:14:45.666974 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:14:45.666974 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:14:45.666974 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:14:45.666974 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:14:45.666974 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:14:45.666974 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:14:45.666974 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:14:45.666974 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:14:45.666974 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:14:45.666974 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:14:45.666974 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:14:45.666974 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:14:45.666974 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:14:45.667807 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:14:45.667807 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:14:45.667807 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:14:45.667807 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:14:45.667807 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:14:45.667807 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:14:45.667807 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:14:45.667807 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:14:45.667807 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:14:45.667807 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:14:45.667807 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:14:45.667807 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:14:45.667807 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 122/252] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Jul 21 19:14:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:14:45.668446 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee780d9-54ff-4d11-b73c-8958ab3410d8 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:45.682599 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:45.730711 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:45.746397 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16935bb8-fca8-4d7e-ba6a-003975f5abc2 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:45.781993 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a781e3f-021b-4667-b9b0-aea1c4f5ac40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:45.782664 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a781e3f-021b-4667-b9b0-aea1c4f5ac40 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:45.782954 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a781e3f-021b-4667-b9b0-aea1c4f5ac40 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:45.783237 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a781e3f-021b-4667-b9b0-aea1c4f5ac40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:45.784112 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a781e3f-021b-4667-b9b0-aea1c4f5ac40 None admin] RBAC: Adding query filter params (role.id=9d25a11a44b24a3eb36a9ecd8d89321d, scope.project.id=d47c3e61323f489c977cc4785142f555, user.id=7645c66412de4713a810c394ff0b8301) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:45.784430 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a781e3f-021b-4667-b9b0-aea1c4f5ac40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:45.785887 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a781e3f-021b-4667-b9b0-aea1c4f5ac40 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:45.793146 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 131/253] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:14:45 2022] GET /identity/v3/role_assignments?user.id=7645c66412de4713a810c394ff0b8301&scope.project.id=d47c3e61323f489c977cc4785142f555&role.id=9d25a11a44b24a3eb36a9ecd8d89321d => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:45.794118 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a781e3f-021b-4667-b9b0-aea1c4f5ac40 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:45.806519 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee780d9-54ff-4d11-b73c-8958ab3410d8 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:45.876336 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2682337-9140-43a4-ba0d-c8d96febcb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:45.877153 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2682337-9140-43a4-ba0d-c8d96febcb89 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:45.877437 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2682337-9140-43a4-ba0d-c8d96febcb89 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:45.877715 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2682337-9140-43a4-ba0d-c8d96febcb89 None admin] PATH_INFO: `/v3/users/00357edc3bc7442d8202042c70b1e518` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:45.880365 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2682337-9140-43a4-ba0d-c8d96febcb89 None admin] RBAC: Authorizing `identity:get_user(user_id=00357edc3bc7442d8202042c70b1e518)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:45.881972 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2682337-9140-43a4-ba0d-c8d96febcb89 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:45.883996 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 123/254] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:14:45 2022] GET /identity/v3/users/00357edc3bc7442d8202042c70b1e518 => generated 297 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:45.889645 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2682337-9140-43a4-ba0d-c8d96febcb89 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:45.908189 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a781e3f-021b-4667-b9b0-aea1c4f5ac40 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:45.920168 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:45.948424 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d78a4-2325-4a60-8294-bf12ec1e8008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:45.949180 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d78a4-2325-4a60-8294-bf12ec1e8008 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:45.949411 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d78a4-2325-4a60-8294-bf12ec1e8008 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:45.949694 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d78a4-2325-4a60-8294-bf12ec1e8008 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:45.950462 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d78a4-2325-4a60-8294-bf12ec1e8008 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:45.950776 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d78a4-2325-4a60-8294-bf12ec1e8008 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:45.952375 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d78a4-2325-4a60-8294-bf12ec1e8008 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:45.963274 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 132/255] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:14:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:45.968599 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d78a4-2325-4a60-8294-bf12ec1e8008 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:46.073232 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2682337-9140-43a4-ba0d-c8d96febcb89 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:46.083937 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d78a4-2325-4a60-8294-bf12ec1e8008 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:46.115801 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:46.122371 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e95275e-a58d-460e-95c9-0de58d2fec80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:46.132920 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95275e-a58d-460e-95c9-0de58d2fec80 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:46.132920 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95275e-a58d-460e-95c9-0de58d2fec80 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:46.132920 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95275e-a58d-460e-95c9-0de58d2fec80 None admin] PATH_INFO: `/v3/users/e08b3c894b23421aabdc51fe682d0738` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:46.132920 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e95275e-a58d-460e-95c9-0de58d2fec80 None admin] RBAC: Authorizing `identity:get_user(user_id=e08b3c894b23421aabdc51fe682d0738)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:46.132920 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e95275e-a58d-460e-95c9-0de58d2fec80 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:46.132920 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 133/256] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:14:45 2022] GET /identity/v3/users/e08b3c894b23421aabdc51fe682d0738 => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:14:46.134846 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e95275e-a58d-460e-95c9-0de58d2fec80 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:46.148172 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83feaa93-f1b3-423b-b05d-68dd467d7a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:46.149115 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83feaa93-f1b3-423b-b05d-68dd467d7a16 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:46.149580 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83feaa93-f1b3-423b-b05d-68dd467d7a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:46.149866 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83feaa93-f1b3-423b-b05d-68dd467d7a16 None admin] PATH_INFO: `/v3/projects/d47c3e61323f489c977cc4785142f555` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:46.151191 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83feaa93-f1b3-423b-b05d-68dd467d7a16 None admin] RBAC: Authorizing `identity:get_project(project_id=d47c3e61323f489c977cc4785142f555)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:46.152651 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83feaa93-f1b3-423b-b05d-68dd467d7a16 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:46.155752 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 124/257] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:14:45 2022] GET /identity/v3/projects/d47c3e61323f489c977cc4785142f555 => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:14:46.164424 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83feaa93-f1b3-423b-b05d-68dd467d7a16 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:46.176142 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:46.326964 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e95275e-a58d-460e-95c9-0de58d2fec80 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:46.346685 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83feaa93-f1b3-423b-b05d-68dd467d7a16 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:46.384858 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49438182-e068-4055-a8f9-0ed43d746e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:46.385681 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49438182-e068-4055-a8f9-0ed43d746e94 None admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:46.385964 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49438182-e068-4055-a8f9-0ed43d746e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:46.386241 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49438182-e068-4055-a8f9-0ed43d746e94 None admin] PATH_INFO: `/v3/projects/d47c3e61323f489c977cc4785142f555/users/00357edc3bc7442d8202042c70b1e518/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:46.390101 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49438182-e068-4055-a8f9-0ed43d746e94 None admin] RBAC: Authorizing `identity:create_grant(project_id=d47c3e61323f489c977cc4785142f555, user_id=00357edc3bc7442d8202042c70b1e518, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:46.391576 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49438182-e068-4055-a8f9-0ed43d746e94 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:46.403142 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437a297-164c-4d5c-a4bb-1e7cabcf0e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:46.403873 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437a297-164c-4d5c-a4bb-1e7cabcf0e38 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:46.404153 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437a297-164c-4d5c-a4bb-1e7cabcf0e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:46.404429 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437a297-164c-4d5c-a4bb-1e7cabcf0e38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:46.485117 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 125/258] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Jul 21 19:14:46 2022] PUT /identity/v3/projects/d47c3e61323f489c977cc4785142f555/users/00357edc3bc7442d8202042c70b1e518/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:14:46.486489 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0dd8a-2b0f-487e-b837-25e5adea933c None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:46.486779 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0dd8a-2b0f-487e-b837-25e5adea933c None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:46.487065 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0dd8a-2b0f-487e-b837-25e5adea933c None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:46.489784 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 126/259] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:14:46.495041 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437a297-164c-4d5c-a4bb-1e7cabcf0e38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:46.495041 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437a297-164c-4d5c-a4bb-1e7cabcf0e38 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:46.496460 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d161b05-dd62-4557-979a-44f2dda528e4 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:46.496811 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d161b05-dd62-4557-979a-44f2dda528e4 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:46.497094 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d161b05-dd62-4557-979a-44f2dda528e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:46.525581 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-6d161b05-dd62-4557-979a-44f2dda528e4 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:46.526805 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-6d161b05-dd62-4557-979a-44f2dda528e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:46.574670 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:46.575177 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:46.604635 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 127/260] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:14:46.646292 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d161b05-dd62-4557-979a-44f2dda528e4 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:46.733082 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 134/261] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:14:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 19:14:46.735943 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437a297-164c-4d5c-a4bb-1e7cabcf0e38 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:46.787141 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d161b05-dd62-4557-979a-44f2dda528e4 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:46.828806 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0209d7-1020-43f2-82ad-397e7fb57584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:46.829998 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0209d7-1020-43f2-82ad-397e7fb57584 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:46.830500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0209d7-1020-43f2-82ad-397e7fb57584 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:46.830964 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0209d7-1020-43f2-82ad-397e7fb57584 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:46.842633 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0209d7-1020-43f2-82ad-397e7fb57584 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:14:46.851493 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-7b0209d7-1020-43f2-82ad-397e7fb57584 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 19:14:46.851493 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:14:46.851493 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:14:46.851493 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:14:46.851493 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:14:46.851493 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:14:46.851493 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:14:46.851493 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:14:46.851493 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:14:46.851493 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:14:46.851493 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:14:46.851493 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:14:46.851493 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:14:46.851493 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:14:46.851493 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:14:46.851493 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:14:46.853065 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:14:46.853065 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:14:46.853065 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:14:46.853065 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:14:46.853065 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:14:46.853065 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:14:46.853065 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:14:46.853065 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:14:46.853065 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:14:46.853065 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:14:46.853065 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:14:46.853065 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:14:46.853065 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:14:46.853065 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:14:46.853065 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:14:46.853065 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:14:46.853853 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:14:46.853853 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:14:46.853853 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:14:46.853853 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:14:46.853853 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:14:46.853853 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:14:46.853853 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:14:46.853853 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:14:46.853853 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:14:46.853853 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:14:46.853853 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 19:14:46.853853 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:14:46.856782 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 128/262] 10.222.0.60 () {56 vars in 1114 bytes} [Thu Jul 21 19:14:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:14:46.862443 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0209d7-1020-43f2-82ad-397e7fb57584 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:46.879323 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437a297-164c-4d5c-a4bb-1e7cabcf0e38 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:46.924005 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:46.928416 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd611f5-752d-47fe-a6bd-43918b779032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:46.929350 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd611f5-752d-47fe-a6bd-43918b779032 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:46.929637 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd611f5-752d-47fe-a6bd-43918b779032 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:46.930651 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd611f5-752d-47fe-a6bd-43918b779032 None admin] PATH_INFO: `/v3/projects/d47c3e61323f489c977cc4785142f555` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:46.932058 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd611f5-752d-47fe-a6bd-43918b779032 None admin] RBAC: Authorizing `identity:get_project(project_id=d47c3e61323f489c977cc4785142f555)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:46.933535 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd611f5-752d-47fe-a6bd-43918b779032 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:46.935554 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 135/263] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:14:46 2022] GET /identity/v3/projects/d47c3e61323f489c977cc4785142f555 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:14:46.945945 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd611f5-752d-47fe-a6bd-43918b779032 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:46.955125 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:46.983457 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0209d7-1020-43f2-82ad-397e7fb57584 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:47.037208 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314d941-20f6-420d-b975-fb0a36452962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:47.038123 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314d941-20f6-420d-b975-fb0a36452962 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:47.038551 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314d941-20f6-420d-b975-fb0a36452962 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:47.038995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314d941-20f6-420d-b975-fb0a36452962 None admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:47.040023 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b314d941-20f6-420d-b975-fb0a36452962 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:47.040573 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b314d941-20f6-420d-b975-fb0a36452962 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:47.042125 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b314d941-20f6-420d-b975-fb0a36452962 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:47.057753 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 129/264] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:14:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:14:47.059792 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd611f5-752d-47fe-a6bd-43918b779032 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:47.062379 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314d941-20f6-420d-b975-fb0a36452962 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:47.095787 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974754c8-0545-407d-821f-b8a9fa98362d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:47.096907 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974754c8-0545-407d-821f-b8a9fa98362d None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:47.097096 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974754c8-0545-407d-821f-b8a9fa98362d None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:47.097443 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974754c8-0545-407d-821f-b8a9fa98362d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:47.098348 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974754c8-0545-407d-821f-b8a9fa98362d None admin] RBAC: Adding query filter params (role.id=685e18230e1744c581baaf842d0fd4ca, scope.project.id=d47c3e61323f489c977cc4785142f555, user.id=e08b3c894b23421aabdc51fe682d0738) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:47.098755 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974754c8-0545-407d-821f-b8a9fa98362d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:47.100270 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974754c8-0545-407d-821f-b8a9fa98362d None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:47.107479 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 136/265] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:14:46 2022] GET /identity/v3/role_assignments?user.id=e08b3c894b23421aabdc51fe682d0738&scope.project.id=d47c3e61323f489c977cc4785142f555&role.id=685e18230e1744c581baaf842d0fd4ca => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:14:47.211933 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:47.217511 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314d941-20f6-420d-b975-fb0a36452962 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:47.263811 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721819da-c4e0-420b-92b0-730541749498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:47.264701 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721819da-c4e0-420b-92b0-730541749498 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:47.264986 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721819da-c4e0-420b-92b0-730541749498 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:47.265261 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721819da-c4e0-420b-92b0-730541749498 None admin] PATH_INFO: `/v3/users/e08b3c894b23421aabdc51fe682d0738` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:47.272150 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721819da-c4e0-420b-92b0-730541749498 None admin] RBAC: Authorizing `identity:get_user(user_id=e08b3c894b23421aabdc51fe682d0738)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:47.273646 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721819da-c4e0-420b-92b0-730541749498 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:47.275662 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 130/266] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:14:47 2022] GET /identity/v3/users/e08b3c894b23421aabdc51fe682d0738 => generated 283 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:14:47.282838 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974754c8-0545-407d-821f-b8a9fa98362d None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:47.366175 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:47.401669 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974754c8-0545-407d-821f-b8a9fa98362d None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:47.455309 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b852f-0412-41e9-b8bc-74b62f6719fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:47.456000 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b852f-0412-41e9-b8bc-74b62f6719fa None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:47.456417 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b852f-0412-41e9-b8bc-74b62f6719fa None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:47.456701 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b852f-0412-41e9-b8bc-74b62f6719fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:47.543715 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b852f-0412-41e9-b8bc-74b62f6719fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:47.545590 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b852f-0412-41e9-b8bc-74b62f6719fa None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:47.629254 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:47.672018 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 137/267] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:14:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 19:14:47.677530 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721819da-c4e0-420b-92b0-730541749498 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:47.819229 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721819da-c4e0-420b-92b0-730541749498 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:47.880205 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ef857-82fc-47b3-b549-b65d2afc5fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:47.881103 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ef857-82fc-47b3-b549-b65d2afc5fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:47.881394 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ef857-82fc-47b3-b549-b65d2afc5fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:47.881674 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ef857-82fc-47b3-b549-b65d2afc5fc7 None admin] PATH_INFO: `/v3/projects/d47c3e61323f489c977cc4785142f555` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:47.883067 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437ef857-82fc-47b3-b549-b65d2afc5fc7 None admin] RBAC: Authorizing `identity:get_project(project_id=d47c3e61323f489c977cc4785142f555)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:47.884945 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437ef857-82fc-47b3-b549-b65d2afc5fc7 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:47.886979 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 131/268] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:14:47 2022] GET /identity/v3/projects/d47c3e61323f489c977cc4785142f555 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:47.892893 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b852f-0412-41e9-b8bc-74b62f6719fa None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:48.040694 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b852f-0412-41e9-b8bc-74b62f6719fa None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:48.081808 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a56b6f-46f7-4555-9267-8d851b56814e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:48.082454 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a56b6f-46f7-4555-9267-8d851b56814e None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:48.082741 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a56b6f-46f7-4555-9267-8d851b56814e None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:48.083023 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a56b6f-46f7-4555-9267-8d851b56814e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:48.083943 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a56b6f-46f7-4555-9267-8d851b56814e None admin] RBAC: Adding query filter params (role.id=3ad609555dec437d92e5c7291b1c939a, scope.project.id=d47c3e61323f489c977cc4785142f555, user.id=e08b3c894b23421aabdc51fe682d0738) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:48.084258 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a56b6f-46f7-4555-9267-8d851b56814e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:48.085713 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a56b6f-46f7-4555-9267-8d851b56814e None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:48.092506 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 138/269] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:14:47 2022] GET /identity/v3/role_assignments?user.id=e08b3c894b23421aabdc51fe682d0738&scope.project.id=d47c3e61323f489c977cc4785142f555&role.id=3ad609555dec437d92e5c7291b1c939a => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:48.192241 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7b4ae-805b-4f3b-b4b2-8aad05ae944a None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:48.192877 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7b4ae-805b-4f3b-b4b2-8aad05ae944a None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:48.193264 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013df9ce-1844-4993-9f2c-0a80f2db60f5 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:48.193562 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013df9ce-1844-4993-9f2c-0a80f2db60f5 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:48.193775 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7b4ae-805b-4f3b-b4b2-8aad05ae944a None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:48.193893 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013df9ce-1844-4993-9f2c-0a80f2db60f5 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:48.195894 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 139/270] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 19:14:48.196657 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 132/271] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:14:48.202519 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abec98-ebfa-423b-8bfa-94b95ef902aa None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:48.202807 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abec98-ebfa-423b-8bfa-94b95ef902aa None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:48.203091 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abec98-ebfa-423b-8bfa-94b95ef902aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:48.205719 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e3819-dcaa-4e44-ac31-1faa2b10ed4a None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:48.206008 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e3819-dcaa-4e44-ac31-1faa2b10ed4a None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:48.206286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e3819-dcaa-4e44-ac31-1faa2b10ed4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:48.240824 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-b8abec98-ebfa-423b-8bfa-94b95ef902aa None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:48.242972 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-b8abec98-ebfa-423b-8bfa-94b95ef902aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:48.245978 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-d34e3819-dcaa-4e44-ac31-1faa2b10ed4a None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:48.247175 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-d34e3819-dcaa-4e44-ac31-1faa2b10ed4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:48.286850 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:48.293920 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:48.342280 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 133/272] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:14:48.344872 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 140/273] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:14:48.368892 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8abec98-ebfa-423b-8bfa-94b95ef902aa None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:48.372307 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e3819-dcaa-4e44-ac31-1faa2b10ed4a None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:48.487901 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e3819-dcaa-4e44-ac31-1faa2b10ed4a None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:48.511752 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8abec98-ebfa-423b-8bfa-94b95ef902aa None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:48.531060 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28989d54-4fb4-4a8c-8e76-55ff50185e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:48.534147 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28989d54-4fb4-4a8c-8e76-55ff50185e1b None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:48.534659 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28989d54-4fb4-4a8c-8e76-55ff50185e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:48.535128 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28989d54-4fb4-4a8c-8e76-55ff50185e1b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:48.536730 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28989d54-4fb4-4a8c-8e76-55ff50185e1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:48.539415 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28989d54-4fb4-4a8c-8e76-55ff50185e1b None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:48.545519 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 141/274] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:14:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:14:48.547556 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28989d54-4fb4-4a8c-8e76-55ff50185e1b None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:48.556165 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2609c-d9b1-4a5e-ba10-c52faff7b33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:48.557322 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2609c-d9b1-4a5e-ba10-c52faff7b33f None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:48.557844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2609c-d9b1-4a5e-ba10-c52faff7b33f None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:48.558310 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2609c-d9b1-4a5e-ba10-c52faff7b33f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:48.570061 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e2609c-d9b1-4a5e-ba10-c52faff7b33f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:14:48.580055 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-96e2609c-d9b1-4a5e-ba10-c52faff7b33f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 19:14:48.580055 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:14:48.580055 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:14:48.580055 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:14:48.580055 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:14:48.580055 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:14:48.580055 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:14:48.580055 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:14:48.580055 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:14:48.580055 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:14:48.580055 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:14:48.580055 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:14:48.580055 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:14:48.580055 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:14:48.580055 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:14:48.580055 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:14:48.580995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:14:48.580995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:14:48.580995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:14:48.580995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:14:48.580995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:14:48.580995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:14:48.580995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:14:48.580995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:14:48.580995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:14:48.580995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:14:48.580995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:14:48.580995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:14:48.580995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:14:48.580995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:14:48.580995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:14:48.580995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:14:48.581783 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:14:48.581783 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:14:48.581783 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:14:48.581783 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:14:48.581783 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:14:48.581783 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:14:48.581783 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:14:48.581783 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:14:48.581783 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:14:48.581783 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:14:48.581783 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 19:14:48.581783 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:14:48.584600 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 134/275] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:14:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:14:48.587874 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:48.592691 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2609c-d9b1-4a5e-ba10-c52faff7b33f None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:48.623251 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:48.688785 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28989d54-4fb4-4a8c-8e76-55ff50185e1b None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:48.719679 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2609c-d9b1-4a5e-ba10-c52faff7b33f None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:48.725825 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188177ca-c1fa-4f04-a88b-d883413e9103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:48.727196 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188177ca-c1fa-4f04-a88b-d883413e9103 None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:48.727648 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188177ca-c1fa-4f04-a88b-d883413e9103 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:48.728063 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188177ca-c1fa-4f04-a88b-d883413e9103 None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:48.729035 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188177ca-c1fa-4f04-a88b-d883413e9103 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:48.730698 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188177ca-c1fa-4f04-a88b-d883413e9103 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:48.758877 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704af42-5ad0-4d22-8991-8abefe0582e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:48.759576 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704af42-5ad0-4d22-8991-8abefe0582e3 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:48.759865 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704af42-5ad0-4d22-8991-8abefe0582e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:48.760143 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704af42-5ad0-4d22-8991-8abefe0582e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:48.760886 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704af42-5ad0-4d22-8991-8abefe0582e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:48.761195 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704af42-5ad0-4d22-8991-8abefe0582e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:48.762575 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704af42-5ad0-4d22-8991-8abefe0582e3 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:48.771284 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 135/276] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Jul 21 19:14:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:48.776598 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704af42-5ad0-4d22-8991-8abefe0582e3 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:48.835479 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 142/277] 10.222.0.60 () {60 vars in 1132 bytes} [Thu Jul 21 19:14:48 2022] POST /identity/v3/users => generated 293 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:14:48.880480 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:48.896835 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704af42-5ad0-4d22-8991-8abefe0582e3 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:48.941799 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5734eec-3709-441f-a932-96d7c911c991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:48.943227 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5734eec-3709-441f-a932-96d7c911c991 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:48.943906 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5734eec-3709-441f-a932-96d7c911c991 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:48.944432 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5734eec-3709-441f-a932-96d7c911c991 None admin] PATH_INFO: `/v3/users/ffdc74a81274487381d4fbc73c5fe9b0` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:48.958220 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731980b-b4ba-4a99-a51c-b9f91bdd505d None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:48.958413 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731980b-b4ba-4a99-a51c-b9f91bdd505d None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:48.958642 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731980b-b4ba-4a99-a51c-b9f91bdd505d None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:48.960292 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 143/278] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 19:14:48.962123 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5734eec-3709-441f-a932-96d7c911c991 None admin] RBAC: Authorizing `identity:get_user(user_id=ffdc74a81274487381d4fbc73c5fe9b0)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:48.964068 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5734eec-3709-441f-a932-96d7c911c991 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:48.966395 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e23ae2-1fb6-4e2f-87bf-5e444b413e2b None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:48.966726 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e23ae2-1fb6-4e2f-87bf-5e444b413e2b None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:48.966986 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e23ae2-1fb6-4e2f-87bf-5e444b413e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:48.967344 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 136/279] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:14:48 2022] GET /identity/v3/users/ffdc74a81274487381d4fbc73c5fe9b0 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:14:48.972626 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5734eec-3709-441f-a932-96d7c911c991 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:48.990392 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-69e23ae2-1fb6-4e2f-87bf-5e444b413e2b None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:48.992035 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-69e23ae2-1fb6-4e2f-87bf-5e444b413e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:49.066836 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 144/280] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 19:14:49.084305 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5734eec-3709-441f-a932-96d7c911c991 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:49.091196 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e23ae2-1fb6-4e2f-87bf-5e444b413e2b None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:49.110864 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:49.130300 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd929f63-9653-4e34-87c0-aadcd6383008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:49.131285 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd929f63-9653-4e34-87c0-aadcd6383008 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:49.131553 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd929f63-9653-4e34-87c0-aadcd6383008 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:49.131836 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd929f63-9653-4e34-87c0-aadcd6383008 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:49.132804 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd929f63-9653-4e34-87c0-aadcd6383008 None admin] RBAC: Adding query filter params (role.id=0af30c087b3541a4847d708dd68464d6, user.id=ffdc74a81274487381d4fbc73c5fe9b0, scope.system=all) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:49.133195 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd929f63-9653-4e34-87c0-aadcd6383008 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:49.134703 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd929f63-9653-4e34-87c0-aadcd6383008 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:49.145622 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 137/281] 10.222.0.60 () {56 vars in 1308 bytes} [Thu Jul 21 19:14:48 2022] GET /identity/v3/role_assignments?user.id=ffdc74a81274487381d4fbc73c5fe9b0&scope.system=all&role.id=0af30c087b3541a4847d708dd68464d6 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:49.155042 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ab40c-9b2f-47a6-a296-739587fd5912 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:49.155342 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ab40c-9b2f-47a6-a296-739587fd5912 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:49.155633 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ab40c-9b2f-47a6-a296-739587fd5912 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:49.157348 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 138/282] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:14:49.163847 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebfd1b-4627-401b-aed0-0bdbd48b0dbf None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:49.164972 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebfd1b-4627-401b-aed0-0bdbd48b0dbf None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:49.165501 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebfd1b-4627-401b-aed0-0bdbd48b0dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:49.177694 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:49.185465 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-89ebfd1b-4627-401b-aed0-0bdbd48b0dbf None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:49.186720 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-89ebfd1b-4627-401b-aed0-0bdbd48b0dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:49.239274 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e23ae2-1fb6-4e2f-87bf-5e444b413e2b None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:49.282269 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0032822-bece-4fb9-b9d7-1e971cca3e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:49.282907 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 139/283] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 19:14:49.283360 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0032822-bece-4fb9-b9d7-1e971cca3e62 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:49.283360 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0032822-bece-4fb9-b9d7-1e971cca3e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:49.283571 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0032822-bece-4fb9-b9d7-1e971cca3e62 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:49.297509 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0032822-bece-4fb9-b9d7-1e971cca3e62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:14:49.305962 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-f0032822-bece-4fb9-b9d7-1e971cca3e62 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 19:14:49.305962 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:14:49.305962 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:14:49.305962 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:14:49.305962 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:14:49.305962 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:14:49.305962 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:14:49.305962 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:14:49.305962 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:14:49.305962 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:14:49.305962 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:14:49.305962 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:14:49.305962 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:14:49.305962 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:14:49.305962 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:14:49.305962 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:14:49.309511 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:14:49.309511 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:14:49.309511 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:14:49.309511 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:14:49.309511 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:14:49.309511 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:14:49.309511 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:14:49.309511 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:14:49.309511 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:14:49.309511 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:14:49.309511 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:14:49.309511 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:14:49.309511 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:14:49.309511 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:14:49.309511 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:14:49.309511 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:14:49.310328 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:14:49.310328 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:14:49.310328 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:14:49.310328 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:14:49.310328 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:14:49.310328 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:14:49.310328 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:14:49.310328 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:14:49.310328 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:14:49.310328 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:14:49.310328 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 19:14:49.310328 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:14:49.310328 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 145/284] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:14:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:14:49.311025 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ebfd1b-4627-401b-aed0-0bdbd48b0dbf None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:49.316755 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0032822-bece-4fb9-b9d7-1e971cca3e62 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:49.413805 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:49.435392 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ebfd1b-4627-401b-aed0-0bdbd48b0dbf None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:49.472658 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cdb074-bafc-4cfb-9373-b81fbbe778eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:49.473461 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cdb074-bafc-4cfb-9373-b81fbbe778eb None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:49.473747 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cdb074-bafc-4cfb-9373-b81fbbe778eb None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:49.474129 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cdb074-bafc-4cfb-9373-b81fbbe778eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:49.476913 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:49.485969 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cdb074-bafc-4cfb-9373-b81fbbe778eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:14:49.494848 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-e8cdb074-bafc-4cfb-9373-b81fbbe778eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 19:14:49.494848 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:14:49.494848 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:14:49.494848 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:14:49.494848 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:14:49.494848 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:14:49.494848 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:14:49.494848 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:14:49.494848 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:14:49.494848 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:14:49.494848 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:14:49.494848 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:14:49.494848 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:14:49.494848 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:14:49.494848 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:14:49.494848 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:14:49.495831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:14:49.495831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:14:49.495831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:14:49.495831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:14:49.495831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:14:49.495831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:14:49.495831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:14:49.495831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:14:49.495831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:14:49.495831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:14:49.495831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:14:49.495831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:14:49.495831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:14:49.495831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:14:49.495831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:14:49.495831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:14:49.496649 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:14:49.496649 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:14:49.496649 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:14:49.496649 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:14:49.496649 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:14:49.496649 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:14:49.496649 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:14:49.496649 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:14:49.496649 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:14:49.496649 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:14:49.496649 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 19:14:49.496649 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:14:49.497246 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 140/285] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:14:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:14:49.503230 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cdb074-bafc-4cfb-9373-b81fbbe778eb None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:49.505160 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0032822-bece-4fb9-b9d7-1e971cca3e62 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:49.612310 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd668d81-2a66-422b-b1be-d5278f7b6d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:49.613374 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd668d81-2a66-422b-b1be-d5278f7b6d39 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:49.613881 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd668d81-2a66-422b-b1be-d5278f7b6d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:49.614385 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd668d81-2a66-422b-b1be-d5278f7b6d39 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:49.615520 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd668d81-2a66-422b-b1be-d5278f7b6d39 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:49.616037 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd668d81-2a66-422b-b1be-d5278f7b6d39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:49.617949 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd668d81-2a66-422b-b1be-d5278f7b6d39 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:49.628479 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cdb074-bafc-4cfb-9373-b81fbbe778eb None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:49.638621 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 146/286] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Jul 21 19:14:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:14:49.639664 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd668d81-2a66-422b-b1be-d5278f7b6d39 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:49.684739 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e1eb7-41ca-4bc8-858b-af5ffb90b20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:49.685344 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e1eb7-41ca-4bc8-858b-af5ffb90b20e None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:49.685628 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e1eb7-41ca-4bc8-858b-af5ffb90b20e None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:49.685900 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e1eb7-41ca-4bc8-858b-af5ffb90b20e None admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:49.686653 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321e1eb7-41ca-4bc8-858b-af5ffb90b20e None admin] RBAC: Adding query filter params (name=member) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:49.686960 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321e1eb7-41ca-4bc8-858b-af5ffb90b20e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:49.688378 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321e1eb7-41ca-4bc8-858b-af5ffb90b20e None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:49.711674 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 141/287] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Jul 21 19:14:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:49.717337 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e1eb7-41ca-4bc8-858b-af5ffb90b20e None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:49.788533 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd668d81-2a66-422b-b1be-d5278f7b6d39 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:49.829991 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae4c1d6-4931-4b51-bcd0-c40cd57e5105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:49.830870 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4c1d6-4931-4b51-bcd0-c40cd57e5105 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:49.831150 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4c1d6-4931-4b51-bcd0-c40cd57e5105 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:49.831424 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4c1d6-4931-4b51-bcd0-c40cd57e5105 None admin] PATH_INFO: `/v3/users/7645c66412de4713a810c394ff0b8301` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:49.837610 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae4c1d6-4931-4b51-bcd0-c40cd57e5105 None admin] RBAC: Authorizing `identity:get_user(user_id=7645c66412de4713a810c394ff0b8301)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:49.839086 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae4c1d6-4931-4b51-bcd0-c40cd57e5105 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:49.840773 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 147/288] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:14:49 2022] GET /identity/v3/users/7645c66412de4713a810c394ff0b8301 => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:49.846749 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae4c1d6-4931-4b51-bcd0-c40cd57e5105 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:49.855805 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:49.868237 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:49.910003 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e1eb7-41ca-4bc8-858b-af5ffb90b20e None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:49.952443 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d6676-a273-4edf-9728-ba56874e5125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:49.953692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d6676-a273-4edf-9728-ba56874e5125 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:49.954072 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d6676-a273-4edf-9728-ba56874e5125 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:49.954516 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d6676-a273-4edf-9728-ba56874e5125 None admin] PATH_INFO: `/v3/users/00357edc3bc7442d8202042c70b1e518` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:49.959470 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d6676-a273-4edf-9728-ba56874e5125 None admin] RBAC: Authorizing `identity:get_user(user_id=00357edc3bc7442d8202042c70b1e518)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:49.959470 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d6676-a273-4edf-9728-ba56874e5125 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:49.961917 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 142/289] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:14:49 2022] GET /identity/v3/users/00357edc3bc7442d8202042c70b1e518 => generated 297 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:14:49.968019 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d6676-a273-4edf-9728-ba56874e5125 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:50.046065 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae4c1d6-4931-4b51-bcd0-c40cd57e5105 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:50.113456 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d6676-a273-4edf-9728-ba56874e5125 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:50.147178 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:50.152116 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf23be-d696-45e2-8646-398aeb99e35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:50.152780 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf23be-d696-45e2-8646-398aeb99e35a None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:50.153066 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf23be-d696-45e2-8646-398aeb99e35a None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:50.153344 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf23be-d696-45e2-8646-398aeb99e35a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:50.168151 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e5e22-a29e-45f4-89f1-3d5171fb7b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:50.169032 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e5e22-a29e-45f4-89f1-3d5171fb7b1b None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:50.169320 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e5e22-a29e-45f4-89f1-3d5171fb7b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:50.169601 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e5e22-a29e-45f4-89f1-3d5171fb7b1b None admin] PATH_INFO: `/v3/projects/d47c3e61323f489c977cc4785142f555` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:50.176157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e5e22-a29e-45f4-89f1-3d5171fb7b1b None admin] RBAC: Authorizing `identity:get_project(project_id=d47c3e61323f489c977cc4785142f555)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:50.177898 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e5e22-a29e-45f4-89f1-3d5171fb7b1b None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:50.180586 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 148/290] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:14:49 2022] GET /identity/v3/projects/d47c3e61323f489c977cc4785142f555 => generated 302 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:50.186007 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e5e22-a29e-45f4-89f1-3d5171fb7b1b None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:50.224852 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf23be-d696-45e2-8646-398aeb99e35a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:50.227322 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf23be-d696-45e2-8646-398aeb99e35a None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:50.346721 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 143/291] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:14:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 19:14:50.352600 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf23be-d696-45e2-8646-398aeb99e35a None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:50.389798 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:50.403831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:50.457629 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e5e22-a29e-45f4-89f1-3d5171fb7b1b None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:50.493242 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf23be-d696-45e2-8646-398aeb99e35a None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:50.529842 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53780541-9eb0-443d-be9b-a5bda3521eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:50.530718 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53780541-9eb0-443d-be9b-a5bda3521eff None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:50.531000 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53780541-9eb0-443d-be9b-a5bda3521eff None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:50.531274 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53780541-9eb0-443d-be9b-a5bda3521eff None admin] PATH_INFO: `/v3/projects/d47c3e61323f489c977cc4785142f555` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:50.532486 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53780541-9eb0-443d-be9b-a5bda3521eff None admin] RBAC: Authorizing `identity:get_project(project_id=d47c3e61323f489c977cc4785142f555)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:50.533924 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53780541-9eb0-443d-be9b-a5bda3521eff None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:50.535708 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 144/292] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:14:50 2022] GET /identity/v3/projects/d47c3e61323f489c977cc4785142f555 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:50.544480 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53780541-9eb0-443d-be9b-a5bda3521eff None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:50.563739 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a520a41-489a-4042-9a22-e4176ff07b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:50.564650 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a520a41-489a-4042-9a22-e4176ff07b37 None admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:50.564942 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a520a41-489a-4042-9a22-e4176ff07b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:50.565227 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a520a41-489a-4042-9a22-e4176ff07b37 None admin] PATH_INFO: `/v3/projects/d47c3e61323f489c977cc4785142f555/users/7645c66412de4713a810c394ff0b8301/roles/9d25a11a44b24a3eb36a9ecd8d89321d` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:50.567245 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a520a41-489a-4042-9a22-e4176ff07b37 None admin] RBAC: Authorizing `identity:create_grant(project_id=d47c3e61323f489c977cc4785142f555, user_id=7645c66412de4713a810c394ff0b8301, role_id=9d25a11a44b24a3eb36a9ecd8d89321d)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:50.568866 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a520a41-489a-4042-9a22-e4176ff07b37 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:50.644267 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 149/293] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Jul 21 19:14:50 2022] PUT /identity/v3/projects/d47c3e61323f489c977cc4785142f555/users/7645c66412de4713a810c394ff0b8301/roles/9d25a11a44b24a3eb36a9ecd8d89321d => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:14:50.674107 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:50.682755 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53780541-9eb0-443d-be9b-a5bda3521eff None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:50.719987 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cb891-1c3a-48d1-8724-7e27a4e0656f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:50.720667 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cb891-1c3a-48d1-8724-7e27a4e0656f None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:50.720956 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cb891-1c3a-48d1-8724-7e27a4e0656f None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:50.721236 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cb891-1c3a-48d1-8724-7e27a4e0656f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:50.722095 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44cb891-1c3a-48d1-8724-7e27a4e0656f None admin] RBAC: Adding query filter params (role.id=0af30c087b3541a4847d708dd68464d6, scope.project.id=d47c3e61323f489c977cc4785142f555, user.id=00357edc3bc7442d8202042c70b1e518) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:50.722412 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44cb891-1c3a-48d1-8724-7e27a4e0656f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:50.723904 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44cb891-1c3a-48d1-8724-7e27a4e0656f None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:50.731708 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 145/294] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:14:50 2022] GET /identity/v3/role_assignments?user.id=00357edc3bc7442d8202042c70b1e518&scope.project.id=d47c3e61323f489c977cc4785142f555&role.id=0af30c087b3541a4847d708dd68464d6 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:51.477247 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6dcdf-5952-466a-adb6-e2b052d6ab1a None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:51.477933 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6dcdf-5952-466a-adb6-e2b052d6ab1a None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:51.477933 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6dcdf-5952-466a-adb6-e2b052d6ab1a None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:51.479447 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 150/295] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:14:51.484736 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42e53a-68b1-4111-ab68-ea359fde117b None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:51.485156 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42e53a-68b1-4111-ab68-ea359fde117b None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:51.485330 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42e53a-68b1-4111-ab68-ea359fde117b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:51.500154 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79389373-a393-4ad4-b14a-60eed6f2312c None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:51.500472 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79389373-a393-4ad4-b14a-60eed6f2312c None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:51.500720 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79389373-a393-4ad4-b14a-60eed6f2312c None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:51.502333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 151/296] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:14:51.503791 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1df874-0202-441a-a2f7-6ee311fff367 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:51.503941 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-0c42e53a-68b1-4111-ab68-ea359fde117b None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:51.504301 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1df874-0202-441a-a2f7-6ee311fff367 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:51.504677 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1df874-0202-441a-a2f7-6ee311fff367 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:51.505113 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-0c42e53a-68b1-4111-ab68-ea359fde117b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:51.506298 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 152/297] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 19:14:51.509397 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f983b-6078-4d5c-87f5-0cd6d05629cf None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:51.509795 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f983b-6078-4d5c-87f5-0cd6d05629cf None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:51.510263 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f983b-6078-4d5c-87f5-0cd6d05629cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:51.526991 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-242f983b-6078-4d5c-87f5-0cd6d05629cf None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:51.528232 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-242f983b-6078-4d5c-87f5-0cd6d05629cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:51.581015 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 146/298] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:14:51.582726 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b0d55-9f3b-4fe1-b693-52b23ed9c986 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:51.583210 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b0d55-9f3b-4fe1-b693-52b23ed9c986 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:51.583731 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b0d55-9f3b-4fe1-b693-52b23ed9c986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:51.600770 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-683b0d55-9f3b-4fe1-b693-52b23ed9c986 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:51.603142 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-683b0d55-9f3b-4fe1-b693-52b23ed9c986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:51.611746 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 153/299] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 19:14:51.612663 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f983b-6078-4d5c-87f5-0cd6d05629cf None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:51.683561 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 147/300] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:14:51.683561 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b0d55-9f3b-4fe1-b693-52b23ed9c986 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:51.684767 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:51.706798 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:51.730120 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f983b-6078-4d5c-87f5-0cd6d05629cf None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:51.766726 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d4409-8361-4798-92f0-0d28b57b8647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:51.767577 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d4409-8361-4798-92f0-0d28b57b8647 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:51.767865 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d4409-8361-4798-92f0-0d28b57b8647 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:51.768141 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d4409-8361-4798-92f0-0d28b57b8647 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:51.778901 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919d4409-8361-4798-92f0-0d28b57b8647 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:14:51.786535 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-919d4409-8361-4798-92f0-0d28b57b8647 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 19:14:51.786535 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:14:51.786535 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:14:51.786535 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:14:51.786535 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:14:51.786535 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:14:51.786535 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:14:51.786535 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:14:51.786535 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:14:51.786535 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:14:51.786535 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:14:51.786535 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:14:51.786535 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:14:51.786535 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:14:51.786535 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:14:51.786535 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:14:51.787417 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:14:51.787417 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:14:51.787417 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:14:51.787417 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:14:51.787417 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:14:51.787417 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:14:51.787417 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:14:51.787417 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:14:51.787417 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:14:51.787417 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:14:51.787417 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:14:51.787417 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:14:51.787417 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:14:51.787417 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:14:51.787417 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:14:51.787417 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:14:51.792366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:14:51.792366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:14:51.792366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:14:51.792366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:14:51.792366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:14:51.792366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:14:51.792366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:14:51.792366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:14:51.792366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:14:51.792366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:14:51.792366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 19:14:51.792366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:14:51.792366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 154/301] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:14:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:14:51.792366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d4409-8361-4798-92f0-0d28b57b8647 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:51.796417 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b0d55-9f3b-4fe1-b693-52b23ed9c986 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:51.831017 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4feac92-7c04-4d4a-96d4-66f5c3113a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:51.831847 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4feac92-7c04-4d4a-96d4-66f5c3113a4f None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:51.832137 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4feac92-7c04-4d4a-96d4-66f5c3113a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:51.832413 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4feac92-7c04-4d4a-96d4-66f5c3113a4f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:51.844757 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4feac92-7c04-4d4a-96d4-66f5c3113a4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:14:51.852492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-f4feac92-7c04-4d4a-96d4-66f5c3113a4f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 19:14:51.852492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:14:51.852492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:14:51.852492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:14:51.852492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:14:51.852492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:14:51.852492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:14:51.852492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:14:51.852492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:14:51.852492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:14:51.852492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:14:51.852492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:14:51.852492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:14:51.852492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:14:51.852492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:14:51.852492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:14:51.853410 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:14:51.853410 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:14:51.853410 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:14:51.853410 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:14:51.853410 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:14:51.853410 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:14:51.853410 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:14:51.853410 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:14:51.853410 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:14:51.853410 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:14:51.853410 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:14:51.853410 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:14:51.853410 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:14:51.853410 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:14:51.853410 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:14:51.853410 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:14:51.854206 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:14:51.854206 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:14:51.854206 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:14:51.854206 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:14:51.854206 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:14:51.854206 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:14:51.854206 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:14:51.854206 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:14:51.854206 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:14:51.854206 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:14:51.854206 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 19:14:51.854206 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:14:51.854206 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 148/302] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:14:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:14:51.854850 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4feac92-7c04-4d4a-96d4-66f5c3113a4f None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:51.907686 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d4409-8361-4798-92f0-0d28b57b8647 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:51.932942 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:51.951662 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:51.951831 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac02642-6cf4-49b9-b9ae-bfdfffc79fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:51.951831 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac02642-6cf4-49b9-b9ae-bfdfffc79fbe None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:51.951831 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac02642-6cf4-49b9-b9ae-bfdfffc79fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:51.951831 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac02642-6cf4-49b9-b9ae-bfdfffc79fbe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:51.952110 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac02642-6cf4-49b9-b9ae-bfdfffc79fbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:51.952110 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac02642-6cf4-49b9-b9ae-bfdfffc79fbe None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:51.952110 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 155/303] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:14:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:51.955415 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac02642-6cf4-49b9-b9ae-bfdfffc79fbe None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:51.963805 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4feac92-7c04-4d4a-96d4-66f5c3113a4f None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:52.000715 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861eae15-619b-4177-afed-83b0821c3702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:52.001391 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861eae15-619b-4177-afed-83b0821c3702 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:52.001683 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861eae15-619b-4177-afed-83b0821c3702 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:52.001963 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861eae15-619b-4177-afed-83b0821c3702 None admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:52.002704 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861eae15-619b-4177-afed-83b0821c3702 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:52.003015 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861eae15-619b-4177-afed-83b0821c3702 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:52.004442 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861eae15-619b-4177-afed-83b0821c3702 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:52.017769 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 149/304] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Jul 21 19:14:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:52.017769 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861eae15-619b-4177-afed-83b0821c3702 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:52.068285 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac02642-6cf4-49b9-b9ae-bfdfffc79fbe None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:52.104025 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3720cca-1065-4fa9-abe2-eb6380558ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:52.104695 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3720cca-1065-4fa9-abe2-eb6380558ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:52.104980 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3720cca-1065-4fa9-abe2-eb6380558ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:52.105261 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3720cca-1065-4fa9-abe2-eb6380558ae3 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:52.106007 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3720cca-1065-4fa9-abe2-eb6380558ae3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:52.106315 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3720cca-1065-4fa9-abe2-eb6380558ae3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:52.107814 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3720cca-1065-4fa9-abe2-eb6380558ae3 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:52.116446 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 156/305] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Jul 21 19:14:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:52.117070 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3720cca-1065-4fa9-abe2-eb6380558ae3 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:52.130210 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861eae15-619b-4177-afed-83b0821c3702 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:52.167301 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3674b0f-6fe0-47ee-bc0a-c5f7b6bfae07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:52.168246 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3674b0f-6fe0-47ee-bc0a-c5f7b6bfae07 None admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:52.168727 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3674b0f-6fe0-47ee-bc0a-c5f7b6bfae07 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:52.169295 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3674b0f-6fe0-47ee-bc0a-c5f7b6bfae07 None admin] PATH_INFO: `/v3/groups` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:52.169987 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3674b0f-6fe0-47ee-bc0a-c5f7b6bfae07 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:52.171449 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3674b0f-6fe0-47ee-bc0a-c5f7b6bfae07 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:52.180340 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:52.224781 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3720cca-1065-4fa9-abe2-eb6380558ae3 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:52.262654 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d2331-1583-4808-9e90-b145f34dac1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:52.263563 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d2331-1583-4808-9e90-b145f34dac1f None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:52.263843 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d2331-1583-4808-9e90-b145f34dac1f None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:52.264119 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d2331-1583-4808-9e90-b145f34dac1f None admin] PATH_INFO: `/v3/users/076ddd50e3f44db9b62cb605ad6c5d8c` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:52.272368 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:52.287662 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 150/306] 10.222.0.60 () {60 vars in 1134 bytes} [Thu Jul 21 19:14:52 2022] POST /identity/v3/groups => generated 229 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:14:52.287662 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3674b0f-6fe0-47ee-bc0a-c5f7b6bfae07 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:52.289985 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d2331-1583-4808-9e90-b145f34dac1f None admin] RBAC: Authorizing `identity:get_user(user_id=076ddd50e3f44db9b62cb605ad6c5d8c)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:52.292296 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d2331-1583-4808-9e90-b145f34dac1f None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:52.294390 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 157/307] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:14:52 2022] GET /identity/v3/users/076ddd50e3f44db9b62cb605ad6c5d8c => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:52.301320 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d2331-1583-4808-9e90-b145f34dac1f None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:52.435871 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3674b0f-6fe0-47ee-bc0a-c5f7b6bfae07 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:52.453535 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d2331-1583-4808-9e90-b145f34dac1f None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:52.472042 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:52.478122 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b9bed-1241-4ee8-b8bd-90c253c0bbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:52.478962 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b9bed-1241-4ee8-b8bd-90c253c0bbd8 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:52.479232 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b9bed-1241-4ee8-b8bd-90c253c0bbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:52.479542 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b9bed-1241-4ee8-b8bd-90c253c0bbd8 None admin] PATH_INFO: `/v3/users/ffdc74a81274487381d4fbc73c5fe9b0` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:52.480841 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155b9bed-1241-4ee8-b8bd-90c253c0bbd8 None admin] RBAC: Authorizing `identity:get_user(user_id=ffdc74a81274487381d4fbc73c5fe9b0)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:52.482307 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155b9bed-1241-4ee8-b8bd-90c253c0bbd8 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:52.484010 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 151/308] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:14:52 2022] GET /identity/v3/users/ffdc74a81274487381d4fbc73c5fe9b0 => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:52.492216 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b9bed-1241-4ee8-b8bd-90c253c0bbd8 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:52.501439 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb72da-67fa-4a58-b6c8-024954f9064b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:52.502107 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb72da-67fa-4a58-b6c8-024954f9064b None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:52.502391 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb72da-67fa-4a58-b6c8-024954f9064b None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:52.502705 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb72da-67fa-4a58-b6c8-024954f9064b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:52.503550 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb72da-67fa-4a58-b6c8-024954f9064b None admin] RBAC: Adding query filter params (role.id=9d25a11a44b24a3eb36a9ecd8d89321d, user.id=076ddd50e3f44db9b62cb605ad6c5d8c, scope.system=all) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:52.504689 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb72da-67fa-4a58-b6c8-024954f9064b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:52.506013 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb72da-67fa-4a58-b6c8-024954f9064b None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:52.516725 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 158/309] 10.222.0.60 () {56 vars in 1308 bytes} [Thu Jul 21 19:14:52 2022] GET /identity/v3/role_assignments?user.id=076ddd50e3f44db9b62cb605ad6c5d8c&scope.system=all&role.id=9d25a11a44b24a3eb36a9ecd8d89321d => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:52.595839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:52.623132 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b9bed-1241-4ee8-b8bd-90c253c0bbd8 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:52.665378 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97afd40d-97da-411a-901c-3c40edc9304b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:52.666262 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97afd40d-97da-411a-901c-3c40edc9304b None admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:52.666541 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97afd40d-97da-411a-901c-3c40edc9304b None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:52.666813 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97afd40d-97da-411a-901c-3c40edc9304b None admin] PATH_INFO: `/v3/system/users/ffdc74a81274487381d4fbc73c5fe9b0/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:52.668553 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97afd40d-97da-411a-901c-3c40edc9304b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ffdc74a81274487381d4fbc73c5fe9b0, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:52.670224 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97afd40d-97da-411a-901c-3c40edc9304b None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:52.765804 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 152/310] 10.222.0.60 () {58 vars in 1334 bytes} [Thu Jul 21 19:14:52 2022] PUT /identity/v3/system/users/ffdc74a81274487381d4fbc73c5fe9b0/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:14:52.954541 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98cf30c-9b45-4e84-8081-c89e2c1912d7 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:52.954898 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98cf30c-9b45-4e84-8081-c89e2c1912d7 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:52.955112 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98cf30c-9b45-4e84-8081-c89e2c1912d7 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:52.956882 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 159/311] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:14:52.962530 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1154c-a19c-43f7-8d31-9a04395d0f5f None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:52.962821 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1154c-a19c-43f7-8d31-9a04395d0f5f None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:52.963099 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1154c-a19c-43f7-8d31-9a04395d0f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:52.981884 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-abe1154c-a19c-43f7-8d31-9a04395d0f5f None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:52.983069 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-abe1154c-a19c-43f7-8d31-9a04395d0f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:53.060571 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 153/312] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:14:53.083394 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98cf30c-9b45-4e84-8081-c89e2c1912d7 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:53.193593 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98cf30c-9b45-4e84-8081-c89e2c1912d7 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:53.230878 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e13430-b28e-4037-b997-9874523100ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:53.231703 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e13430-b28e-4037-b997-9874523100ed None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:53.232036 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e13430-b28e-4037-b997-9874523100ed None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:53.232345 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e13430-b28e-4037-b997-9874523100ed None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:53.244087 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e13430-b28e-4037-b997-9874523100ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:14:53.252117 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-64e13430-b28e-4037-b997-9874523100ed None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 19:14:53.252117 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:14:53.252117 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:14:53.252117 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:14:53.252117 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:14:53.252117 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:14:53.252117 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:14:53.252117 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:14:53.252117 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:14:53.252117 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:14:53.252117 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:14:53.252117 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:14:53.252117 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:14:53.252117 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:14:53.252117 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:14:53.252117 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:14:53.253232 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:14:53.253232 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:14:53.253232 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:14:53.253232 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:14:53.253232 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:14:53.253232 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:14:53.253232 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:14:53.253232 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:14:53.253232 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:14:53.253232 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:14:53.253232 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:14:53.253232 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:14:53.253232 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:14:53.253232 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:14:53.253232 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:14:53.253232 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:14:53.254228 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:14:53.254228 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:14:53.254228 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:14:53.254228 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:14:53.254228 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:14:53.254228 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:14:53.254228 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:14:53.254228 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:14:53.254228 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:14:53.254228 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:14:53.254228 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 19:14:53.254228 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:14:53.254228 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 160/313] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:14:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:14:53.261268 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe1154c-a19c-43f7-8d31-9a04395d0f5f None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:53.326047 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:53.365632 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe1154c-a19c-43f7-8d31-9a04395d0f5f None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:53.400168 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32f1ac-278f-432b-9af6-b794629a3147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:53.400841 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32f1ac-278f-432b-9af6-b794629a3147 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:53.401125 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32f1ac-278f-432b-9af6-b794629a3147 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:53.401406 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32f1ac-278f-432b-9af6-b794629a3147 None admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:53.402150 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c32f1ac-278f-432b-9af6-b794629a3147 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:53.402457 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c32f1ac-278f-432b-9af6-b794629a3147 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:53.403869 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c32f1ac-278f-432b-9af6-b794629a3147 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:53.412369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 154/314] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Jul 21 19:14:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:53.418315 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e13430-b28e-4037-b997-9874523100ed None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:53.464786 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:53.532843 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e13430-b28e-4037-b997-9874523100ed None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:53.568708 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bcca96-c996-459f-90be-622a4beaa75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:53.569574 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcca96-c996-459f-90be-622a4beaa75f None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:53.569856 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcca96-c996-459f-90be-622a4beaa75f None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:53.570167 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcca96-c996-459f-90be-622a4beaa75f None admin] PATH_INFO: `/v3/users/7645c66412de4713a810c394ff0b8301` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:53.571409 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bcca96-c996-459f-90be-622a4beaa75f None admin] RBAC: Authorizing `identity:get_user(user_id=7645c66412de4713a810c394ff0b8301)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:53.572980 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bcca96-c996-459f-90be-622a4beaa75f None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:53.574605 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 161/315] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:14:53 2022] GET /identity/v3/users/7645c66412de4713a810c394ff0b8301 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:53.580157 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32f1ac-278f-432b-9af6-b794629a3147 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:53.686195 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32f1ac-278f-432b-9af6-b794629a3147 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:53.710406 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:53.721714 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d124f80-4e4d-4cae-98e4-922032ef5626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:53.722668 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d124f80-4e4d-4cae-98e4-922032ef5626 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:53.723110 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d124f80-4e4d-4cae-98e4-922032ef5626 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:53.726207 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d124f80-4e4d-4cae-98e4-922032ef5626 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:53.795203 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d124f80-4e4d-4cae-98e4-922032ef5626 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:53.796956 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d124f80-4e4d-4cae-98e4-922032ef5626 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:53.896437 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 155/316] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:14:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 19:14:53.904487 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bcca96-c996-459f-90be-622a4beaa75f None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:54.014309 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bcca96-c996-459f-90be-622a4beaa75f None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:54.016682 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:54.049733 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfccc5-7981-47fc-859b-957a1b0cc376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:54.050906 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfccc5-7981-47fc-859b-957a1b0cc376 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:54.051192 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfccc5-7981-47fc-859b-957a1b0cc376 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:54.051487 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfccc5-7981-47fc-859b-957a1b0cc376 None admin] PATH_INFO: `/v3/projects/d47c3e61323f489c977cc4785142f555` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:54.052939 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbfccc5-7981-47fc-859b-957a1b0cc376 None admin] RBAC: Authorizing `identity:get_project(project_id=d47c3e61323f489c977cc4785142f555)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:54.054395 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbfccc5-7981-47fc-859b-957a1b0cc376 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:54.056557 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 162/317] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:14:53 2022] GET /identity/v3/projects/d47c3e61323f489c977cc4785142f555 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:54.061943 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d124f80-4e4d-4cae-98e4-922032ef5626 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:54.087127 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:54.166024 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d124f80-4e4d-4cae-98e4-922032ef5626 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:54.201137 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3adfc-392a-4be7-90d8-6aab08d05955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:54.202126 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3adfc-392a-4be7-90d8-6aab08d05955 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:54.202605 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3adfc-392a-4be7-90d8-6aab08d05955 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:54.203071 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3adfc-392a-4be7-90d8-6aab08d05955 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:54.204167 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3adfc-392a-4be7-90d8-6aab08d05955 None admin] RBAC: Adding query filter params (role.id=9d25a11a44b24a3eb36a9ecd8d89321d, scope.project.id=d47c3e61323f489c977cc4785142f555, user.id=7645c66412de4713a810c394ff0b8301) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:54.204678 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3adfc-392a-4be7-90d8-6aab08d05955 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:54.206335 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3adfc-392a-4be7-90d8-6aab08d05955 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:54.213661 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 156/318] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:14:54 2022] GET /identity/v3/role_assignments?user.id=7645c66412de4713a810c394ff0b8301&scope.project.id=d47c3e61323f489c977cc4785142f555&role.id=9d25a11a44b24a3eb36a9ecd8d89321d => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:54.584225 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a423ee2-9289-469c-9b14-a865df5630bc None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:54.584733 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a423ee2-9289-469c-9b14-a865df5630bc None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:54.584833 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a423ee2-9289-469c-9b14-a865df5630bc None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:54.586333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 163/319] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:14:54.591272 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606727a6-fc9c-4999-bf67-870eacd67f03 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:54.591692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606727a6-fc9c-4999-bf67-870eacd67f03 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:54.591881 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606727a6-fc9c-4999-bf67-870eacd67f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:54.609611 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-606727a6-fc9c-4999-bf67-870eacd67f03 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:54.610801 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-606727a6-fc9c-4999-bf67-870eacd67f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:54.678139 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 157/320] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:14:54.701186 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a423ee2-9289-469c-9b14-a865df5630bc None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:54.723108 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a27941-aed6-46a5-b177-d8eee016d313 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:54.723403 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a27941-aed6-46a5-b177-d8eee016d313 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:54.723773 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a27941-aed6-46a5-b177-d8eee016d313 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:54.725366 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 158/321] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 19:14:54.730478 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46832a3-5733-4c3f-a373-92effe44a58e None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:54.730773 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46832a3-5733-4c3f-a373-92effe44a58e None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:54.731059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46832a3-5733-4c3f-a373-92effe44a58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:54.748312 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-a46832a3-5733-4c3f-a373-92effe44a58e None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:54.749497 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-a46832a3-5733-4c3f-a373-92effe44a58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:54.763100 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:54.814129 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a423ee2-9289-469c-9b14-a865df5630bc None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:54.820241 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 159/322] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:14:54.842288 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46832a3-5733-4c3f-a373-92effe44a58e None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:54.850388 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc273ab-5ddb-4eeb-a7ba-e6f9842390d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:54.851849 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc273ab-5ddb-4eeb-a7ba-e6f9842390d5 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:54.852303 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc273ab-5ddb-4eeb-a7ba-e6f9842390d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:54.852589 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc273ab-5ddb-4eeb-a7ba-e6f9842390d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:54.853942 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc273ab-5ddb-4eeb-a7ba-e6f9842390d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:54.855623 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc273ab-5ddb-4eeb-a7ba-e6f9842390d5 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:54.857458 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 164/323] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:14:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:54.862553 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc273ab-5ddb-4eeb-a7ba-e6f9842390d5 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:54.906130 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:54.953108 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46832a3-5733-4c3f-a373-92effe44a58e None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:54.966402 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc273ab-5ddb-4eeb-a7ba-e6f9842390d5 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:54.986258 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d81380-a46e-429b-873e-5920568d4d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:54.987049 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d81380-a46e-429b-873e-5920568d4d1b None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:54.987333 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d81380-a46e-429b-873e-5920568d4d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:54.987634 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d81380-a46e-429b-873e-5920568d4d1b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:54.997303 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d81380-a46e-429b-873e-5920568d4d1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:14:54.999515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032e179-de84-4dde-b237-4d45f67171b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:55.000181 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032e179-de84-4dde-b237-4d45f67171b9 None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:55.000468 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032e179-de84-4dde-b237-4d45f67171b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:55.000747 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032e179-de84-4dde-b237-4d45f67171b9 None admin] PATH_INFO: `/v3/groups` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:55.001489 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c032e179-de84-4dde-b237-4d45f67171b9 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:55.002939 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c032e179-de84-4dde-b237-4d45f67171b9 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:55.004927 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-79d81380-a46e-429b-873e-5920568d4d1b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 19:14:55.004927 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:14:55.004927 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:14:55.004927 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:14:55.004927 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:14:55.004927 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:14:55.004927 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:14:55.004927 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:14:55.004927 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:14:55.004927 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:14:55.004927 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:14:55.004927 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:14:55.004927 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:14:55.004927 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:14:55.004927 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:14:55.004927 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:14:55.005851 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:14:55.005851 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:14:55.005851 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:14:55.005851 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:14:55.005851 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:14:55.005851 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:14:55.005851 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:14:55.005851 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:14:55.005851 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:14:55.005851 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:14:55.005851 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:14:55.005851 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:14:55.005851 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:14:55.005851 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:14:55.005851 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:14:55.005851 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:14:55.006639 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:14:55.006639 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:14:55.006639 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:14:55.006639 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:14:55.006639 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:14:55.006639 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:14:55.006639 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:14:55.006639 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:14:55.006639 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:14:55.006639 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:14:55.006639 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 19:14:55.006639 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:14:55.006639 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 160/324] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:14:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:14:55.007640 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5cf62b-6379-4509-9199-d50ae10ea213 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:55.007925 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5cf62b-6379-4509-9199-d50ae10ea213 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:55.008201 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5cf62b-6379-4509-9199-d50ae10ea213 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:55.009442 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 161/325] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:14:55.012233 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5cf62b-6379-4509-9199-d50ae10ea213 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:55.022965 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:55.109931 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5cf62b-6379-4509-9199-d50ae10ea213 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:55.112693 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 165/326] 10.222.0.60 () {60 vars in 1134 bytes} [Thu Jul 21 19:14:54 2022] POST /identity/v3/groups => generated 226 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 19:14:55.113945 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ad1bd-d29b-4318-b785-f6f9a293eb16 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:55.114236 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ad1bd-d29b-4318-b785-f6f9a293eb16 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:55.114515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ad1bd-d29b-4318-b785-f6f9a293eb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:55.132417 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-091ad1bd-d29b-4318-b785-f6f9a293eb16 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:55.133670 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-091ad1bd-d29b-4318-b785-f6f9a293eb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:55.150144 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92d972-8c0c-499c-bb18-41da25896e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:55.150842 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92d972-8c0c-499c-bb18-41da25896e7a None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:55.151129 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92d972-8c0c-499c-bb18-41da25896e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:55.151409 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92d972-8c0c-499c-bb18-41da25896e7a None admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:55.152207 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92d972-8c0c-499c-bb18-41da25896e7a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:55.152516 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92d972-8c0c-499c-bb18-41da25896e7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:55.153934 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92d972-8c0c-499c-bb18-41da25896e7a None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:55.162845 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 162/327] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Jul 21 19:14:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:14:55.169504 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92d972-8c0c-499c-bb18-41da25896e7a None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:55.220195 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 166/328] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:14:55.245406 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ad1bd-d29b-4318-b785-f6f9a293eb16 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:55.258977 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:55.279396 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:55.299546 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92d972-8c0c-499c-bb18-41da25896e7a None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:55.335899 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f4fedd-c0ba-4ef0-911b-c911269f10f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:55.337619 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4fedd-c0ba-4ef0-911b-c911269f10f8 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:55.337902 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4fedd-c0ba-4ef0-911b-c911269f10f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:55.338181 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4fedd-c0ba-4ef0-911b-c911269f10f8 None admin] PATH_INFO: `/v3/users/076ddd50e3f44db9b62cb605ad6c5d8c` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:55.341419 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f4fedd-c0ba-4ef0-911b-c911269f10f8 None admin] RBAC: Authorizing `identity:get_user(user_id=076ddd50e3f44db9b62cb605ad6c5d8c)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:55.341979 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f4fedd-c0ba-4ef0-911b-c911269f10f8 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:55.343838 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 163/329] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:14:55 2022] GET /identity/v3/users/076ddd50e3f44db9b62cb605ad6c5d8c => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:55.349400 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f4fedd-c0ba-4ef0-911b-c911269f10f8 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:55.365104 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ad1bd-d29b-4318-b785-f6f9a293eb16 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:55.408441 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edaf264-cf53-4faa-92ed-fcd071eb6a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:55.409689 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edaf264-cf53-4faa-92ed-fcd071eb6a9f None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:55.409689 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edaf264-cf53-4faa-92ed-fcd071eb6a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:55.409946 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edaf264-cf53-4faa-92ed-fcd071eb6a9f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:55.428066 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edaf264-cf53-4faa-92ed-fcd071eb6a9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:14:55.439002 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-6edaf264-cf53-4faa-92ed-fcd071eb6a9f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 19:14:55.439002 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:14:55.439002 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:14:55.439002 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:14:55.439002 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:14:55.439002 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:14:55.439002 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:14:55.439002 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:14:55.439002 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:14:55.439002 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:14:55.439002 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:14:55.439002 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:14:55.439002 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:14:55.439002 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:14:55.439002 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:14:55.439002 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:14:55.440046 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:14:55.440046 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:14:55.440046 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:14:55.440046 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:14:55.440046 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:14:55.440046 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:14:55.440046 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:14:55.440046 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:14:55.440046 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:14:55.440046 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:14:55.440046 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:14:55.440046 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:14:55.440046 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:14:55.440046 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:14:55.440046 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:14:55.440046 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:14:55.440834 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:14:55.440834 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:14:55.440834 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:14:55.440834 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:14:55.440834 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:14:55.440834 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:14:55.440834 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:14:55.440834 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:14:55.440834 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:14:55.440834 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:14:55.440834 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 19:14:55.440834 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:14:55.440834 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 167/330] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:14:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:14:55.446890 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edaf264-cf53-4faa-92ed-fcd071eb6a9f None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:55.489539 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f4fedd-c0ba-4ef0-911b-c911269f10f8 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:55.531942 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6380863-7620-467c-8f37-076f1c9a5829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:55.533071 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6380863-7620-467c-8f37-076f1c9a5829 None admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:55.533357 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6380863-7620-467c-8f37-076f1c9a5829 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:55.533638 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6380863-7620-467c-8f37-076f1c9a5829 None admin] PATH_INFO: `/v3/system/users/076ddd50e3f44db9b62cb605ad6c5d8c/roles/9d25a11a44b24a3eb36a9ecd8d89321d` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:55.535997 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6380863-7620-467c-8f37-076f1c9a5829 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=076ddd50e3f44db9b62cb605ad6c5d8c, role_id=9d25a11a44b24a3eb36a9ecd8d89321d)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:55.537380 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6380863-7620-467c-8f37-076f1c9a5829 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:55.568426 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:55.580108 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edaf264-cf53-4faa-92ed-fcd071eb6a9f None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:55.616162 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f0e345-1ea8-4671-9ce3-468bc898a0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:55.616958 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0e345-1ea8-4671-9ce3-468bc898a0e6 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:55.617204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0e345-1ea8-4671-9ce3-468bc898a0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:55.617425 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0e345-1ea8-4671-9ce3-468bc898a0e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:55.618507 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f0e345-1ea8-4671-9ce3-468bc898a0e6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:55.619833 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f0e345-1ea8-4671-9ce3-468bc898a0e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:55.620187 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 164/331] 10.222.0.60 () {58 vars in 1334 bytes} [Thu Jul 21 19:14:55 2022] PUT /identity/v3/system/users/076ddd50e3f44db9b62cb605ad6c5d8c/roles/9d25a11a44b24a3eb36a9ecd8d89321d => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:14:55.620560 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f0e345-1ea8-4671-9ce3-468bc898a0e6 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:55.631504 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 168/332] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Jul 21 19:14:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:14:55.639930 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6380863-7620-467c-8f37-076f1c9a5829 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:55.642688 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:55.768182 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6380863-7620-467c-8f37-076f1c9a5829 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:55.811626 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9a20fd-73be-4abe-81bc-901d799b8b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:55.812825 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a20fd-73be-4abe-81bc-901d799b8b5e None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:55.813289 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a20fd-73be-4abe-81bc-901d799b8b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:55.813770 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a20fd-73be-4abe-81bc-901d799b8b5e None admin] PATH_INFO: `/v3/users/ffdc74a81274487381d4fbc73c5fe9b0` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:55.815284 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9a20fd-73be-4abe-81bc-901d799b8b5e None admin] RBAC: Authorizing `identity:get_user(user_id=ffdc74a81274487381d4fbc73c5fe9b0)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:55.817072 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9a20fd-73be-4abe-81bc-901d799b8b5e None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:55.819309 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 165/333] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:14:55 2022] GET /identity/v3/users/ffdc74a81274487381d4fbc73c5fe9b0 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:55.825388 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f0e345-1ea8-4671-9ce3-468bc898a0e6 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:55.934717 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f0e345-1ea8-4671-9ce3-468bc898a0e6 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:55.972574 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5feb652-4178-4b3b-9019-cde245cd8b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:55.973555 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5feb652-4178-4b3b-9019-cde245cd8b0c None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:55.974028 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5feb652-4178-4b3b-9019-cde245cd8b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:55.974515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5feb652-4178-4b3b-9019-cde245cd8b0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:55.975573 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5feb652-4178-4b3b-9019-cde245cd8b0c None admin] RBAC: Adding query filter params (role.id=0af30c087b3541a4847d708dd68464d6, user.id=ffdc74a81274487381d4fbc73c5fe9b0, scope.system=all) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:55.976078 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5feb652-4178-4b3b-9019-cde245cd8b0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:55.977900 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5feb652-4178-4b3b-9019-cde245cd8b0c None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:55.991231 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 169/334] 10.222.0.60 () {56 vars in 1308 bytes} [Thu Jul 21 19:14:55 2022] GET /identity/v3/role_assignments?user.id=ffdc74a81274487381d4fbc73c5fe9b0&scope.system=all&role.id=0af30c087b3541a4847d708dd68464d6 => generated 510 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:57.680751 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da25d8-d99c-429a-b9ef-41e15f355a08 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:57.681254 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da25d8-d99c-429a-b9ef-41e15f355a08 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:57.681338 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da25d8-d99c-429a-b9ef-41e15f355a08 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:57.683005 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 166/335] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:14:57.688244 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c52c0-ada7-45e0-a2b4-4f554f21264c None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:57.688659 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c52c0-ada7-45e0-a2b4-4f554f21264c None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:57.688893 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c52c0-ada7-45e0-a2b4-4f554f21264c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:57.706809 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-474c52c0-ada7-45e0-a2b4-4f554f21264c None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:57.708064 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-474c52c0-ada7-45e0-a2b4-4f554f21264c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:57.711772 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:57.792942 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 170/336] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:14:57.824676 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da25d8-d99c-429a-b9ef-41e15f355a08 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:57.910076 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:57.944786 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da25d8-d99c-429a-b9ef-41e15f355a08 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:57.984683 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0e268-bbb7-437c-93b4-d7c6c6df25cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:57.985772 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0e268-bbb7-437c-93b4-d7c6c6df25cd None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:57.986223 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0e268-bbb7-437c-93b4-d7c6c6df25cd None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:57.986665 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0e268-bbb7-437c-93b4-d7c6c6df25cd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:58.003143 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb0e268-bbb7-437c-93b4-d7c6c6df25cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:14:58.012237 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-8fb0e268-bbb7-437c-93b4-d7c6c6df25cd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 19:14:58.012237 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:14:58.012237 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:14:58.012237 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:14:58.012237 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:14:58.012237 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:14:58.012237 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:14:58.012237 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:14:58.012237 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:14:58.012237 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:14:58.012237 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:14:58.012237 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:14:58.012237 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:14:58.012237 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:14:58.012237 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:14:58.012237 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:14:58.013443 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:14:58.013443 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:14:58.013443 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:14:58.013443 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:14:58.013443 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:14:58.013443 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:14:58.013443 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:14:58.013443 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:14:58.013443 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:14:58.013443 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:14:58.013443 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:14:58.013443 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:14:58.013443 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:14:58.013443 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:14:58.013443 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:14:58.013443 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:14:58.014509 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:14:58.014509 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:14:58.014509 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:14:58.014509 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:14:58.014509 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:14:58.014509 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:14:58.014509 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:14:58.014509 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:14:58.014509 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:14:58.014509 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:14:58.014509 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 19:14:58.014509 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:14:58.016971 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 167/337] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:14:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:14:58.022374 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c52c0-ada7-45e0-a2b4-4f554f21264c None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:58.144828 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c52c0-ada7-45e0-a2b4-4f554f21264c None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:58.195617 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd2a02-6c31-4777-a9c4-533b6d0dd17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:58.196576 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd2a02-6c31-4777-a9c4-533b6d0dd17d None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:58.196866 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd2a02-6c31-4777-a9c4-533b6d0dd17d None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:58.197130 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd2a02-6c31-4777-a9c4-533b6d0dd17d None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:58.197894 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd2a02-6c31-4777-a9c4-533b6d0dd17d None admin] RBAC: Adding query filter params (name=member) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:58.198205 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd2a02-6c31-4777-a9c4-533b6d0dd17d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:58.199657 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd2a02-6c31-4777-a9c4-533b6d0dd17d None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:58.215161 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 171/338] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Jul 21 19:14:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:58.220966 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0e268-bbb7-437c-93b4-d7c6c6df25cd None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:58.367528 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0e268-bbb7-437c-93b4-d7c6c6df25cd None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:58.404545 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:58.413466 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6fab8b-4eff-4df2-a0ca-019cfb97e677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:58.414884 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fab8b-4eff-4df2-a0ca-019cfb97e677 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:58.415170 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fab8b-4eff-4df2-a0ca-019cfb97e677 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:58.415463 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fab8b-4eff-4df2-a0ca-019cfb97e677 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:58.481546 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7c9e8-e415-4947-a669-eeabc3d11858 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:58.481847 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7c9e8-e415-4947-a669-eeabc3d11858 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:58.482010 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7c9e8-e415-4947-a669-eeabc3d11858 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:58.483647 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 172/339] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:14:58.488835 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41329923-2aca-4248-aad0-cfe0262c27e4 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:58.489125 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41329923-2aca-4248-aad0-cfe0262c27e4 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:58.489405 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41329923-2aca-4248-aad0-cfe0262c27e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:58.498214 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6fab8b-4eff-4df2-a0ca-019cfb97e677 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:58.499729 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6fab8b-4eff-4df2-a0ca-019cfb97e677 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:58.506524 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:58.540521 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-41329923-2aca-4248-aad0-cfe0262c27e4 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:58.541721 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-41329923-2aca-4248-aad0-cfe0262c27e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:58.617594 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 168/340] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:14:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 19:14:58.618942 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca025a0b-cbc1-4af1-a7ee-1e63bd5fe344 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:58.619233 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca025a0b-cbc1-4af1-a7ee-1e63bd5fe344 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:58.619536 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca025a0b-cbc1-4af1-a7ee-1e63bd5fe344 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:58.621039 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 169/341] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:14:58.622104 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eabe70-1047-428d-bd1b-8e65713a8bf7 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:58.622393 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eabe70-1047-428d-bd1b-8e65713a8bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:58.622670 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eabe70-1047-428d-bd1b-8e65713a8bf7 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:58.629346 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 170/342] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:14:58.629346 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eabe70-1047-428d-bd1b-8e65713a8bf7 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:58.636575 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 173/343] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 19:14:58.638027 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b970e-89a0-4872-bf91-9e6050dd17e6 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:58.638324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b970e-89a0-4872-bf91-9e6050dd17e6 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:58.638606 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b970e-89a0-4872-bf91-9e6050dd17e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:58.655573 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-a74b970e-89a0-4872-bf91-9e6050dd17e6 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:58.656928 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-a74b970e-89a0-4872-bf91-9e6050dd17e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:58.667068 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:58.748975 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 174/344] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:14:58.750876 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87658e-5d34-4727-80ad-6931c9e01c0b None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:58.751308 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87658e-5d34-4727-80ad-6931c9e01c0b None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:58.751767 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87658e-5d34-4727-80ad-6931c9e01c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:58.758921 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eabe70-1047-428d-bd1b-8e65713a8bf7 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:58.770198 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-ab87658e-5d34-4727-80ad-6931c9e01c0b None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:14:58.772386 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ab87658e-5d34-4727-80ad-6931c9e01c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:14:58.801457 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9104c-03d0-456f-b215-aeda27df740a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:58.802593 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9104c-03d0-456f-b215-aeda27df740a None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:58.802882 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9104c-03d0-456f-b215-aeda27df740a None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:58.803157 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9104c-03d0-456f-b215-aeda27df740a None admin] PATH_INFO: `/v3/projects/0180b37d7e6843eaa90e0d081ade9da8` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:58.805192 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b9104c-03d0-456f-b215-aeda27df740a None admin] RBAC: Authorizing `identity:get_project(project_id=0180b37d7e6843eaa90e0d081ade9da8)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:58.806858 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b9104c-03d0-456f-b215-aeda27df740a None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:58.811492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 171/345] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:14:58 2022] GET /identity/v3/projects/0180b37d7e6843eaa90e0d081ade9da8 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:58.811492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9104c-03d0-456f-b215-aeda27df740a None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:58.852308 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:58.860883 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 175/346] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:14:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:14:58.868679 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87658e-5d34-4727-80ad-6931c9e01c0b None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:58.953793 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:58.958180 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9104c-03d0-456f-b215-aeda27df740a None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:59.001545 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a25d27-4e8b-4f07-a3c1-759779b6d94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:59.002722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a25d27-4e8b-4f07-a3c1-759779b6d94d None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:59.003169 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a25d27-4e8b-4f07-a3c1-759779b6d94d None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:59.003817 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a25d27-4e8b-4f07-a3c1-759779b6d94d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:59.009121 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87658e-5d34-4727-80ad-6931c9e01c0b None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:59.017162 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a25d27-4e8b-4f07-a3c1-759779b6d94d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:14:59.029771 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-d0a25d27-4e8b-4f07-a3c1-759779b6d94d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 19:14:59.029771 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:14:59.029771 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:14:59.029771 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:14:59.029771 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:14:59.029771 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:14:59.029771 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:14:59.029771 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:14:59.029771 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:14:59.029771 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:14:59.029771 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:14:59.029771 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:14:59.029771 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:14:59.029771 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:14:59.029771 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:14:59.029771 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:14:59.030874 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:14:59.030874 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:14:59.030874 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:14:59.030874 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:14:59.030874 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:14:59.030874 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:14:59.030874 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:14:59.030874 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:14:59.030874 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:14:59.030874 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:14:59.030874 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:14:59.030874 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:14:59.030874 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:14:59.030874 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:14:59.030874 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:14:59.030874 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:14:59.031692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:14:59.031692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:14:59.031692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:14:59.031692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:14:59.031692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:14:59.031692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:14:59.031692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:14:59.031692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:14:59.031692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:14:59.031692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:14:59.031692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 19:14:59.031692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:14:59.031692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 172/347] 10.222.0.60 () {56 vars in 1114 bytes} [Thu Jul 21 19:14:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:14:59.032375 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a25d27-4e8b-4f07-a3c1-759779b6d94d None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:59.061687 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515db667-3e86-46bf-acb2-aa3abcc58554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:59.062505 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515db667-3e86-46bf-acb2-aa3abcc58554 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:59.062791 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515db667-3e86-46bf-acb2-aa3abcc58554 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:59.063071 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515db667-3e86-46bf-acb2-aa3abcc58554 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:59.078501 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515db667-3e86-46bf-acb2-aa3abcc58554 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:14:59.087469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-515db667-3e86-46bf-acb2-aa3abcc58554 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 19:14:59.087469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:14:59.087469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:14:59.087469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:14:59.087469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:14:59.087469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:14:59.087469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:14:59.087469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:14:59.087469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:14:59.087469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:14:59.087469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:14:59.087469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:14:59.087469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:14:59.087469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:14:59.087469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:14:59.087469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:14:59.088383 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:14:59.088383 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:14:59.088383 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:14:59.088383 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:14:59.088383 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:14:59.088383 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:14:59.088383 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:14:59.088383 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:14:59.088383 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:14:59.088383 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:14:59.088383 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:14:59.088383 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:14:59.088383 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:14:59.088383 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:14:59.088383 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:14:59.088383 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:14:59.089184 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:14:59.089184 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:14:59.089184 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:14:59.089184 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:14:59.089184 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:14:59.089184 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:14:59.089184 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:14:59.089184 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:14:59.089184 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:14:59.089184 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:14:59.089184 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 19:14:59.089184 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:14:59.089184 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 176/348] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:14:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:14:59.089914 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515db667-3e86-46bf-acb2-aa3abcc58554 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:59.156080 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:59.178099 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a25d27-4e8b-4f07-a3c1-759779b6d94d None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:59.222058 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c65fd-f817-46e0-b651-67a68be30037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:59.222860 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515db667-3e86-46bf-acb2-aa3abcc58554 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:59.222986 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c65fd-f817-46e0-b651-67a68be30037 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:59.223279 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c65fd-f817-46e0-b651-67a68be30037 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:59.223631 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c65fd-f817-46e0-b651-67a68be30037 None admin] PATH_INFO: `/v3/groups/90fb1786a57043fd8943c5ea162b9294` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:59.233119 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c65fd-f817-46e0-b651-67a68be30037 None admin] RBAC: Authorizing `identity:get_group(group_id=90fb1786a57043fd8943c5ea162b9294)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:59.234771 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c65fd-f817-46e0-b651-67a68be30037 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:59.236945 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 173/349] 10.222.0.60 () {56 vars in 1180 bytes} [Thu Jul 21 19:14:59 2022] GET /identity/v3/groups/90fb1786a57043fd8943c5ea162b9294 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:59.243218 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c65fd-f817-46e0-b651-67a68be30037 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:59.266927 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979dc003-679d-45ca-9695-6e9cb14a869a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:59.267725 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979dc003-679d-45ca-9695-6e9cb14a869a None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:59.268057 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979dc003-679d-45ca-9695-6e9cb14a869a None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:59.268339 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979dc003-679d-45ca-9695-6e9cb14a869a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:59.274688 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:59.280023 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979dc003-679d-45ca-9695-6e9cb14a869a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:14:59.289412 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-979dc003-679d-45ca-9695-6e9cb14a869a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 19:14:59.289412 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:14:59.289412 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:14:59.289412 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:14:59.289412 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:14:59.289412 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:14:59.289412 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:14:59.289412 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:14:59.289412 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:14:59.289412 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:14:59.289412 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:14:59.289412 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:14:59.289412 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:14:59.289412 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:14:59.289412 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:14:59.289412 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:14:59.299786 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:14:59.299786 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:14:59.299786 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:14:59.299786 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:14:59.299786 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:14:59.299786 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:14:59.299786 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:14:59.299786 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:14:59.299786 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:14:59.299786 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:14:59.299786 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:14:59.299786 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:14:59.299786 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:14:59.299786 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:14:59.299786 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:14:59.299786 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:14:59.300562 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:14:59.300562 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:14:59.300562 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:14:59.300562 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:14:59.300562 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:14:59.300562 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:14:59.300562 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:14:59.300562 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:14:59.300562 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:14:59.300562 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:14:59.300562 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 19:14:59.300562 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:14:59.300562 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 177/350] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:14:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:14:59.300562 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979dc003-679d-45ca-9695-6e9cb14a869a None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:59.381925 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c65fd-f817-46e0-b651-67a68be30037 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:59.428347 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311ec43-fbda-4df0-8df7-0c6c49cb11f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:59.429040 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311ec43-fbda-4df0-8df7-0c6c49cb11f0 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:59.431106 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311ec43-fbda-4df0-8df7-0c6c49cb11f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:59.431106 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311ec43-fbda-4df0-8df7-0c6c49cb11f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:59.431106 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7311ec43-fbda-4df0-8df7-0c6c49cb11f0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:59.431467 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7311ec43-fbda-4df0-8df7-0c6c49cb11f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:59.433224 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7311ec43-fbda-4df0-8df7-0c6c49cb11f0 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:59.438761 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979dc003-679d-45ca-9695-6e9cb14a869a None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:59.444370 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 174/351] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:14:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:59.445637 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311ec43-fbda-4df0-8df7-0c6c49cb11f0 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:59.458452 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:59.484823 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1427d-9f42-44b9-be86-dc5915fae837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:59.485922 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1427d-9f42-44b9-be86-dc5915fae837 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:59.486513 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1427d-9f42-44b9-be86-dc5915fae837 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:59.486994 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1427d-9f42-44b9-be86-dc5915fae837 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:59.487991 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c1427d-9f42-44b9-be86-dc5915fae837 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:59.488515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c1427d-9f42-44b9-be86-dc5915fae837 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:59.490214 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c1427d-9f42-44b9-be86-dc5915fae837 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:59.505262 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 178/352] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Jul 21 19:14:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:59.506654 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1427d-9f42-44b9-be86-dc5915fae837 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:59.550797 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:59.571278 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311ec43-fbda-4df0-8df7-0c6c49cb11f0 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:59.623102 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c122f-1aea-48a9-966d-b4994ca4eabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:59.624438 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c122f-1aea-48a9-966d-b4994ca4eabe None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:59.624438 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c122f-1aea-48a9-966d-b4994ca4eabe None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:59.624622 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c122f-1aea-48a9-966d-b4994ca4eabe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:59.626099 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c122f-1aea-48a9-966d-b4994ca4eabe None admin] RBAC: Adding query filter params (group.id=90fb1786a57043fd8943c5ea162b9294, role.id=0af30c087b3541a4847d708dd68464d6, scope.project.id=0180b37d7e6843eaa90e0d081ade9da8) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:59.626423 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c122f-1aea-48a9-966d-b4994ca4eabe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:59.628103 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c122f-1aea-48a9-966d-b4994ca4eabe None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:59.632732 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1427d-9f42-44b9-be86-dc5915fae837 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:59.634699 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 175/353] 10.222.0.60 () {56 vars in 1376 bytes} [Thu Jul 21 19:14:59 2022] GET /identity/v3/role_assignments?group.id=90fb1786a57043fd8943c5ea162b9294&scope.project.id=0180b37d7e6843eaa90e0d081ade9da8&role.id=0af30c087b3541a4847d708dd68464d6 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:59.635794 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c122f-1aea-48a9-966d-b4994ca4eabe None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:59.674237 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cfb55-3875-447c-b70f-58614afe8ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:59.675410 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cfb55-3875-447c-b70f-58614afe8ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:59.675891 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cfb55-3875-447c-b70f-58614afe8ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:59.676316 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cfb55-3875-447c-b70f-58614afe8ad3 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:59.677251 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166cfb55-3875-447c-b70f-58614afe8ad3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:14:59.677972 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166cfb55-3875-447c-b70f-58614afe8ad3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:59.679635 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166cfb55-3875-447c-b70f-58614afe8ad3 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:59.693147 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 179/354] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Jul 21 19:14:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:59.693147 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cfb55-3875-447c-b70f-58614afe8ad3 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:59.735277 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:59.783598 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c122f-1aea-48a9-966d-b4994ca4eabe None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:59.815667 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cfb55-3875-447c-b70f-58614afe8ad3 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:14:59.841913 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e7027-49c0-442a-bf21-9e19a9ba082d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:59.843021 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e7027-49c0-442a-bf21-9e19a9ba082d None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:59.843557 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e7027-49c0-442a-bf21-9e19a9ba082d None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:59.844056 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e7027-49c0-442a-bf21-9e19a9ba082d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:59.861606 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb8285-4193-4c64-8a56-02dba47b41d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:14:59.862497 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb8285-4193-4c64-8a56-02dba47b41d0 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:59.862783 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb8285-4193-4c64-8a56-02dba47b41d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:59.863064 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb8285-4193-4c64-8a56-02dba47b41d0 None admin] PATH_INFO: `/v3/users/076ddd50e3f44db9b62cb605ad6c5d8c` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:59.867174 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb8285-4193-4c64-8a56-02dba47b41d0 None admin] RBAC: Authorizing `identity:get_user(user_id=076ddd50e3f44db9b62cb605ad6c5d8c)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:59.868685 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb8285-4193-4c64-8a56-02dba47b41d0 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:14:59.870116 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:14:59.870456 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 180/355] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:14:59 2022] GET /identity/v3/users/076ddd50e3f44db9b62cb605ad6c5d8c => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:14:59.875850 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e273501-7093-4345-88b7-cf74d37ee63a None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:14:59.877465 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e273501-7093-4345-88b7-cf74d37ee63a None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:14:59.877948 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e273501-7093-4345-88b7-cf74d37ee63a None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:14:59.879975 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 181/356] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:14:59 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:14:59.884021 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e273501-7093-4345-88b7-cf74d37ee63a None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:14:59.934582 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e7027-49c0-442a-bf21-9e19a9ba082d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:14:59.936114 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e7027-49c0-442a-bf21-9e19a9ba082d None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:00.002104 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e273501-7093-4345-88b7-cf74d37ee63a None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:00.005254 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:00.049582 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6480cf-bc6c-4a13-aa3e-0f61e2ea6482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:00.051177 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6480cf-bc6c-4a13-aa3e-0f61e2ea6482 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:00.051864 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6480cf-bc6c-4a13-aa3e-0f61e2ea6482 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:00.053092 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6480cf-bc6c-4a13-aa3e-0f61e2ea6482 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:00.064534 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 176/357] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:14:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 19:15:00.065652 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e7027-49c0-442a-bf21-9e19a9ba082d None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:00.133167 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:00.149409 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6480cf-bc6c-4a13-aa3e-0f61e2ea6482 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:00.154889 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6480cf-bc6c-4a13-aa3e-0f61e2ea6482 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:00.198062 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e7027-49c0-442a-bf21-9e19a9ba082d None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:00.258316 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6073d4e-2cba-4ce6-94a3-539d9e25e70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:00.259118 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6073d4e-2cba-4ce6-94a3-539d9e25e70f None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:00.259118 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6073d4e-2cba-4ce6-94a3-539d9e25e70f None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:00.259495 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6073d4e-2cba-4ce6-94a3-539d9e25e70f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:00.260996 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6073d4e-2cba-4ce6-94a3-539d9e25e70f None admin] RBAC: Adding query filter params (role.id=9d25a11a44b24a3eb36a9ecd8d89321d, user.id=076ddd50e3f44db9b62cb605ad6c5d8c, scope.system=all) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:00.260996 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6073d4e-2cba-4ce6-94a3-539d9e25e70f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:00.262704 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6073d4e-2cba-4ce6-94a3-539d9e25e70f None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:00.277443 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 177/358] 10.222.0.60 () {56 vars in 1308 bytes} [Thu Jul 21 19:15:00 2022] GET /identity/v3/role_assignments?user.id=076ddd50e3f44db9b62cb605ad6c5d8c&scope.system=all&role.id=9d25a11a44b24a3eb36a9ecd8d89321d => generated 510 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:00.279141 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f146986-a920-47ad-838e-56e0dd351a8b None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:00.279510 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f146986-a920-47ad-838e-56e0dd351a8b None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:00.279755 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f146986-a920-47ad-838e-56e0dd351a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:00.288149 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 182/359] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:14:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 19:15:00.289899 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acaf24a-c4bb-44bf-a30c-fada43d846b2 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:00.290305 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acaf24a-c4bb-44bf-a30c-fada43d846b2 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:00.290655 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acaf24a-c4bb-44bf-a30c-fada43d846b2 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:00.292066 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 183/360] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:00.292830 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acaf24a-c4bb-44bf-a30c-fada43d846b2 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:00.303061 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-3f146986-a920-47ad-838e-56e0dd351a8b None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:00.305519 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-3f146986-a920-47ad-838e-56e0dd351a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:00.310686 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:00.403331 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 178/361] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:15:00.403331 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f146986-a920-47ad-838e-56e0dd351a8b None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:00.434221 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acaf24a-c4bb-44bf-a30c-fada43d846b2 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:00.455885 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:00.480699 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c0655-13d0-4fde-9df8-a6570df90b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:00.481736 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c0655-13d0-4fde-9df8-a6570df90b02 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:00.482092 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c0655-13d0-4fde-9df8-a6570df90b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:00.482471 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c0655-13d0-4fde-9df8-a6570df90b02 None admin] PATH_INFO: `/v3/projects/0180b37d7e6843eaa90e0d081ade9da8` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:00.483881 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c0655-13d0-4fde-9df8-a6570df90b02 None admin] RBAC: Authorizing `identity:get_project(project_id=0180b37d7e6843eaa90e0d081ade9da8)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:00.485418 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c0655-13d0-4fde-9df8-a6570df90b02 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:00.490989 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 184/362] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:15:00 2022] GET /identity/v3/projects/0180b37d7e6843eaa90e0d081ade9da8 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:00.490989 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606b008-532a-44a2-a105-7701916b06b9 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:00.490989 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606b008-532a-44a2-a105-7701916b06b9 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:00.490989 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606b008-532a-44a2-a105-7701916b06b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:00.509171 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-e606b008-532a-44a2-a105-7701916b06b9 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:00.510398 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-e606b008-532a-44a2-a105-7701916b06b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:00.550718 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f146986-a920-47ad-838e-56e0dd351a8b None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:00.602246 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead059b-7dfe-4642-b367-40bf8e9304af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:00.602774 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 185/363] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:15:00.603206 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead059b-7dfe-4642-b367-40bf8e9304af None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:00.603594 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead059b-7dfe-4642-b367-40bf8e9304af None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:00.603872 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead059b-7dfe-4642-b367-40bf8e9304af None admin] PATH_INFO: `/v3/projects/d47c3e61323f489c977cc4785142f555` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:00.603978 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606b008-532a-44a2-a105-7701916b06b9 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:00.605153 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dead059b-7dfe-4642-b367-40bf8e9304af None admin] RBAC: Authorizing `identity:get_project(project_id=d47c3e61323f489c977cc4785142f555)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:00.606839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dead059b-7dfe-4642-b367-40bf8e9304af None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:00.609208 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:00.609458 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 179/364] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:15:00 2022] GET /identity/v3/projects/d47c3e61323f489c977cc4785142f555 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:00.612219 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead059b-7dfe-4642-b367-40bf8e9304af None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:00.747839 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606b008-532a-44a2-a105-7701916b06b9 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:00.750400 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead059b-7dfe-4642-b367-40bf8e9304af None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:00.753439 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:00.792914 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a821251-b254-4386-8d58-eb0974a0e242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:00.793125 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b7a751-3df4-44f3-8e67-29346fda9cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:00.794018 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a821251-b254-4386-8d58-eb0974a0e242 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:00.794330 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a821251-b254-4386-8d58-eb0974a0e242 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:00.794611 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a821251-b254-4386-8d58-eb0974a0e242 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:00.794939 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7a751-3df4-44f3-8e67-29346fda9cac None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:00.795361 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7a751-3df4-44f3-8e67-29346fda9cac None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:00.796282 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7a751-3df4-44f3-8e67-29346fda9cac None admin] PATH_INFO: `/v3/groups/90fb1786a57043fd8943c5ea162b9294` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:00.797637 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b7a751-3df4-44f3-8e67-29346fda9cac None admin] RBAC: Authorizing `identity:get_group(group_id=90fb1786a57043fd8943c5ea162b9294)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:00.799166 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b7a751-3df4-44f3-8e67-29346fda9cac None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:00.801122 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 180/365] 10.222.0.60 () {56 vars in 1180 bytes} [Thu Jul 21 19:15:00 2022] GET /identity/v3/groups/90fb1786a57043fd8943c5ea162b9294 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:00.801898 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b7a751-3df4-44f3-8e67-29346fda9cac None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:00.811869 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a821251-b254-4386-8d58-eb0974a0e242 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:15:00.823143 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-7a821251-b254-4386-8d58-eb0974a0e242 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 19:15:00.823143 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:00.823143 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:00.823143 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:00.823143 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:00.823143 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:00.823143 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:00.823143 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:00.823143 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:00.823143 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:00.823143 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:00.823143 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:00.823143 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:15:00.823143 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:15:00.823143 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:15:00.823143 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:15:00.824489 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:15:00.824489 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:15:00.824489 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:15:00.824489 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:15:00.824489 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:00.824489 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:00.824489 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:00.824489 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:00.824489 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:00.824489 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:00.824489 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:00.824489 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:00.824489 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:00.824489 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:00.824489 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:00.824489 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:00.825272 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:00.825272 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:00.825272 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:00.825272 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:00.825272 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:15:00.825272 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:15:00.825272 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:15:00.825272 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:15:00.825272 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:15:00.825272 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:15:00.825272 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 19:15:00.825272 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:00.825272 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 186/366] 10.222.0.60 () {56 vars in 1114 bytes} [Thu Jul 21 19:15:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:00.825921 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a821251-b254-4386-8d58-eb0974a0e242 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:00.921138 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:00.931930 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b7a751-3df4-44f3-8e67-29346fda9cac None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:00.972094 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a821251-b254-4386-8d58-eb0974a0e242 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:00.979253 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6729de-21ab-47c1-a395-f4f4c7466e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:00.980158 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6729de-21ab-47c1-a395-f4f4c7466e79 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:00.980443 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6729de-21ab-47c1-a395-f4f4c7466e79 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:00.980721 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6729de-21ab-47c1-a395-f4f4c7466e79 None admin] PATH_INFO: `/v3/groups/90fb1786a57043fd8943c5ea162b9294` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:00.982306 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6729de-21ab-47c1-a395-f4f4c7466e79 None admin] RBAC: Authorizing `identity:get_group(group_id=90fb1786a57043fd8943c5ea162b9294)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:00.983804 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6729de-21ab-47c1-a395-f4f4c7466e79 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:00.985454 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 181/367] 10.222.0.60 () {56 vars in 1180 bytes} [Thu Jul 21 19:15:00 2022] GET /identity/v3/groups/90fb1786a57043fd8943c5ea162b9294 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:00.986220 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6729de-21ab-47c1-a395-f4f4c7466e79 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:01.011885 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa37f4-9118-4cab-b57d-e2166dfba312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:01.013340 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa37f4-9118-4cab-b57d-e2166dfba312 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:01.013340 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa37f4-9118-4cab-b57d-e2166dfba312 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:01.013340 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa37f4-9118-4cab-b57d-e2166dfba312 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:01.027373 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa37f4-9118-4cab-b57d-e2166dfba312 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:15:01.036379 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-e5fa37f4-9118-4cab-b57d-e2166dfba312 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:15:01.036379 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:01.036379 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:01.036379 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:01.036379 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:01.036379 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:01.036379 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:01.036379 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:01.036379 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:01.036379 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:01.036379 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:01.036379 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:01.036379 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:15:01.036379 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:15:01.036379 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:15:01.036379 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:15:01.037267 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:15:01.037267 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:15:01.037267 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:15:01.037267 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:15:01.037267 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:01.037267 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:01.037267 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:01.037267 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:01.037267 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:01.037267 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:01.037267 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:01.037267 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:01.037267 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:01.037267 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:01.037267 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:01.037267 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:01.038064 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:01.038064 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:01.038064 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:01.038064 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:01.038064 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:15:01.038064 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:15:01.038064 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:15:01.038064 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:15:01.038064 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:15:01.038064 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:15:01.038064 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:15:01.038064 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:01.038064 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 187/368] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Jul 21 19:15:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:01.039513 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa37f4-9118-4cab-b57d-e2166dfba312 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:01.051395 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:01.124116 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6729de-21ab-47c1-a395-f4f4c7466e79 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:01.160305 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa37f4-9118-4cab-b57d-e2166dfba312 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:01.162595 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effe93d-5ffb-4818-bb9f-d9bd1536838a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:01.163571 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effe93d-5ffb-4818-bb9f-d9bd1536838a None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:01.164601 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effe93d-5ffb-4818-bb9f-d9bd1536838a None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:01.164886 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effe93d-5ffb-4818-bb9f-d9bd1536838a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:01.165780 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6effe93d-5ffb-4818-bb9f-d9bd1536838a None admin] RBAC: Adding query filter params (group.id=90fb1786a57043fd8943c5ea162b9294, role.id=3ad609555dec437d92e5c7291b1c939a, scope.project.id=0180b37d7e6843eaa90e0d081ade9da8) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:01.166031 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6effe93d-5ffb-4818-bb9f-d9bd1536838a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:01.167542 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6effe93d-5ffb-4818-bb9f-d9bd1536838a None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:01.175094 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 182/369] 10.222.0.60 () {56 vars in 1376 bytes} [Thu Jul 21 19:15:00 2022] GET /identity/v3/role_assignments?group.id=90fb1786a57043fd8943c5ea162b9294&scope.project.id=0180b37d7e6843eaa90e0d081ade9da8&role.id=3ad609555dec437d92e5c7291b1c939a => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:01.175749 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effe93d-5ffb-4818-bb9f-d9bd1536838a None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:01.187370 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:01.203899 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810ff91-d597-4fdb-a799-bebaed21e062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:01.204908 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810ff91-d597-4fdb-a799-bebaed21e062 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:01.205355 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810ff91-d597-4fdb-a799-bebaed21e062 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:01.205741 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810ff91-d597-4fdb-a799-bebaed21e062 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:01.206675 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c810ff91-d597-4fdb-a799-bebaed21e062 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:01.207098 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c810ff91-d597-4fdb-a799-bebaed21e062 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:01.208711 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c810ff91-d597-4fdb-a799-bebaed21e062 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:01.221893 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 188/370] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:15:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:01.223184 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810ff91-d597-4fdb-a799-bebaed21e062 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:01.316714 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effe93d-5ffb-4818-bb9f-d9bd1536838a None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:01.320323 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:01.343693 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810ff91-d597-4fdb-a799-bebaed21e062 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:01.361271 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a44bd0-eea4-46ff-a2e9-f2d22312d064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:01.361950 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a44bd0-eea4-46ff-a2e9-f2d22312d064 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:01.362236 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a44bd0-eea4-46ff-a2e9-f2d22312d064 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:01.362514 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a44bd0-eea4-46ff-a2e9-f2d22312d064 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:01.363357 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a44bd0-eea4-46ff-a2e9-f2d22312d064 None admin] RBAC: Adding query filter params (group.id=90fb1786a57043fd8943c5ea162b9294, role.id=0af30c087b3541a4847d708dd68464d6, scope.project.id=d47c3e61323f489c977cc4785142f555) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:01.364874 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a44bd0-eea4-46ff-a2e9-f2d22312d064 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:01.366395 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a44bd0-eea4-46ff-a2e9-f2d22312d064 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:01.373564 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 183/371] 10.222.0.60 () {56 vars in 1376 bytes} [Thu Jul 21 19:15:01 2022] GET /identity/v3/role_assignments?group.id=90fb1786a57043fd8943c5ea162b9294&scope.project.id=d47c3e61323f489c977cc4785142f555&role.id=0af30c087b3541a4847d708dd68464d6 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:01.374434 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a44bd0-eea4-46ff-a2e9-f2d22312d064 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:01.389025 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12840754-42b7-437a-a63a-15820e15636f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:01.389713 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12840754-42b7-437a-a63a-15820e15636f None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:01.390071 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12840754-42b7-437a-a63a-15820e15636f None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:01.390353 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12840754-42b7-437a-a63a-15820e15636f None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:01.391211 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12840754-42b7-437a-a63a-15820e15636f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:01.391624 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12840754-42b7-437a-a63a-15820e15636f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:01.393213 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12840754-42b7-437a-a63a-15820e15636f None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:01.407466 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 189/372] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:15:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:01.410077 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12840754-42b7-437a-a63a-15820e15636f None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:01.474119 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:01.507873 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a44bd0-eea4-46ff-a2e9-f2d22312d064 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:01.558757 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ae927-d773-4e6d-bbe0-c5b027275a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:01.559478 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ae927-d773-4e6d-bbe0-c5b027275a4c None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:01.559747 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ae927-d773-4e6d-bbe0-c5b027275a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:01.560027 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ae927-d773-4e6d-bbe0-c5b027275a4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:01.561478 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12840754-42b7-437a-a63a-15820e15636f None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:01.601571 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17af5c-559a-4918-a1f0-8487f713520d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:01.602535 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17af5c-559a-4918-a1f0-8487f713520d None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:01.602827 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17af5c-559a-4918-a1f0-8487f713520d None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:01.603160 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17af5c-559a-4918-a1f0-8487f713520d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:01.614836 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:01.657080 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ae927-d773-4e6d-bbe0-c5b027275a4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:01.658565 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ae927-d773-4e6d-bbe0-c5b027275a4c None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:01.689030 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17af5c-559a-4918-a1f0-8487f713520d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:01.691315 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17af5c-559a-4918-a1f0-8487f713520d None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:01.775802 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:01.815247 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 184/373] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:15:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 19:15:01.821840 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ae927-d773-4e6d-bbe0-c5b027275a4c None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:01.856399 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 190/374] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:15:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 19:15:01.862338 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17af5c-559a-4918-a1f0-8487f713520d None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:01.940519 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:02.004686 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ae927-d773-4e6d-bbe0-c5b027275a4c None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:02.051264 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17af5c-559a-4918-a1f0-8487f713520d None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:02.061780 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309b35b-26b3-4161-a046-ef71b22fd403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:02.062976 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309b35b-26b3-4161-a046-ef71b22fd403 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:02.064011 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309b35b-26b3-4161-a046-ef71b22fd403 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:02.064362 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309b35b-26b3-4161-a046-ef71b22fd403 None admin] PATH_INFO: `/v3/projects/d47c3e61323f489c977cc4785142f555` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:02.065774 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9309b35b-26b3-4161-a046-ef71b22fd403 None admin] RBAC: Authorizing `identity:get_project(project_id=d47c3e61323f489c977cc4785142f555)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:02.067150 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9309b35b-26b3-4161-a046-ef71b22fd403 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:02.069327 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 185/375] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:15:01 2022] GET /identity/v3/projects/d47c3e61323f489c977cc4785142f555 => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:15:02.071199 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e3405-c7a2-4ddb-973d-6e01b584d5d1 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:02.071673 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e3405-c7a2-4ddb-973d-6e01b584d5d1 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:02.072019 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e3405-c7a2-4ddb-973d-6e01b584d5d1 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:02.073577 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 186/376] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:02.078266 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e3405-c7a2-4ddb-973d-6e01b584d5d1 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:02.099338 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94acd16f-9966-43fa-b19e-2b2d5b665eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:02.100686 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94acd16f-9966-43fa-b19e-2b2d5b665eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:02.101152 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94acd16f-9966-43fa-b19e-2b2d5b665eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:02.101887 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94acd16f-9966-43fa-b19e-2b2d5b665eb9 None admin] PATH_INFO: `/v3/projects/c15ec98f010f4039a43acd913bc93061` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:02.103262 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94acd16f-9966-43fa-b19e-2b2d5b665eb9 None admin] RBAC: Authorizing `identity:get_project(project_id=c15ec98f010f4039a43acd913bc93061)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:02.105382 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94acd16f-9966-43fa-b19e-2b2d5b665eb9 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:02.108392 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 191/377] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:15:01 2022] GET /identity/v3/projects/c15ec98f010f4039a43acd913bc93061 => generated 344 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:02.109852 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaedf16-f891-4dcf-8743-a07792c731e3 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:02.110321 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaedf16-f891-4dcf-8743-a07792c731e3 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:02.110757 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaedf16-f891-4dcf-8743-a07792c731e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:02.133586 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-cfaedf16-f891-4dcf-8743-a07792c731e3 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:02.135974 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-cfaedf16-f891-4dcf-8743-a07792c731e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:02.150252 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:02.203030 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e3405-c7a2-4ddb-973d-6e01b584d5d1 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:02.235322 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 192/378] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:15:02.236700 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaedf16-f891-4dcf-8743-a07792c731e3 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:02.257116 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1627574-3e54-44ae-a8e7-c304f1eb9c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:02.258977 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1627574-3e54-44ae-a8e7-c304f1eb9c00 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:02.259270 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1627574-3e54-44ae-a8e7-c304f1eb9c00 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:02.259579 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1627574-3e54-44ae-a8e7-c304f1eb9c00 None admin] PATH_INFO: `/v3/groups/90fb1786a57043fd8943c5ea162b9294` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:02.261008 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1627574-3e54-44ae-a8e7-c304f1eb9c00 None admin] RBAC: Authorizing `identity:get_group(group_id=90fb1786a57043fd8943c5ea162b9294)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:02.262476 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1627574-3e54-44ae-a8e7-c304f1eb9c00 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:02.266063 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 187/379] 10.222.0.60 () {56 vars in 1180 bytes} [Thu Jul 21 19:15:02 2022] GET /identity/v3/groups/90fb1786a57043fd8943c5ea162b9294 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:02.266836 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1627574-3e54-44ae-a8e7-c304f1eb9c00 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:02.276484 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:02.389228 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaedf16-f891-4dcf-8743-a07792c731e3 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:02.390819 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1627574-3e54-44ae-a8e7-c304f1eb9c00 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:02.436584 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0b388-4023-4d32-a34e-16199923d8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:02.437546 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0b388-4023-4d32-a34e-16199923d8c6 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:02.437828 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0b388-4023-4d32-a34e-16199923d8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:02.437926 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd3132-c6c2-42ca-9fd4-856110bed5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:02.438111 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0b388-4023-4d32-a34e-16199923d8c6 None admin] PATH_INFO: `/v3/groups/3f143b68458a448d94a866989ddc951f` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:02.438747 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd3132-c6c2-42ca-9fd4-856110bed5e4 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:02.439036 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd3132-c6c2-42ca-9fd4-856110bed5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:02.439317 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd3132-c6c2-42ca-9fd4-856110bed5e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:02.445208 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a0b388-4023-4d32-a34e-16199923d8c6 None admin] RBAC: Authorizing `identity:get_group(group_id=3f143b68458a448d94a866989ddc951f)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:02.446685 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a0b388-4023-4d32-a34e-16199923d8c6 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:02.448676 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 193/380] 10.222.0.60 () {56 vars in 1180 bytes} [Thu Jul 21 19:15:02 2022] GET /identity/v3/groups/3f143b68458a448d94a866989ddc951f => generated 229 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:02.449599 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0b388-4023-4d32-a34e-16199923d8c6 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:02.457655 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd3132-c6c2-42ca-9fd4-856110bed5e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:15:02.466928 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:02.468427 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-2dbd3132-c6c2-42ca-9fd4-856110bed5e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 19:15:02.468427 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:02.468427 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:02.468427 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:02.468427 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:02.468427 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:02.468427 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:02.468427 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:02.468427 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:02.468427 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:02.468427 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:02.468427 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:02.468427 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:15:02.468427 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:15:02.468427 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:15:02.468427 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:15:02.470420 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:15:02.470420 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:15:02.470420 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:15:02.470420 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:15:02.470420 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:02.470420 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:02.470420 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:02.470420 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:02.470420 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:02.470420 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:02.470420 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:02.470420 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:02.470420 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:02.470420 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:02.470420 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:02.470420 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:02.472364 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:02.472364 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:02.472364 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:02.472364 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:02.472364 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:15:02.472364 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:15:02.472364 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:15:02.472364 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:15:02.472364 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:15:02.472364 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:15:02.472364 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 19:15:02.472364 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:02.472364 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 188/381] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:15:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:02.472364 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd3132-c6c2-42ca-9fd4-856110bed5e4 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:02.554690 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:02.595518 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd3132-c6c2-42ca-9fd4-856110bed5e4 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:02.599193 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0b388-4023-4d32-a34e-16199923d8c6 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:02.634114 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c810127-ee75-45be-9f32-a83f0f609b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:02.635142 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c810127-ee75-45be-9f32-a83f0f609b12 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:02.635662 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c810127-ee75-45be-9f32-a83f0f609b12 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:02.636167 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c810127-ee75-45be-9f32-a83f0f609b12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:02.637187 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c810127-ee75-45be-9f32-a83f0f609b12 None admin] RBAC: Adding query filter params (group.id=3f143b68458a448d94a866989ddc951f, role.id=685e18230e1744c581baaf842d0fd4ca, scope.project.id=c15ec98f010f4039a43acd913bc93061) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:02.637705 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c810127-ee75-45be-9f32-a83f0f609b12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:02.639514 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c810127-ee75-45be-9f32-a83f0f609b12 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:02.645586 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69675c-ef68-41bc-af27-fd5c42fbc8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:02.646246 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69675c-ef68-41bc-af27-fd5c42fbc8a1 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:02.646592 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 189/382] 10.222.0.60 () {56 vars in 1376 bytes} [Thu Jul 21 19:15:02 2022] GET /identity/v3/role_assignments?group.id=3f143b68458a448d94a866989ddc951f&scope.project.id=c15ec98f010f4039a43acd913bc93061&role.id=685e18230e1744c581baaf842d0fd4ca => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:02.646716 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69675c-ef68-41bc-af27-fd5c42fbc8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:02.646981 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69675c-ef68-41bc-af27-fd5c42fbc8a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:02.651459 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb69675c-ef68-41bc-af27-fd5c42fbc8a1 None admin] RBAC: Adding query filter params (group.id=90fb1786a57043fd8943c5ea162b9294, role.id=3ad609555dec437d92e5c7291b1c939a, scope.project.id=d47c3e61323f489c977cc4785142f555) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:02.651459 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb69675c-ef68-41bc-af27-fd5c42fbc8a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:02.651459 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb69675c-ef68-41bc-af27-fd5c42fbc8a1 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:02.652490 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c810127-ee75-45be-9f32-a83f0f609b12 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:02.657105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 194/383] 10.222.0.60 () {56 vars in 1376 bytes} [Thu Jul 21 19:15:02 2022] GET /identity/v3/role_assignments?group.id=90fb1786a57043fd8943c5ea162b9294&scope.project.id=d47c3e61323f489c977cc4785142f555&role.id=3ad609555dec437d92e5c7291b1c939a => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:02.798204 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c810127-ee75-45be-9f32-a83f0f609b12 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:02.839716 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:02.848065 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240d691-0c5d-47f0-9fd1-e4c57b06b0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:02.848760 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240d691-0c5d-47f0-9fd1-e4c57b06b0fb None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:02.849047 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240d691-0c5d-47f0-9fd1-e4c57b06b0fb None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:02.849323 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240d691-0c5d-47f0-9fd1-e4c57b06b0fb None admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:02.850083 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8240d691-0c5d-47f0-9fd1-e4c57b06b0fb None admin] RBAC: Adding query filter params (name=member) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:02.850392 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8240d691-0c5d-47f0-9fd1-e4c57b06b0fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:02.852489 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8240d691-0c5d-47f0-9fd1-e4c57b06b0fb None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:02.862851 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 190/384] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Jul 21 19:15:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:02.869521 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69675c-ef68-41bc-af27-fd5c42fbc8a1 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:02.958721 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:02.996675 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69675c-ef68-41bc-af27-fd5c42fbc8a1 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:03.042056 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd84328-6365-4472-afae-4e887224d674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:03.042922 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd84328-6365-4472-afae-4e887224d674 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:03.043206 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd84328-6365-4472-afae-4e887224d674 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:03.043500 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd84328-6365-4472-afae-4e887224d674 None admin] PATH_INFO: `/v3/groups/90fb1786a57043fd8943c5ea162b9294` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:03.044723 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd84328-6365-4472-afae-4e887224d674 None admin] RBAC: Authorizing `identity:get_group(group_id=90fb1786a57043fd8943c5ea162b9294)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:03.046235 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd84328-6365-4472-afae-4e887224d674 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:03.048179 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 195/385] 10.222.0.60 () {56 vars in 1180 bytes} [Thu Jul 21 19:15:02 2022] GET /identity/v3/groups/90fb1786a57043fd8943c5ea162b9294 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:03.055650 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240d691-0c5d-47f0-9fd1-e4c57b06b0fb None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:03.188596 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240d691-0c5d-47f0-9fd1-e4c57b06b0fb None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:03.236076 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349fa3fc-62fc-419d-8fa7-c71488fb9015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:03.237305 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349fa3fc-62fc-419d-8fa7-c71488fb9015 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:03.237795 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349fa3fc-62fc-419d-8fa7-c71488fb9015 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:03.238272 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349fa3fc-62fc-419d-8fa7-c71488fb9015 None admin] PATH_INFO: `/v3/projects/0180b37d7e6843eaa90e0d081ade9da8` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:03.244188 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349fa3fc-62fc-419d-8fa7-c71488fb9015 None admin] RBAC: Authorizing `identity:get_project(project_id=0180b37d7e6843eaa90e0d081ade9da8)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:03.245891 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349fa3fc-62fc-419d-8fa7-c71488fb9015 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:03.247912 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 191/386] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:15:03 2022] GET /identity/v3/projects/0180b37d7e6843eaa90e0d081ade9da8 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:03.253869 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd84328-6365-4472-afae-4e887224d674 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:03.390253 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd84328-6365-4472-afae-4e887224d674 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:03.441286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81263511-b1c4-4085-b137-8a06922b33ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:03.442180 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81263511-b1c4-4085-b137-8a06922b33ba None admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:03.442466 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81263511-b1c4-4085-b137-8a06922b33ba None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:03.442741 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81263511-b1c4-4085-b137-8a06922b33ba None admin] PATH_INFO: `/v3/projects/0180b37d7e6843eaa90e0d081ade9da8/groups/90fb1786a57043fd8943c5ea162b9294/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:03.445339 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81263511-b1c4-4085-b137-8a06922b33ba None admin] RBAC: Authorizing `identity:create_grant(project_id=0180b37d7e6843eaa90e0d081ade9da8, group_id=90fb1786a57043fd8943c5ea162b9294, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:03.446799 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81263511-b1c4-4085-b137-8a06922b33ba None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:03.549398 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:03.554876 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 196/387] 10.222.0.60 () {58 vars in 1442 bytes} [Thu Jul 21 19:15:03 2022] PUT /identity/v3/projects/0180b37d7e6843eaa90e0d081ade9da8/groups/90fb1786a57043fd8943c5ea162b9294/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:15:03.903267 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1036bd-3f47-4c91-a7db-f28dff59870a None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:03.904307 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1036bd-3f47-4c91-a7db-f28dff59870a None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:03.904802 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1036bd-3f47-4c91-a7db-f28dff59870a None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:03.906372 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 192/388] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:03.913074 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6317e9-52d9-48a9-8f00-f2048cceaa08 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:03.914288 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6317e9-52d9-48a9-8f00-f2048cceaa08 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:03.914895 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6317e9-52d9-48a9-8f00-f2048cceaa08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:03.928545 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8831229-b92e-4c76-a574-b2c23c635624 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:03.929187 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8831229-b92e-4c76-a574-b2c23c635624 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:03.929956 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8831229-b92e-4c76-a574-b2c23c635624 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:03.931824 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 193/389] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:03.936438 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-5a6317e9-52d9-48a9-8f00-f2048cceaa08 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:03.937506 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96579583-89fb-4332-91f0-89dc19737811 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:03.937636 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-5a6317e9-52d9-48a9-8f00-f2048cceaa08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:03.938130 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96579583-89fb-4332-91f0-89dc19737811 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:03.938609 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96579583-89fb-4332-91f0-89dc19737811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:03.967260 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-96579583-89fb-4332-91f0-89dc19737811 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:03.968832 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-96579583-89fb-4332-91f0-89dc19737811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:04.063803 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:04.069101 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 194/390] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 19:15:04.071352 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 197/391] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:15:04.094600 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96579583-89fb-4332-91f0-89dc19737811 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:04.100258 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6317e9-52d9-48a9-8f00-f2048cceaa08 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:04.231944 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96579583-89fb-4332-91f0-89dc19737811 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:04.269603 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6079e83-e393-4eb0-b689-7e8830654a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:04.270452 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6079e83-e393-4eb0-b689-7e8830654a35 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:04.270741 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6079e83-e393-4eb0-b689-7e8830654a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:04.271022 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6079e83-e393-4eb0-b689-7e8830654a35 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:04.282305 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6079e83-e393-4eb0-b689-7e8830654a35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:15:04.291090 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-e6079e83-e393-4eb0-b689-7e8830654a35 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 19:15:04.291090 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:04.291090 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:04.291090 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:04.291090 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:04.291090 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:04.291090 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:04.291090 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:04.291090 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:04.291090 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:04.291090 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:04.291090 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:04.291090 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:15:04.291090 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:15:04.291090 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:15:04.291090 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:15:04.292000 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:15:04.292000 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:15:04.292000 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:15:04.292000 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:15:04.292000 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:04.292000 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:04.292000 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:04.292000 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:04.292000 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:04.292000 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:04.292000 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:04.292000 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:04.292000 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:04.292000 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:04.292000 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:04.292000 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:04.293247 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:04.293247 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:04.293247 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:04.293247 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:04.293247 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:15:04.293247 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:15:04.293247 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:15:04.293247 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:15:04.293247 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:15:04.293247 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:15:04.293247 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 19:15:04.293247 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:04.293247 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 195/392] 10.222.0.60 () {56 vars in 1114 bytes} [Thu Jul 21 19:15:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:04.301881 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6079e83-e393-4eb0-b689-7e8830654a35 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:04.329104 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6317e9-52d9-48a9-8f00-f2048cceaa08 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:04.386727 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:04.396336 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767ff0a-2f1d-471f-a76e-4c13239c67cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:04.401595 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767ff0a-2f1d-471f-a76e-4c13239c67cc None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:04.401595 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767ff0a-2f1d-471f-a76e-4c13239c67cc None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:04.401595 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767ff0a-2f1d-471f-a76e-4c13239c67cc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:04.411775 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:04.416976 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c767ff0a-2f1d-471f-a76e-4c13239c67cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:15:04.424724 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-c767ff0a-2f1d-471f-a76e-4c13239c67cc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 19:15:04.424724 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:04.424724 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:04.424724 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:04.424724 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:04.424724 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:04.424724 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:04.424724 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:04.424724 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:04.424724 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:04.424724 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:04.424724 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:04.424724 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:15:04.424724 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:15:04.424724 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:15:04.424724 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:15:04.425837 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:15:04.425837 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:15:04.425837 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:15:04.425837 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:15:04.425837 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:04.425837 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:04.425837 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:04.425837 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:04.425837 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:04.425837 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:04.425837 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:04.425837 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:04.425837 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:04.425837 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:04.425837 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:04.425837 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:04.426759 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:04.426759 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:04.426759 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:04.426759 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:04.426759 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:15:04.426759 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:15:04.426759 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:15:04.426759 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:15:04.426759 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:15:04.426759 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:15:04.426759 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 19:15:04.426759 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:04.426759 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 198/393] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:15:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:04.436908 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767ff0a-2f1d-471f-a76e-4c13239c67cc None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:04.519064 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6079e83-e393-4eb0-b689-7e8830654a35 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:04.584902 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da4604d-55b6-4acf-8a50-09faba21e649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:04.585619 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4604d-55b6-4acf-8a50-09faba21e649 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:04.585908 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4604d-55b6-4acf-8a50-09faba21e649 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:04.586192 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4604d-55b6-4acf-8a50-09faba21e649 None admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:04.586936 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da4604d-55b6-4acf-8a50-09faba21e649 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:04.587247 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da4604d-55b6-4acf-8a50-09faba21e649 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:04.588649 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da4604d-55b6-4acf-8a50-09faba21e649 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:04.607232 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 196/394] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:15:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:04.609458 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da4604d-55b6-4acf-8a50-09faba21e649 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:04.630470 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767ff0a-2f1d-471f-a76e-4c13239c67cc None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:04.667946 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d717ab8-34bc-447a-957e-394831ae0156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:04.668633 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d717ab8-34bc-447a-957e-394831ae0156 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:04.668919 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d717ab8-34bc-447a-957e-394831ae0156 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:04.669198 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d717ab8-34bc-447a-957e-394831ae0156 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:04.669952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d717ab8-34bc-447a-957e-394831ae0156 None admin] RBAC: Adding query filter params (name=member) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:04.670259 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d717ab8-34bc-447a-957e-394831ae0156 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:04.671701 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d717ab8-34bc-447a-957e-394831ae0156 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:04.694041 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 199/395] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Jul 21 19:15:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:04.700454 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d717ab8-34bc-447a-957e-394831ae0156 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:04.792312 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da4604d-55b6-4acf-8a50-09faba21e649 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:04.804013 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:04.805950 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:04.832672 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df931a-fbd2-4457-9bbd-b21d8bd118e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:04.833534 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df931a-fbd2-4457-9bbd-b21d8bd118e8 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:04.833886 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df931a-fbd2-4457-9bbd-b21d8bd118e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:04.834103 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df931a-fbd2-4457-9bbd-b21d8bd118e8 None admin] PATH_INFO: `/v3/groups/90fb1786a57043fd8943c5ea162b9294` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:04.840745 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df931a-fbd2-4457-9bbd-b21d8bd118e8 None admin] RBAC: Authorizing `identity:get_group(group_id=90fb1786a57043fd8943c5ea162b9294)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:04.842212 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df931a-fbd2-4457-9bbd-b21d8bd118e8 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:04.851960 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 197/396] 10.222.0.60 () {56 vars in 1180 bytes} [Thu Jul 21 19:15:04 2022] GET /identity/v3/groups/90fb1786a57043fd8943c5ea162b9294 => generated 226 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:04.855843 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df931a-fbd2-4457-9bbd-b21d8bd118e8 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:04.900607 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d717ab8-34bc-447a-957e-394831ae0156 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:04.967015 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb93e7d-4b59-467a-a505-aded4254b47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:04.970351 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb93e7d-4b59-467a-a505-aded4254b47a None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:04.970649 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb93e7d-4b59-467a-a505-aded4254b47a None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:04.970935 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb93e7d-4b59-467a-a505-aded4254b47a None admin] PATH_INFO: `/v3/groups/90fb1786a57043fd8943c5ea162b9294` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:04.974050 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb93e7d-4b59-467a-a505-aded4254b47a None admin] RBAC: Authorizing `identity:get_group(group_id=90fb1786a57043fd8943c5ea162b9294)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:04.975527 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb93e7d-4b59-467a-a505-aded4254b47a None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:04.978139 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 200/397] 10.222.0.60 () {56 vars in 1180 bytes} [Thu Jul 21 19:15:04 2022] GET /identity/v3/groups/90fb1786a57043fd8943c5ea162b9294 => generated 226 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:04.984589 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb93e7d-4b59-467a-a505-aded4254b47a None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:05.049079 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df931a-fbd2-4457-9bbd-b21d8bd118e8 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:05.090063 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d677c2-4aa4-46c2-a95a-bb6c7cc1e2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:05.090919 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d677c2-4aa4-46c2-a95a-bb6c7cc1e2ed None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:05.091208 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d677c2-4aa4-46c2-a95a-bb6c7cc1e2ed None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:05.091515 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d677c2-4aa4-46c2-a95a-bb6c7cc1e2ed None admin] PATH_INFO: `/v3/projects/0180b37d7e6843eaa90e0d081ade9da8` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:05.093899 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d677c2-4aa4-46c2-a95a-bb6c7cc1e2ed None admin] RBAC: Authorizing `identity:get_project(project_id=0180b37d7e6843eaa90e0d081ade9da8)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:05.095668 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d677c2-4aa4-46c2-a95a-bb6c7cc1e2ed None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:05.097779 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 198/398] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:15:04 2022] GET /identity/v3/projects/0180b37d7e6843eaa90e0d081ade9da8 => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:15:05.098976 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7abaf6-5840-43f5-950f-d9d1cec00936 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:05.099265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7abaf6-5840-43f5-950f-d9d1cec00936 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:05.103838 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7abaf6-5840-43f5-950f-d9d1cec00936 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:05.105548 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 199/399] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:05.111857 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7abaf6-5840-43f5-950f-d9d1cec00936 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:05.144276 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb93e7d-4b59-467a-a505-aded4254b47a None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:05.166944 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:05.173307 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:05.183321 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88406de9-dbcd-4796-8cc9-dc55424ecb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:05.184323 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88406de9-dbcd-4796-8cc9-dc55424ecb4c None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:05.184723 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88406de9-dbcd-4796-8cc9-dc55424ecb4c None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:05.185026 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88406de9-dbcd-4796-8cc9-dc55424ecb4c None admin] PATH_INFO: `/v3/projects/d47c3e61323f489c977cc4785142f555` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:05.186490 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88406de9-dbcd-4796-8cc9-dc55424ecb4c None admin] RBAC: Authorizing `identity:get_project(project_id=d47c3e61323f489c977cc4785142f555)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:05.188211 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88406de9-dbcd-4796-8cc9-dc55424ecb4c None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:05.194475 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 201/400] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:15:04 2022] GET /identity/v3/projects/d47c3e61323f489c977cc4785142f555 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:05.194475 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181ce6a-d489-4131-8a3b-4c72fa21d6b0 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:05.194475 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181ce6a-d489-4131-8a3b-4c72fa21d6b0 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:05.194475 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181ce6a-d489-4131-8a3b-4c72fa21d6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:05.213336 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-2181ce6a-d489-4131-8a3b-4c72fa21d6b0 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:05.214798 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-2181ce6a-d489-4131-8a3b-4c72fa21d6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:05.244761 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7abaf6-5840-43f5-950f-d9d1cec00936 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:05.287147 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb82a8-c595-496f-80d0-fc1961870e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:05.288622 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb82a8-c595-496f-80d0-fc1961870e1a None admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:05.289212 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb82a8-c595-496f-80d0-fc1961870e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:05.289628 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb82a8-c595-496f-80d0-fc1961870e1a None admin] PATH_INFO: `/v3/projects/0180b37d7e6843eaa90e0d081ade9da8/groups/90fb1786a57043fd8943c5ea162b9294/roles/3ad609555dec437d92e5c7291b1c939a` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:05.292031 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cb82a8-c595-496f-80d0-fc1961870e1a None admin] RBAC: Authorizing `identity:create_grant(project_id=0180b37d7e6843eaa90e0d081ade9da8, group_id=90fb1786a57043fd8943c5ea162b9294, role_id=3ad609555dec437d92e5c7291b1c939a)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:05.295494 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 202/401] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:15:05.295494 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181ce6a-d489-4131-8a3b-4c72fa21d6b0 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:05.300978 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cb82a8-c595-496f-80d0-fc1961870e1a None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:05.412967 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181ce6a-d489-4131-8a3b-4c72fa21d6b0 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:05.437682 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:05.455081 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a0665-0a4b-438e-a786-f50f61008622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:05.455995 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a0665-0a4b-438e-a786-f50f61008622 None admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:05.456280 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a0665-0a4b-438e-a786-f50f61008622 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:05.456558 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a0665-0a4b-438e-a786-f50f61008622 None admin] PATH_INFO: `/v3/projects/d47c3e61323f489c977cc4785142f555/groups/90fb1786a57043fd8943c5ea162b9294/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:05.458517 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a0665-0a4b-438e-a786-f50f61008622 None admin] RBAC: Authorizing `identity:create_grant(project_id=d47c3e61323f489c977cc4785142f555, group_id=90fb1786a57043fd8943c5ea162b9294, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:05.460002 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a0665-0a4b-438e-a786-f50f61008622 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:05.661331 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 203/402] 10.222.0.60 () {58 vars in 1442 bytes} [Thu Jul 21 19:15:05 2022] PUT /identity/v3/projects/d47c3e61323f489c977cc4785142f555/groups/90fb1786a57043fd8943c5ea162b9294/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:15:05.662160 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a0665-0a4b-438e-a786-f50f61008622 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:05.749265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 200/403] 10.222.0.60 () {58 vars in 1442 bytes} [Thu Jul 21 19:15:05 2022] PUT /identity/v3/projects/0180b37d7e6843eaa90e0d081ade9da8/groups/90fb1786a57043fd8943c5ea162b9294/roles/3ad609555dec437d92e5c7291b1c939a => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:15:05.751853 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98774604-99ed-4348-b880-a64a3272326e None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:05.752429 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98774604-99ed-4348-b880-a64a3272326e None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:05.753328 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98774604-99ed-4348-b880-a64a3272326e None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:05.763959 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 201/404] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:05 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:05.766693 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba3fcc-feae-451f-83ad-7d203a7cd4e7 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:05.766979 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba3fcc-feae-451f-83ad-7d203a7cd4e7 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:05.767182 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba3fcc-feae-451f-83ad-7d203a7cd4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:05.803471 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-b2ba3fcc-feae-451f-83ad-7d203a7cd4e7 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:05.808518 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-b2ba3fcc-feae-451f-83ad-7d203a7cd4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:05.812850 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a0665-0a4b-438e-a786-f50f61008622 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:05.857364 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1190d94e-4cc2-40c0-8b69-3a15faf5bfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:05.858565 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190d94e-4cc2-40c0-8b69-3a15faf5bfbb None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:05.858853 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190d94e-4cc2-40c0-8b69-3a15faf5bfbb None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:05.860241 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190d94e-4cc2-40c0-8b69-3a15faf5bfbb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:05.877403 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1190d94e-4cc2-40c0-8b69-3a15faf5bfbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:15:05.887257 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-1190d94e-4cc2-40c0-8b69-3a15faf5bfbb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:15:05.887257 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:05.887257 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:05.887257 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:05.887257 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:05.887257 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:05.887257 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:05.887257 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:05.887257 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:05.887257 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:05.887257 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:05.887257 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:05.887257 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:15:05.887257 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:15:05.887257 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:15:05.887257 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:15:05.888449 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:15:05.888449 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:15:05.888449 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:15:05.888449 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:15:05.888449 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:05.888449 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:05.888449 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:05.888449 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:05.888449 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:05.888449 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:05.888449 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:05.888449 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:05.888449 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:05.888449 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:05.888449 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:05.888449 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:05.889450 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:05.889450 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:05.889450 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:05.889450 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:05.889450 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:15:05.889450 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:15:05.889450 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:15:05.889450 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:15:05.889450 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:15:05.889450 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:15:05.889450 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:15:05.889450 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:05.889450 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 204/405] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Jul 21 19:15:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:05.895850 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1190d94e-4cc2-40c0-8b69-3a15faf5bfbb None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:05.907929 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 202/406] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 19:15:05.933139 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba3fcc-feae-451f-83ad-7d203a7cd4e7 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:05.947913 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:05.971393 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:06.027911 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1190d94e-4cc2-40c0-8b69-3a15faf5bfbb None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:06.046385 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba3fcc-feae-451f-83ad-7d203a7cd4e7 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:06.073077 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e63b0-8e65-4da2-a02c-005d87d4075d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:06.073864 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e63b0-8e65-4da2-a02c-005d87d4075d None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:06.074224 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e63b0-8e65-4da2-a02c-005d87d4075d None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:06.074717 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e63b0-8e65-4da2-a02c-005d87d4075d None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:06.075891 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7e63b0-8e65-4da2-a02c-005d87d4075d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:06.076283 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7e63b0-8e65-4da2-a02c-005d87d4075d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:06.078165 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7e63b0-8e65-4da2-a02c-005d87d4075d None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:06.083737 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4325d-1288-4e94-ac0b-2db5ec2d58e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:06.085538 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4325d-1288-4e94-ac0b-2db5ec2d58e2 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:06.086252 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4325d-1288-4e94-ac0b-2db5ec2d58e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:06.086672 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4325d-1288-4e94-ac0b-2db5ec2d58e2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:06.088436 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 205/407] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:15:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:06.089820 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e165b1-72db-4f26-aaf1-f4eb32a584a6 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:06.091815 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e165b1-72db-4f26-aaf1-f4eb32a584a6 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:06.092270 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e165b1-72db-4f26-aaf1-f4eb32a584a6 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:06.093728 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 206/408] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:06.095499 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e165b1-72db-4f26-aaf1-f4eb32a584a6 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:06.105862 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4325d-1288-4e94-ac0b-2db5ec2d58e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:15:06.117439 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-a4d4325d-1288-4e94-ac0b-2db5ec2d58e2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 19:15:06.117439 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:06.117439 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:06.117439 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:06.117439 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:06.117439 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:06.117439 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:06.117439 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:06.117439 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:06.117439 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:06.117439 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:06.117439 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:06.117439 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:15:06.117439 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:15:06.117439 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:15:06.117439 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:15:06.118376 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:15:06.118376 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:15:06.118376 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:15:06.118376 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:15:06.118376 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:06.118376 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:06.118376 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:06.118376 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:06.118376 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:06.118376 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:06.118376 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:06.118376 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:06.118376 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:06.118376 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:06.118376 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:06.118376 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:06.119169 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:06.119169 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:06.119169 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:06.119169 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:06.119169 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:15:06.119169 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:15:06.119169 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:15:06.119169 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:15:06.119169 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:15:06.119169 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:15:06.119169 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 19:15:06.119169 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:06.120955 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 203/409] 10.222.0.60 () {56 vars in 1114 bytes} [Thu Jul 21 19:15:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:15:06.125673 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62490d-6ba6-4f2d-9d5a-907fdb5e927c None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:06.125673 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62490d-6ba6-4f2d-9d5a-907fdb5e927c None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:06.125673 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62490d-6ba6-4f2d-9d5a-907fdb5e927c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:06.144030 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-4a62490d-6ba6-4f2d-9d5a-907fdb5e927c None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:06.145027 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-4a62490d-6ba6-4f2d-9d5a-907fdb5e927c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:06.218146 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 204/410] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:15:06.219139 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62490d-6ba6-4f2d-9d5a-907fdb5e927c None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:06.221855 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:06.226577 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e165b1-72db-4f26-aaf1-f4eb32a584a6 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:06.262685 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b79146-3eea-427d-8f95-eb95726044b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:06.265178 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b79146-3eea-427d-8f95-eb95726044b5 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:06.265474 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b79146-3eea-427d-8f95-eb95726044b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:06.265862 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b79146-3eea-427d-8f95-eb95726044b5 None admin] PATH_INFO: `/v3/groups/3f143b68458a448d94a866989ddc951f` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:06.267165 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b79146-3eea-427d-8f95-eb95726044b5 None admin] RBAC: Authorizing `identity:get_group(group_id=3f143b68458a448d94a866989ddc951f)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:06.268725 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b79146-3eea-427d-8f95-eb95726044b5 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:06.275200 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 207/411] 10.222.0.60 () {56 vars in 1180 bytes} [Thu Jul 21 19:15:06 2022] GET /identity/v3/groups/3f143b68458a448d94a866989ddc951f => generated 229 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:06.275200 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b79146-3eea-427d-8f95-eb95726044b5 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:06.323583 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:06.333572 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62490d-6ba6-4f2d-9d5a-907fdb5e927c None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:06.377942 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27ef61-db82-4dd1-9626-ec40cf438859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:06.378619 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27ef61-db82-4dd1-9626-ec40cf438859 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:06.378908 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27ef61-db82-4dd1-9626-ec40cf438859 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:06.379188 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27ef61-db82-4dd1-9626-ec40cf438859 None admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:06.379966 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc27ef61-db82-4dd1-9626-ec40cf438859 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:06.380277 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc27ef61-db82-4dd1-9626-ec40cf438859 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:06.381656 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc27ef61-db82-4dd1-9626-ec40cf438859 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:06.390206 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 205/412] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:15:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:06.390536 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b79146-3eea-427d-8f95-eb95726044b5 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:06.391031 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27ef61-db82-4dd1-9626-ec40cf438859 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:06.439460 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5674f-2fb2-4722-9180-3c272efbe195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:06.439460 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5674f-2fb2-4722-9180-3c272efbe195 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:06.439460 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5674f-2fb2-4722-9180-3c272efbe195 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:06.439460 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5674f-2fb2-4722-9180-3c272efbe195 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:06.448996 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a5674f-2fb2-4722-9180-3c272efbe195 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:15:06.459351 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-07a5674f-2fb2-4722-9180-3c272efbe195 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 19:15:06.459351 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:06.459351 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:06.459351 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:06.459351 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:06.459351 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:06.459351 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:06.459351 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:06.459351 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:06.459351 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:06.459351 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:06.459351 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:06.459351 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:15:06.459351 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:15:06.459351 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:15:06.459351 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:15:06.460811 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:15:06.460811 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:15:06.460811 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:15:06.460811 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:15:06.460811 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:06.460811 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:06.460811 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:06.460811 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:06.460811 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:06.460811 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:06.460811 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:06.460811 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:06.460811 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:06.460811 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:06.460811 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:06.460811 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:06.461710 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:06.461710 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:06.461710 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:06.461710 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:06.461710 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:15:06.461710 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:15:06.461710 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:15:06.461710 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:15:06.461710 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:15:06.461710 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:15:06.461710 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 19:15:06.461710 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:06.462961 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 208/413] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:15:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:06.463274 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5674f-2fb2-4722-9180-3c272efbe195 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:06.496650 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27ef61-db82-4dd1-9626-ec40cf438859 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:06.499869 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:06.532917 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c88c1-3df8-480c-8eaa-83f4190f95b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:06.533791 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c88c1-3df8-480c-8eaa-83f4190f95b4 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:06.534077 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c88c1-3df8-480c-8eaa-83f4190f95b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:06.534357 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c88c1-3df8-480c-8eaa-83f4190f95b4 None admin] PATH_INFO: `/v3/projects/c15ec98f010f4039a43acd913bc93061` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:06.535642 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c88c1-3df8-480c-8eaa-83f4190f95b4 None admin] RBAC: Authorizing `identity:get_project(project_id=c15ec98f010f4039a43acd913bc93061)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:06.537169 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c88c1-3df8-480c-8eaa-83f4190f95b4 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:06.539464 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 206/414] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:15:06 2022] GET /identity/v3/projects/c15ec98f010f4039a43acd913bc93061 => generated 344 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:06.544658 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c88c1-3df8-480c-8eaa-83f4190f95b4 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:06.592352 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5674f-2fb2-4722-9180-3c272efbe195 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:06.626876 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12663ba-432a-4af7-96ea-c77cb614726d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:06.627783 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12663ba-432a-4af7-96ea-c77cb614726d None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:06.632727 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12663ba-432a-4af7-96ea-c77cb614726d None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:06.632727 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12663ba-432a-4af7-96ea-c77cb614726d None admin] PATH_INFO: `/v3/groups/90fb1786a57043fd8943c5ea162b9294` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:06.632727 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12663ba-432a-4af7-96ea-c77cb614726d None admin] RBAC: Authorizing `identity:get_group(group_id=90fb1786a57043fd8943c5ea162b9294)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:06.632727 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12663ba-432a-4af7-96ea-c77cb614726d None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:06.634335 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 209/415] 10.222.0.60 () {56 vars in 1180 bytes} [Thu Jul 21 19:15:06 2022] GET /identity/v3/groups/90fb1786a57043fd8943c5ea162b9294 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:06.634335 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12663ba-432a-4af7-96ea-c77cb614726d None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:06.658542 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:06.676982 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c88c1-3df8-480c-8eaa-83f4190f95b4 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:06.721245 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b75c10-5bb9-4c6f-8b70-8c49e816bbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:06.722569 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b75c10-5bb9-4c6f-8b70-8c49e816bbfc None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:06.723303 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b75c10-5bb9-4c6f-8b70-8c49e816bbfc None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:06.723825 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b75c10-5bb9-4c6f-8b70-8c49e816bbfc None admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:06.724914 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b75c10-5bb9-4c6f-8b70-8c49e816bbfc None admin] RBAC: Adding query filter params (name=member) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:06.725780 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b75c10-5bb9-4c6f-8b70-8c49e816bbfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:06.727633 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b75c10-5bb9-4c6f-8b70-8c49e816bbfc None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:06.742817 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 207/416] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Jul 21 19:15:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:06.742817 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b75c10-5bb9-4c6f-8b70-8c49e816bbfc None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:06.747947 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:06.755678 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12663ba-432a-4af7-96ea-c77cb614726d None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:06.765674 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:06.806428 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1c9fb-7e54-485c-af51-349d2c3f2305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:06.808218 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1c9fb-7e54-485c-af51-349d2c3f2305 None admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:06.808696 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1c9fb-7e54-485c-af51-349d2c3f2305 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:06.809311 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1c9fb-7e54-485c-af51-349d2c3f2305 None admin] PATH_INFO: `/v3/projects/c15ec98f010f4039a43acd913bc93061/groups/3f143b68458a448d94a866989ddc951f/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:06.812263 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1c9fb-7e54-485c-af51-349d2c3f2305 None admin] RBAC: Authorizing `identity:create_grant(project_id=c15ec98f010f4039a43acd913bc93061, group_id=3f143b68458a448d94a866989ddc951f, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:06.814461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1c9fb-7e54-485c-af51-349d2c3f2305 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:06.850254 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b75c10-5bb9-4c6f-8b70-8c49e816bbfc None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:06.882731 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2e93f-22b9-43a6-9183-f9c8dd69f366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:06.883705 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2e93f-22b9-43a6-9183-f9c8dd69f366 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:06.883992 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2e93f-22b9-43a6-9183-f9c8dd69f366 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:06.884270 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2e93f-22b9-43a6-9183-f9c8dd69f366 None admin] PATH_INFO: `/v3/projects/d47c3e61323f489c977cc4785142f555` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:06.885447 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a2e93f-22b9-43a6-9183-f9c8dd69f366 None admin] RBAC: Authorizing `identity:get_project(project_id=d47c3e61323f489c977cc4785142f555)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:06.886884 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a2e93f-22b9-43a6-9183-f9c8dd69f366 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:06.893364 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 208/417] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:15:06 2022] GET /identity/v3/projects/d47c3e61323f489c977cc4785142f555 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:06.893364 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2e93f-22b9-43a6-9183-f9c8dd69f366 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:06.959242 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 210/418] 10.222.0.60 () {58 vars in 1442 bytes} [Thu Jul 21 19:15:06 2022] PUT /identity/v3/projects/c15ec98f010f4039a43acd913bc93061/groups/3f143b68458a448d94a866989ddc951f/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:15:06.962013 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1c9fb-7e54-485c-af51-349d2c3f2305 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:07.022797 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:07.032863 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2e93f-22b9-43a6-9183-f9c8dd69f366 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:07.104189 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a8fd8-2560-4637-a9e1-c5e43a5c21fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:07.105743 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a8fd8-2560-4637-a9e1-c5e43a5c21fa None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:07.106338 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a8fd8-2560-4637-a9e1-c5e43a5c21fa None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:07.106941 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a8fd8-2560-4637-a9e1-c5e43a5c21fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:07.110938 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1c9fb-7e54-485c-af51-349d2c3f2305 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:07.166563 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f307a45d-8ea2-4f9a-af24-93ebd670bd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:07.174779 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307a45d-8ea2-4f9a-af24-93ebd670bd40 None admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:07.174779 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307a45d-8ea2-4f9a-af24-93ebd670bd40 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:07.174779 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307a45d-8ea2-4f9a-af24-93ebd670bd40 None admin] PATH_INFO: `/v3/projects/d47c3e61323f489c977cc4785142f555/groups/90fb1786a57043fd8943c5ea162b9294/roles/3ad609555dec437d92e5c7291b1c939a` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:07.174779 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f307a45d-8ea2-4f9a-af24-93ebd670bd40 None admin] RBAC: Authorizing `identity:create_grant(project_id=d47c3e61323f489c977cc4785142f555, group_id=90fb1786a57043fd8943c5ea162b9294, role_id=3ad609555dec437d92e5c7291b1c939a)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:07.174779 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f307a45d-8ea2-4f9a-af24-93ebd670bd40 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:07.208848 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a8fd8-2560-4637-a9e1-c5e43a5c21fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:07.211364 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a8fd8-2560-4637-a9e1-c5e43a5c21fa None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:07.299383 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:07.315271 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 209/419] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:15:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 19:15:07.320944 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a8fd8-2560-4637-a9e1-c5e43a5c21fa None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:07.402670 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 211/420] 10.222.0.60 () {58 vars in 1442 bytes} [Thu Jul 21 19:15:06 2022] PUT /identity/v3/projects/d47c3e61323f489c977cc4785142f555/groups/90fb1786a57043fd8943c5ea162b9294/roles/3ad609555dec437d92e5c7291b1c939a => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:15:07.431949 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a8fd8-2560-4637-a9e1-c5e43a5c21fa None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:07.469942 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c08c9a-0add-4a31-897b-7bd8a6abfcb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:07.471193 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c08c9a-0add-4a31-897b-7bd8a6abfcb0 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:07.471775 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c08c9a-0add-4a31-897b-7bd8a6abfcb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:07.472276 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c08c9a-0add-4a31-897b-7bd8a6abfcb0 None admin] PATH_INFO: `/v3/projects/0180b37d7e6843eaa90e0d081ade9da8` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:07.473690 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c08c9a-0add-4a31-897b-7bd8a6abfcb0 None admin] RBAC: Authorizing `identity:get_project(project_id=0180b37d7e6843eaa90e0d081ade9da8)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:07.475354 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c08c9a-0add-4a31-897b-7bd8a6abfcb0 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:07.477895 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 210/421] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:15:07 2022] GET /identity/v3/projects/0180b37d7e6843eaa90e0d081ade9da8 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:07.483914 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f307a45d-8ea2-4f9a-af24-93ebd670bd40 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:07.504595 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:07.618951 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f307a45d-8ea2-4f9a-af24-93ebd670bd40 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:07.671607 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a67afc-8f7b-4d58-84fe-f8046eb19534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:07.672483 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a67afc-8f7b-4d58-84fe-f8046eb19534 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:07.672771 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a67afc-8f7b-4d58-84fe-f8046eb19534 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:07.673050 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a67afc-8f7b-4d58-84fe-f8046eb19534 None admin] PATH_INFO: `/v3/groups/90fb1786a57043fd8943c5ea162b9294` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:07.674242 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a67afc-8f7b-4d58-84fe-f8046eb19534 None admin] RBAC: Authorizing `identity:get_group(group_id=90fb1786a57043fd8943c5ea162b9294)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:07.675763 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a67afc-8f7b-4d58-84fe-f8046eb19534 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:07.677949 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 212/422] 10.222.0.60 () {56 vars in 1180 bytes} [Thu Jul 21 19:15:07 2022] GET /identity/v3/groups/90fb1786a57043fd8943c5ea162b9294 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:07.683365 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c08c9a-0add-4a31-897b-7bd8a6abfcb0 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:07.771948 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:07.834340 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c08c9a-0add-4a31-897b-7bd8a6abfcb0 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:07.882985 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff97db5-a0b2-44fa-b07b-e5a73409fd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:07.884028 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff97db5-a0b2-44fa-b07b-e5a73409fd94 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:07.884511 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff97db5-a0b2-44fa-b07b-e5a73409fd94 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:07.885020 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff97db5-a0b2-44fa-b07b-e5a73409fd94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:07.886051 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff97db5-a0b2-44fa-b07b-e5a73409fd94 None admin] RBAC: Adding query filter params (group.id=90fb1786a57043fd8943c5ea162b9294, role.id=0af30c087b3541a4847d708dd68464d6, scope.project.id=0180b37d7e6843eaa90e0d081ade9da8) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:07.886553 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff97db5-a0b2-44fa-b07b-e5a73409fd94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:07.888195 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff97db5-a0b2-44fa-b07b-e5a73409fd94 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:07.895297 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 211/423] 10.222.0.60 () {56 vars in 1376 bytes} [Thu Jul 21 19:15:07 2022] GET /identity/v3/role_assignments?group.id=90fb1786a57043fd8943c5ea162b9294&scope.project.id=0180b37d7e6843eaa90e0d081ade9da8&role.id=0af30c087b3541a4847d708dd68464d6 => generated 611 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:08.168621 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179abe2a-a4bf-4535-abdd-b9606bc9b01f None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:08.169140 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179abe2a-a4bf-4535-abdd-b9606bc9b01f None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:08.169223 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179abe2a-a4bf-4535-abdd-b9606bc9b01f None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:08.170529 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 213/424] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:08.175836 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd20ac-4623-457d-ae67-653a85a398af None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:08.176269 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd20ac-4623-457d-ae67-653a85a398af None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:08.179674 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd20ac-4623-457d-ae67-653a85a398af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:08.181087 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b8a1f-7591-408d-8e64-ae9dde792c22 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:08.181376 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b8a1f-7591-408d-8e64-ae9dde792c22 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:08.181653 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b8a1f-7591-408d-8e64-ae9dde792c22 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:08.183204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 214/425] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:08.191618 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28e310-cf06-4266-8a46-7dda12403f14 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:08.191908 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28e310-cf06-4266-8a46-7dda12403f14 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:08.192216 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28e310-cf06-4266-8a46-7dda12403f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:08.202770 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-18fd20ac-4623-457d-ae67-653a85a398af None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:08.204343 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-18fd20ac-4623-457d-ae67-653a85a398af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:08.214775 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-1c28e310-cf06-4266-8a46-7dda12403f14 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:08.216156 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-1c28e310-cf06-4266-8a46-7dda12403f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:08.298223 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 212/426] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:15:08.312486 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 215/427] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 19:15:08.326507 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd20ac-4623-457d-ae67-653a85a398af None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:08.341664 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c28e310-cf06-4266-8a46-7dda12403f14 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:08.368725 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:08.394762 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:08.461648 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd20ac-4623-457d-ae67-653a85a398af None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:08.485770 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c28e310-cf06-4266-8a46-7dda12403f14 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:08.501755 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341d3eb-8699-4952-8fbb-a28a3465febf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:08.502884 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341d3eb-8699-4952-8fbb-a28a3465febf None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:08.503421 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341d3eb-8699-4952-8fbb-a28a3465febf None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:08.503926 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341d3eb-8699-4952-8fbb-a28a3465febf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:08.520301 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8341d3eb-8699-4952-8fbb-a28a3465febf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:15:08.528529 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-8341d3eb-8699-4952-8fbb-a28a3465febf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 19:15:08.528529 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:08.528529 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:08.528529 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:08.528529 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:08.528529 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:08.528529 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:08.528529 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:08.528529 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:08.528529 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:08.528529 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:08.528529 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:08.528529 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:15:08.528529 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:15:08.528529 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:15:08.528529 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:15:08.529403 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:15:08.529403 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:15:08.529403 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:15:08.529403 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:15:08.529403 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:08.529403 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:08.529403 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:08.529403 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:08.529403 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:08.529403 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:08.529403 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:08.529403 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:08.529403 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:08.529403 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:08.529403 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:08.529403 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:08.530218 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:08.530218 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:08.530218 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:08.530218 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:08.530218 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:15:08.530218 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:15:08.530218 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:15:08.530218 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:15:08.530218 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:15:08.530218 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:15:08.530218 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 19:15:08.530218 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:08.530218 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 213/428] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:15:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:08.536336 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341d3eb-8699-4952-8fbb-a28a3465febf None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:08.545981 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d972224-d3d8-4abe-8a03-0d13335e6d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:08.547230 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d972224-d3d8-4abe-8a03-0d13335e6d3e None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:08.547744 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d972224-d3d8-4abe-8a03-0d13335e6d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:08.548226 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d972224-d3d8-4abe-8a03-0d13335e6d3e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:08.569846 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d972224-d3d8-4abe-8a03-0d13335e6d3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:15:08.580334 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-1d972224-d3d8-4abe-8a03-0d13335e6d3e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 19:15:08.580334 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:08.580334 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:08.580334 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:08.580334 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:08.580334 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:08.580334 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:08.580334 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:08.580334 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:08.580334 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:08.580334 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:08.580334 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:08.580334 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:15:08.580334 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:15:08.580334 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:15:08.580334 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:15:08.581261 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:15:08.581261 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:15:08.581261 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:15:08.581261 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:15:08.581261 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:08.581261 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:08.581261 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:08.581261 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:08.581261 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:08.581261 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:08.581261 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:08.581261 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:08.581261 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:08.581261 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:08.581261 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:08.581261 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:08.582088 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:08.582088 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:08.582088 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:08.582088 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:08.582088 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:15:08.582088 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:15:08.582088 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:15:08.582088 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:15:08.582088 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:15:08.582088 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:15:08.582088 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 19:15:08.582088 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:08.585004 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 216/429] 10.222.0.60 () {56 vars in 1114 bytes} [Thu Jul 21 19:15:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:15:08.591349 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d972224-d3d8-4abe-8a03-0d13335e6d3e None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:08.637433 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341d3eb-8699-4952-8fbb-a28a3465febf None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:08.646440 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:08.674232 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de488507-4ff7-4dbe-9c43-6c09da1a16bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:08.675381 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de488507-4ff7-4dbe-9c43-6c09da1a16bd None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:08.675713 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de488507-4ff7-4dbe-9c43-6c09da1a16bd None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:08.675995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de488507-4ff7-4dbe-9c43-6c09da1a16bd None admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:08.676806 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de488507-4ff7-4dbe-9c43-6c09da1a16bd None admin] RBAC: Adding query filter params (name=member) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:08.677120 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de488507-4ff7-4dbe-9c43-6c09da1a16bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:08.679232 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de488507-4ff7-4dbe-9c43-6c09da1a16bd None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:08.688594 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:08.690224 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 214/430] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Jul 21 19:15:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:15:08.698163 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de488507-4ff7-4dbe-9c43-6c09da1a16bd None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:08.733511 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d972224-d3d8-4abe-8a03-0d13335e6d3e None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:08.777307 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b51c58-4b9e-46aa-a282-24ef0cf8a162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:08.778392 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b51c58-4b9e-46aa-a282-24ef0cf8a162 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:08.779000 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b51c58-4b9e-46aa-a282-24ef0cf8a162 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:08.779511 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b51c58-4b9e-46aa-a282-24ef0cf8a162 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:08.780531 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b51c58-4b9e-46aa-a282-24ef0cf8a162 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:08.781109 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b51c58-4b9e-46aa-a282-24ef0cf8a162 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:08.782960 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b51c58-4b9e-46aa-a282-24ef0cf8a162 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:08.794010 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 217/431] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:15:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:15:08.800928 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b51c58-4b9e-46aa-a282-24ef0cf8a162 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:08.801307 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de488507-4ff7-4dbe-9c43-6c09da1a16bd None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:08.839033 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de4c5d-ec37-4d47-9d80-2efd67c4124c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:08.839717 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de4c5d-ec37-4d47-9d80-2efd67c4124c None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:08.840048 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de4c5d-ec37-4d47-9d80-2efd67c4124c None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:08.840272 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de4c5d-ec37-4d47-9d80-2efd67c4124c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:08.885115 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:08.913813 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6de4c5d-ec37-4d47-9d80-2efd67c4124c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:08.915287 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6de4c5d-ec37-4d47-9d80-2efd67c4124c None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:08.922884 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b51c58-4b9e-46aa-a282-24ef0cf8a162 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:08.964262 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b56a5-28a5-4e33-94af-501836de6797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:08.966019 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b56a5-28a5-4e33-94af-501836de6797 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:08.966607 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b56a5-28a5-4e33-94af-501836de6797 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:08.967348 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b56a5-28a5-4e33-94af-501836de6797 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:08.972459 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:09.034668 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 215/432] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:15:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 19:15:09.040057 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de4c5d-ec37-4d47-9d80-2efd67c4124c None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:09.064907 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b56a5-28a5-4e33-94af-501836de6797 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:09.066439 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b56a5-28a5-4e33-94af-501836de6797 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:09.114353 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:09.152128 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de4c5d-ec37-4d47-9d80-2efd67c4124c None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:09.174366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 218/433] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:15:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 19:15:09.175426 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b56a5-28a5-4e33-94af-501836de6797 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:09.195962 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c211c-0532-4a34-8cd0-92239c4771bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:09.197560 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c211c-0532-4a34-8cd0-92239c4771bf None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:09.198227 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c211c-0532-4a34-8cd0-92239c4771bf None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:09.198698 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c211c-0532-4a34-8cd0-92239c4771bf None admin] PATH_INFO: `/v3/projects/d47c3e61323f489c977cc4785142f555` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:09.200227 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c211c-0532-4a34-8cd0-92239c4771bf None admin] RBAC: Authorizing `identity:get_project(project_id=d47c3e61323f489c977cc4785142f555)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:09.202353 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c211c-0532-4a34-8cd0-92239c4771bf None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:09.204662 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 216/434] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:15:09 2022] GET /identity/v3/projects/d47c3e61323f489c977cc4785142f555 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:15:09.209817 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c211c-0532-4a34-8cd0-92239c4771bf None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:09.215853 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:09.283993 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b56a5-28a5-4e33-94af-501836de6797 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:09.320185 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106aa6dd-93a2-486e-9d2c-70b1f9af57ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:09.321086 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106aa6dd-93a2-486e-9d2c-70b1f9af57ac None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:09.321514 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106aa6dd-93a2-486e-9d2c-70b1f9af57ac None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:09.321758 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106aa6dd-93a2-486e-9d2c-70b1f9af57ac None admin] PATH_INFO: `/v3/projects/0180b37d7e6843eaa90e0d081ade9da8` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:09.322873 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106aa6dd-93a2-486e-9d2c-70b1f9af57ac None admin] RBAC: Authorizing `identity:get_project(project_id=0180b37d7e6843eaa90e0d081ade9da8)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:09.323605 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c211c-0532-4a34-8cd0-92239c4771bf None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:09.324347 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106aa6dd-93a2-486e-9d2c-70b1f9af57ac None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:09.326531 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 219/435] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:15:09 2022] GET /identity/v3/projects/0180b37d7e6843eaa90e0d081ade9da8 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:09.327191 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f5a56-9f93-4c84-a8d7-1e5afa604961 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:09.327648 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f5a56-9f93-4c84-a8d7-1e5afa604961 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:09.327748 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f5a56-9f93-4c84-a8d7-1e5afa604961 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:09.331428 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 220/436] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:09.331428 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f5a56-9f93-4c84-a8d7-1e5afa604961 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:09.361994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ef2ce-0b17-4e44-b5ab-ffa4c60d50c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:09.362851 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ef2ce-0b17-4e44-b5ab-ffa4c60d50c5 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:09.363135 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ef2ce-0b17-4e44-b5ab-ffa4c60d50c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:09.363412 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ef2ce-0b17-4e44-b5ab-ffa4c60d50c5 None admin] PATH_INFO: `/v3/groups/90fb1786a57043fd8943c5ea162b9294` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:09.364608 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ef2ce-0b17-4e44-b5ab-ffa4c60d50c5 None admin] RBAC: Authorizing `identity:get_group(group_id=90fb1786a57043fd8943c5ea162b9294)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:09.366033 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ef2ce-0b17-4e44-b5ab-ffa4c60d50c5 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:09.373124 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 217/437] 10.222.0.60 () {56 vars in 1180 bytes} [Thu Jul 21 19:15:09 2022] GET /identity/v3/groups/90fb1786a57043fd8943c5ea162b9294 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:09.373124 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db107807-7ac8-4bd6-a44d-5b4f61aefc1f None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:09.373124 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db107807-7ac8-4bd6-a44d-5b4f61aefc1f None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:09.373124 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db107807-7ac8-4bd6-a44d-5b4f61aefc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:09.384689 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:09.390089 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-db107807-7ac8-4bd6-a44d-5b4f61aefc1f None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:09.391390 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-db107807-7ac8-4bd6-a44d-5b4f61aefc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:09.450069 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f5a56-9f93-4c84-a8d7-1e5afa604961 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:09.452476 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:09.474317 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 218/438] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:15:09.475737 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db107807-7ac8-4bd6-a44d-5b4f61aefc1f None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:09.485564 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89da856-45ad-46ab-9cc3-e3eee854d129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:09.486663 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89da856-45ad-46ab-9cc3-e3eee854d129 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:09.487103 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89da856-45ad-46ab-9cc3-e3eee854d129 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:09.487381 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89da856-45ad-46ab-9cc3-e3eee854d129 None admin] PATH_INFO: `/v3/groups/90fb1786a57043fd8943c5ea162b9294` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:09.488745 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89da856-45ad-46ab-9cc3-e3eee854d129 None admin] RBAC: Authorizing `identity:get_group(group_id=90fb1786a57043fd8943c5ea162b9294)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:09.490199 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89da856-45ad-46ab-9cc3-e3eee854d129 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:09.497817 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 221/439] 10.222.0.60 () {56 vars in 1180 bytes} [Thu Jul 21 19:15:09 2022] GET /identity/v3/groups/90fb1786a57043fd8943c5ea162b9294 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:09.499573 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89da856-45ad-46ab-9cc3-e3eee854d129 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:09.598173 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db107807-7ac8-4bd6-a44d-5b4f61aefc1f None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:09.605669 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89da856-45ad-46ab-9cc3-e3eee854d129 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:09.632462 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48591148-5b66-4870-a92d-5f7f92e47d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:09.633113 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48591148-5b66-4870-a92d-5f7f92e47d25 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:09.633393 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48591148-5b66-4870-a92d-5f7f92e47d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:09.633664 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48591148-5b66-4870-a92d-5f7f92e47d25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:09.634488 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48591148-5b66-4870-a92d-5f7f92e47d25 None admin] RBAC: Adding query filter params (group.id=90fb1786a57043fd8943c5ea162b9294, role.id=0af30c087b3541a4847d708dd68464d6, scope.project.id=d47c3e61323f489c977cc4785142f555) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:09.634801 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48591148-5b66-4870-a92d-5f7f92e47d25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:09.636248 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48591148-5b66-4870-a92d-5f7f92e47d25 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:09.638987 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:09.642275 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 219/440] 10.222.0.60 () {56 vars in 1376 bytes} [Thu Jul 21 19:15:09 2022] GET /identity/v3/role_assignments?group.id=90fb1786a57043fd8943c5ea162b9294&scope.project.id=d47c3e61323f489c977cc4785142f555&role.id=0af30c087b3541a4847d708dd68464d6 => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:09.643100 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48591148-5b66-4870-a92d-5f7f92e47d25 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:09.658195 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a07c40-be4d-438a-9c70-d5ef58e3b777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:09.658886 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a07c40-be4d-438a-9c70-d5ef58e3b777 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:09.659161 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a07c40-be4d-438a-9c70-d5ef58e3b777 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:09.659459 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a07c40-be4d-438a-9c70-d5ef58e3b777 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:09.660339 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a07c40-be4d-438a-9c70-d5ef58e3b777 None admin] RBAC: Adding query filter params (group.id=90fb1786a57043fd8943c5ea162b9294, role.id=3ad609555dec437d92e5c7291b1c939a, scope.project.id=0180b37d7e6843eaa90e0d081ade9da8) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:09.660652 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a07c40-be4d-438a-9c70-d5ef58e3b777 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:09.662222 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a07c40-be4d-438a-9c70-d5ef58e3b777 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:09.675940 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 222/441] 10.222.0.60 () {56 vars in 1376 bytes} [Thu Jul 21 19:15:09 2022] GET /identity/v3/role_assignments?group.id=90fb1786a57043fd8943c5ea162b9294&scope.project.id=0180b37d7e6843eaa90e0d081ade9da8&role.id=3ad609555dec437d92e5c7291b1c939a => generated 611 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:09.768841 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48591148-5b66-4870-a92d-5f7f92e47d25 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:09.810719 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b088028-e281-4836-bfd3-92f7e84dd3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:09.811931 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b088028-e281-4836-bfd3-92f7e84dd3f0 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:09.812405 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b088028-e281-4836-bfd3-92f7e84dd3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:09.812852 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b088028-e281-4836-bfd3-92f7e84dd3f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:09.825901 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b088028-e281-4836-bfd3-92f7e84dd3f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:15:09.834073 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-2b088028-e281-4836-bfd3-92f7e84dd3f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:15:09.834073 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:09.834073 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:09.834073 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:09.834073 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:09.834073 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:09.834073 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:09.834073 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:09.834073 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:09.834073 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:09.834073 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:09.834073 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:09.834073 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:15:09.834073 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:15:09.834073 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:15:09.834073 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:15:09.835081 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:15:09.835081 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:15:09.835081 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:15:09.835081 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:15:09.835081 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:09.835081 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:09.835081 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:09.835081 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:09.835081 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:09.835081 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:09.835081 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:09.835081 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:09.835081 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:09.835081 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:09.835081 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:09.835081 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:09.836692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:09.836692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:09.836692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:09.836692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:09.836692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:15:09.836692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:15:09.836692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:15:09.836692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:15:09.836692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:15:09.836692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:15:09.836692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:15:09.836692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:09.839175 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 220/442] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Jul 21 19:15:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:09.842426 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a868a-e58f-4008-8431-2e4a7f1fd027 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:09.842426 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a868a-e58f-4008-8431-2e4a7f1fd027 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:09.842426 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a868a-e58f-4008-8431-2e4a7f1fd027 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:09.843220 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 223/443] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:09.845645 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b088028-e281-4836-bfd3-92f7e84dd3f0 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:09.850712 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b374fa-a79a-47a6-94e2-ba1c6d2a7b07 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:09.851011 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b374fa-a79a-47a6-94e2-ba1c6d2a7b07 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:09.851294 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b374fa-a79a-47a6-94e2-ba1c6d2a7b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:09.878579 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-d4b374fa-a79a-47a6-94e2-ba1c6d2a7b07 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:09.879846 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-d4b374fa-a79a-47a6-94e2-ba1c6d2a7b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:09.916377 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:09.921055 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:09.964004 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b088028-e281-4836-bfd3-92f7e84dd3f0 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:09.964659 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 224/444] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:15:09.988705 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b374fa-a79a-47a6-94e2-ba1c6d2a7b07 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:10.001455 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1b2cc-725c-42e0-94b3-5b4f0b9e8858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:10.003003 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1b2cc-725c-42e0-94b3-5b4f0b9e8858 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:10.003003 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1b2cc-725c-42e0-94b3-5b4f0b9e8858 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:10.003003 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1b2cc-725c-42e0-94b3-5b4f0b9e8858 None admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:10.003420 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1b2cc-725c-42e0-94b3-5b4f0b9e8858 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:10.003868 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1b2cc-725c-42e0-94b3-5b4f0b9e8858 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:10.005260 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1b2cc-725c-42e0-94b3-5b4f0b9e8858 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:10.014714 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 221/445] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:15:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:10.020870 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1b2cc-725c-42e0-94b3-5b4f0b9e8858 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:10.103049 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b374fa-a79a-47a6-94e2-ba1c6d2a7b07 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:10.141291 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15582fb3-d25c-48f8-a25d-e8d9b25cdd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:10.142096 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15582fb3-d25c-48f8-a25d-e8d9b25cdd37 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:10.142658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15582fb3-d25c-48f8-a25d-e8d9b25cdd37 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:10.142658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15582fb3-d25c-48f8-a25d-e8d9b25cdd37 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:10.143121 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1b2cc-725c-42e0-94b3-5b4f0b9e8858 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:10.153540 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15582fb3-d25c-48f8-a25d-e8d9b25cdd37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:15:10.163210 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-15582fb3-d25c-48f8-a25d-e8d9b25cdd37 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 19:15:10.163210 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:10.163210 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:10.163210 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:10.163210 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:10.163210 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:10.163210 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:10.163210 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:10.163210 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:10.163210 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:10.163210 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:10.163210 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:10.163210 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:15:10.163210 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:15:10.163210 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:15:10.163210 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:15:10.164227 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:15:10.164227 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:15:10.164227 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:15:10.164227 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:15:10.164227 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:10.164227 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:10.164227 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:10.164227 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:10.164227 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:10.164227 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:10.164227 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:10.164227 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:10.164227 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:10.164227 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:10.164227 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:10.164227 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:10.165445 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:10.165445 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:10.165445 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:10.165445 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:10.165445 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:15:10.165445 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:15:10.165445 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:15:10.165445 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:15:10.165445 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:15:10.165445 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:15:10.165445 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 19:15:10.165445 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:10.165445 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 225/446] 10.222.0.60 () {56 vars in 1114 bytes} [Thu Jul 21 19:15:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:15:10.170981 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15582fb3-d25c-48f8-a25d-e8d9b25cdd37 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:10.173692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:10.187051 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb150b-b138-4c63-89f1-f73d327e81b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:10.187771 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb150b-b138-4c63-89f1-f73d327e81b8 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:10.188052 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb150b-b138-4c63-89f1-f73d327e81b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:10.188593 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb150b-b138-4c63-89f1-f73d327e81b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:10.203937 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:10.265477 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb150b-b138-4c63-89f1-f73d327e81b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:10.266951 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb150b-b138-4c63-89f1-f73d327e81b8 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:10.279899 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15582fb3-d25c-48f8-a25d-e8d9b25cdd37 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:10.313194 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aace604d-bda6-475f-b3f0-d94f31f6515b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:10.313852 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace604d-bda6-475f-b3f0-d94f31f6515b None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:10.314133 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace604d-bda6-475f-b3f0-d94f31f6515b None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:10.314409 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace604d-bda6-475f-b3f0-d94f31f6515b None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:10.315144 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aace604d-bda6-475f-b3f0-d94f31f6515b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:10.315467 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aace604d-bda6-475f-b3f0-d94f31f6515b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:10.316834 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aace604d-bda6-475f-b3f0-d94f31f6515b None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:10.325152 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 226/447] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:15:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:15:10.330825 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aace604d-bda6-475f-b3f0-d94f31f6515b None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:10.363871 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 222/448] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:15:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 19:15:10.373492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb150b-b138-4c63-89f1-f73d327e81b8 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:10.395989 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:10.420181 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:10.435931 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aace604d-bda6-475f-b3f0-d94f31f6515b None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:10.468799 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce8825-5bbe-473b-a3db-a8e8a4199f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:10.469439 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce8825-5bbe-473b-a3db-a8e8a4199f3e None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:10.469721 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce8825-5bbe-473b-a3db-a8e8a4199f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:10.469999 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce8825-5bbe-473b-a3db-a8e8a4199f3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:10.480833 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb150b-b138-4c63-89f1-f73d327e81b8 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:10.513938 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6d501-d881-4a70-b723-5e7b1a88ba24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:10.514803 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6d501-d881-4a70-b723-5e7b1a88ba24 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:10.515090 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6d501-d881-4a70-b723-5e7b1a88ba24 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:10.515368 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6d501-d881-4a70-b723-5e7b1a88ba24 None admin] PATH_INFO: `/v3/projects/c15ec98f010f4039a43acd913bc93061` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:10.516649 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f6d501-d881-4a70-b723-5e7b1a88ba24 None admin] RBAC: Authorizing `identity:get_project(project_id=c15ec98f010f4039a43acd913bc93061)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:10.518139 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f6d501-d881-4a70-b723-5e7b1a88ba24 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:10.519920 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 223/449] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:15:10 2022] GET /identity/v3/projects/c15ec98f010f4039a43acd913bc93061 => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:10.526129 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6d501-d881-4a70-b723-5e7b1a88ba24 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:10.539664 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce8825-5bbe-473b-a3db-a8e8a4199f3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:10.541071 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce8825-5bbe-473b-a3db-a8e8a4199f3e None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:10.613571 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:10.623704 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6d501-d881-4a70-b723-5e7b1a88ba24 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:10.626516 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:10.639046 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 227/450] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:15:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 19:15:10.644569 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce8825-5bbe-473b-a3db-a8e8a4199f3e None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:10.657395 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546e9a6-8b1f-44fa-9a50-53fa2a829a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:10.658252 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546e9a6-8b1f-44fa-9a50-53fa2a829a56 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:10.658538 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546e9a6-8b1f-44fa-9a50-53fa2a829a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:10.658818 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546e9a6-8b1f-44fa-9a50-53fa2a829a56 None admin] PATH_INFO: `/v3/groups/3f143b68458a448d94a866989ddc951f` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:10.660008 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e546e9a6-8b1f-44fa-9a50-53fa2a829a56 None admin] RBAC: Authorizing `identity:get_group(group_id=3f143b68458a448d94a866989ddc951f)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:10.661490 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e546e9a6-8b1f-44fa-9a50-53fa2a829a56 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:10.668341 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 224/451] 10.222.0.60 () {56 vars in 1180 bytes} [Thu Jul 21 19:15:10 2022] GET /identity/v3/groups/3f143b68458a448d94a866989ddc951f => generated 229 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:15:10.669366 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546e9a6-8b1f-44fa-9a50-53fa2a829a56 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:10.743241 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce8825-5bbe-473b-a3db-a8e8a4199f3e None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:10.766096 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546e9a6-8b1f-44fa-9a50-53fa2a829a56 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:10.777008 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437d6fb-0e0a-4d53-9ae2-695f666d7b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:10.777857 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437d6fb-0e0a-4d53-9ae2-695f666d7b99 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:10.778146 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437d6fb-0e0a-4d53-9ae2-695f666d7b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:10.778418 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437d6fb-0e0a-4d53-9ae2-695f666d7b99 None admin] PATH_INFO: `/v3/projects/d47c3e61323f489c977cc4785142f555` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:10.779637 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3437d6fb-0e0a-4d53-9ae2-695f666d7b99 None admin] RBAC: Authorizing `identity:get_project(project_id=d47c3e61323f489c977cc4785142f555)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:10.781085 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3437d6fb-0e0a-4d53-9ae2-695f666d7b99 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:10.782748 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 228/452] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:15:10 2022] GET /identity/v3/projects/d47c3e61323f489c977cc4785142f555 => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:15:10.788973 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437d6fb-0e0a-4d53-9ae2-695f666d7b99 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:10.799206 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245ea6c-3596-4ed6-bb5d-2bfed0e41024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:10.799827 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245ea6c-3596-4ed6-bb5d-2bfed0e41024 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:10.800111 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245ea6c-3596-4ed6-bb5d-2bfed0e41024 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:10.800385 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245ea6c-3596-4ed6-bb5d-2bfed0e41024 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:10.801211 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a245ea6c-3596-4ed6-bb5d-2bfed0e41024 None admin] RBAC: Adding query filter params (group.id=3f143b68458a448d94a866989ddc951f, role.id=685e18230e1744c581baaf842d0fd4ca, scope.project.id=c15ec98f010f4039a43acd913bc93061) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:10.801514 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a245ea6c-3596-4ed6-bb5d-2bfed0e41024 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:10.803183 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a245ea6c-3596-4ed6-bb5d-2bfed0e41024 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:10.809031 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 225/453] 10.222.0.60 () {56 vars in 1376 bytes} [Thu Jul 21 19:15:10 2022] GET /identity/v3/role_assignments?group.id=3f143b68458a448d94a866989ddc951f&scope.project.id=c15ec98f010f4039a43acd913bc93061&role.id=685e18230e1744c581baaf842d0fd4ca => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:10.856170 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:10.903545 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437d6fb-0e0a-4d53-9ae2-695f666d7b99 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:10.939225 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f135f-8f14-46b2-b1c0-ed15a5b1f0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:10.940133 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f135f-8f14-46b2-b1c0-ed15a5b1f0a9 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:10.940422 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f135f-8f14-46b2-b1c0-ed15a5b1f0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:10.940699 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f135f-8f14-46b2-b1c0-ed15a5b1f0a9 None admin] PATH_INFO: `/v3/groups/90fb1786a57043fd8943c5ea162b9294` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:10.941926 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f135f-8f14-46b2-b1c0-ed15a5b1f0a9 None admin] RBAC: Authorizing `identity:get_group(group_id=90fb1786a57043fd8943c5ea162b9294)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:10.943402 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f135f-8f14-46b2-b1c0-ed15a5b1f0a9 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:10.945813 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 229/454] 10.222.0.60 () {56 vars in 1180 bytes} [Thu Jul 21 19:15:10 2022] GET /identity/v3/groups/90fb1786a57043fd8943c5ea162b9294 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:15:10.951823 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245ea6c-3596-4ed6-bb5d-2bfed0e41024 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:10.979686 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:11.054535 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245ea6c-3596-4ed6-bb5d-2bfed0e41024 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:11.086320 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbebc237-de3d-4080-8660-f3901252658b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:11.086956 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebc237-de3d-4080-8660-f3901252658b None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:11.087239 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebc237-de3d-4080-8660-f3901252658b None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:11.087546 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebc237-de3d-4080-8660-f3901252658b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:11.088362 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbebc237-de3d-4080-8660-f3901252658b None admin] RBAC: Adding query filter params (group.id=90fb1786a57043fd8943c5ea162b9294, role.id=3ad609555dec437d92e5c7291b1c939a, scope.project.id=d47c3e61323f489c977cc4785142f555) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:11.088668 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbebc237-de3d-4080-8660-f3901252658b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:11.090102 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbebc237-de3d-4080-8660-f3901252658b None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:11.095623 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 226/455] 10.222.0.60 () {56 vars in 1376 bytes} [Thu Jul 21 19:15:10 2022] GET /identity/v3/role_assignments?group.id=90fb1786a57043fd8943c5ea162b9294&scope.project.id=d47c3e61323f489c977cc4785142f555&role.id=3ad609555dec437d92e5c7291b1c939a => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:13.625880 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e3541-8279-41ec-876a-7f1adb64a327 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:13.626727 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e3541-8279-41ec-876a-7f1adb64a327 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:13.627184 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e3541-8279-41ec-876a-7f1adb64a327 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:13.628990 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 230/456] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:13.634691 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72798c81-e428-4f0e-b87e-0f3f93685c1a None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:13.635493 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72798c81-e428-4f0e-b87e-0f3f93685c1a None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:13.635924 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72798c81-e428-4f0e-b87e-0f3f93685c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:13.659655 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-72798c81-e428-4f0e-b87e-0f3f93685c1a None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:13.661114 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-72798c81-e428-4f0e-b87e-0f3f93685c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:13.755779 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 227/457] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:15:13.792158 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e3541-8279-41ec-876a-7f1adb64a327 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:13.913115 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e3541-8279-41ec-876a-7f1adb64a327 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:13.947993 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:13.961103 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798bae11-d4fc-44a1-8627-1821b6f79a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:13.961912 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798bae11-d4fc-44a1-8627-1821b6f79a28 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:13.962198 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798bae11-d4fc-44a1-8627-1821b6f79a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:13.962474 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798bae11-d4fc-44a1-8627-1821b6f79a28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:13.973149 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798bae11-d4fc-44a1-8627-1821b6f79a28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:13.975239 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798bae11-d4fc-44a1-8627-1821b6f79a28 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:13.993366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-798bae11-d4fc-44a1-8627-1821b6f79a28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:13.993366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:13.993366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:13.993366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:13.993366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:13.993366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:13.993366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:13.993366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:13.993366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:13.993366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:13.993366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:13.993366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:13.993366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:13.993366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:13.993366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:13.994286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:13.994286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:13.994286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:13.994286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:13.994286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:13.994286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:13.994286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:13.994286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:13.994286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:13.994286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:13.994286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:13.994286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:13.994286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:13.994286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:13.994286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:13.994286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:13.994286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:13.995121 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:13.995121 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:13.995121 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:13.995121 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:13.995121 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 231/458] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:14.001332 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72798c81-e428-4f0e-b87e-0f3f93685c1a None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:14.033768 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0c521-859f-4aa4-b066-a038b2baf86e None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:14.034447 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0c521-859f-4aa4-b066-a038b2baf86e None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:14.034920 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0c521-859f-4aa4-b066-a038b2baf86e None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:14.036755 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 232/459] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 19:15:14.042017 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffc035-3caa-4925-bf7f-b571c2fcdac7 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:14.042591 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffc035-3caa-4925-bf7f-b571c2fcdac7 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:14.043061 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffc035-3caa-4925-bf7f-b571c2fcdac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:14.056850 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:14.062309 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-91ffc035-3caa-4925-bf7f-b571c2fcdac7 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:14.063754 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-91ffc035-3caa-4925-bf7f-b571c2fcdac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:14.210498 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 233/460] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 19:15:14.212610 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6acde-35d0-4eb4-a335-523a172c68c4 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:14.213114 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6acde-35d0-4eb4-a335-523a172c68c4 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:14.213597 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6acde-35d0-4eb4-a335-523a172c68c4 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:14.215070 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 234/461] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:14.225601 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631745c3-586e-4f12-b427-6bd23db69cfe None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:14.226415 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631745c3-586e-4f12-b427-6bd23db69cfe None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:14.227822 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631745c3-586e-4f12-b427-6bd23db69cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:14.241673 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72798c81-e428-4f0e-b87e-0f3f93685c1a None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:14.254925 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-631745c3-586e-4f12-b427-6bd23db69cfe None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:14.256472 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-631745c3-586e-4f12-b427-6bd23db69cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:14.279004 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61485616-0bf4-4cb5-9134-6b3962b8dac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:14.279984 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61485616-0bf4-4cb5-9134-6b3962b8dac5 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:14.280481 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61485616-0bf4-4cb5-9134-6b3962b8dac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:14.280932 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61485616-0bf4-4cb5-9134-6b3962b8dac5 None admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:14.281959 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61485616-0bf4-4cb5-9134-6b3962b8dac5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:14.282445 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61485616-0bf4-4cb5-9134-6b3962b8dac5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:14.284077 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61485616-0bf4-4cb5-9134-6b3962b8dac5 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:14.300799 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 228/462] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:14.301964 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61485616-0bf4-4cb5-9134-6b3962b8dac5 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:14.331583 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 235/463] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:15:14.332619 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631745c3-586e-4f12-b427-6bd23db69cfe None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:14.370540 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:14.385993 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:14.409639 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61485616-0bf4-4cb5-9134-6b3962b8dac5 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:14.443296 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631745c3-586e-4f12-b427-6bd23db69cfe None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:14.447966 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2bdbfe-c727-47b0-8997-9b6a7472cade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:14.448766 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bdbfe-c727-47b0-8997-9b6a7472cade None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:14.449051 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bdbfe-c727-47b0-8997-9b6a7472cade None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:14.449323 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bdbfe-c727-47b0-8997-9b6a7472cade None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:14.460564 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2bdbfe-c727-47b0-8997-9b6a7472cade None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:14.462150 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2bdbfe-c727-47b0-8997-9b6a7472cade None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:14.479306 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-be2bdbfe-c727-47b0-8997-9b6a7472cade None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:14.479306 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:14.479306 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:14.479306 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:14.479306 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:14.479306 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:14.479306 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:14.479306 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:14.479306 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:14.479306 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:14.479306 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:14.479306 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:14.479306 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:14.479306 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:14.479306 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:14.480164 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:14.480164 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:14.480164 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:14.480164 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:14.480164 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:14.480164 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:14.480164 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:14.480164 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:14.480164 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:14.480164 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:14.480164 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:14.480164 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:14.480164 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:14.480164 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:14.480164 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:14.480164 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:14.480164 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:14.481071 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:14.481071 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:14.481071 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:14.481071 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:14.481071 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 229/464] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:14.481341 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2bdbfe-c727-47b0-8997-9b6a7472cade None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:14.482549 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a372aa-3eb6-48b0-a79c-e6db4103ae0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:14.483188 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a372aa-3eb6-48b0-a79c-e6db4103ae0b None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:14.483494 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a372aa-3eb6-48b0-a79c-e6db4103ae0b None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:14.483772 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a372aa-3eb6-48b0-a79c-e6db4103ae0b None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:14.484471 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a372aa-3eb6-48b0-a79c-e6db4103ae0b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:14.486280 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a372aa-3eb6-48b0-a79c-e6db4103ae0b None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:14.581520 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 236/465] 10.222.0.60 () {60 vars in 1132 bytes} [Thu Jul 21 19:15:14 2022] POST /identity/v3/users => generated 246 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:15:14.583262 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad2069-1822-4a62-a21b-908475c1ef2a None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:14.583696 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad2069-1822-4a62-a21b-908475c1ef2a None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:14.584526 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad2069-1822-4a62-a21b-908475c1ef2a None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:14.587232 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2bdbfe-c727-47b0-8997-9b6a7472cade None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:14.591167 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 237/466] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:14 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:14.593259 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad2069-1822-4a62-a21b-908475c1ef2a None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:14.625490 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:14.636333 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19d208-798a-4c9c-a1f1-bf138154c3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:14.637914 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19d208-798a-4c9c-a1f1-bf138154c3e7 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:14.638352 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19d208-798a-4c9c-a1f1-bf138154c3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:14.638779 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19d208-798a-4c9c-a1f1-bf138154c3e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:14.651469 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb19d208-798a-4c9c-a1f1-bf138154c3e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:14.653401 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb19d208-798a-4c9c-a1f1-bf138154c3e7 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:14.673603 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-fb19d208-798a-4c9c-a1f1-bf138154c3e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:14.673603 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:14.673603 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:14.673603 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:14.673603 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:14.673603 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:14.673603 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:14.673603 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:14.673603 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:14.673603 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:14.673603 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:14.673603 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:14.673603 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:14.673603 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:14.673603 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:14.674631 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:14.674631 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:14.674631 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:14.674631 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:14.674631 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:14.674631 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:14.674631 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:14.674631 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:14.674631 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:14.674631 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:14.674631 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:14.674631 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:14.674631 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:14.674631 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:14.674631 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:14.674631 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:14.674631 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:14.675701 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:14.675701 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:14.675701 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:14.675701 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:14.677375 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 230/467] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:14.679710 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8b4f0-3efe-4657-a7e3-3503cead516b None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:14.680261 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8b4f0-3efe-4657-a7e3-3503cead516b None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:14.680676 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8b4f0-3efe-4657-a7e3-3503cead516b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:14.699685 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-42f8b4f0-3efe-4657-a7e3-3503cead516b None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:14.701145 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-42f8b4f0-3efe-4657-a7e3-3503cead516b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:14.723879 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:14.736235 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad2069-1822-4a62-a21b-908475c1ef2a None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:14.776234 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b0ef9-540e-4b1a-8a8f-43f0b782aa26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:14.777175 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b0ef9-540e-4b1a-8a8f-43f0b782aa26 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:14.777572 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b0ef9-540e-4b1a-8a8f-43f0b782aa26 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:14.778020 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b0ef9-540e-4b1a-8a8f-43f0b782aa26 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:14.778831 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b0ef9-540e-4b1a-8a8f-43f0b782aa26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:14.779246 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b0ef9-540e-4b1a-8a8f-43f0b782aa26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:14.780058 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 231/468] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:15:14.780878 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b0ef9-540e-4b1a-8a8f-43f0b782aa26 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:14.781292 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f8b4f0-3efe-4657-a7e3-3503cead516b None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:14.797212 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 238/469] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:14.803220 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b0ef9-540e-4b1a-8a8f-43f0b782aa26 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:14.909909 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f8b4f0-3efe-4657-a7e3-3503cead516b None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:14.924984 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:14.932267 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b0ef9-540e-4b1a-8a8f-43f0b782aa26 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:14.951203 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3726ae15-4fff-4670-902f-89ba6f41a0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:14.952109 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726ae15-4fff-4670-902f-89ba6f41a0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:14.952545 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726ae15-4fff-4670-902f-89ba6f41a0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:14.952972 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726ae15-4fff-4670-902f-89ba6f41a0e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:14.953936 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3726ae15-4fff-4670-902f-89ba6f41a0e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:14.955777 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3726ae15-4fff-4670-902f-89ba6f41a0e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:14.957551 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3726ae15-4fff-4670-902f-89ba6f41a0e1 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:14.971493 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 232/470] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:14.972656 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3726ae15-4fff-4670-902f-89ba6f41a0e1 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:14.973042 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2af88-359c-49f9-bd5a-59fbc49fd2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:14.973711 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2af88-359c-49f9-bd5a-59fbc49fd2c7 None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:14.973994 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2af88-359c-49f9-bd5a-59fbc49fd2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:14.974285 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2af88-359c-49f9-bd5a-59fbc49fd2c7 None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:14.974964 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b2af88-359c-49f9-bd5a-59fbc49fd2c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:14.977486 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b2af88-359c-49f9-bd5a-59fbc49fd2c7 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:15.064595 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 239/471] 10.222.0.60 () {60 vars in 1132 bytes} [Thu Jul 21 19:15:14 2022] POST /identity/v3/users => generated 248 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:15:15.065627 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2af88-359c-49f9-bd5a-59fbc49fd2c7 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:15.082767 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:15.087192 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3726ae15-4fff-4670-902f-89ba6f41a0e1 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:15.146697 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889b0f8-cfa4-4330-9d0a-d9f54d0e82f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:15.148186 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889b0f8-cfa4-4330-9d0a-d9f54d0e82f0 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:15.148697 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889b0f8-cfa4-4330-9d0a-d9f54d0e82f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:15.149215 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889b0f8-cfa4-4330-9d0a-d9f54d0e82f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:15.168731 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d889b0f8-cfa4-4330-9d0a-d9f54d0e82f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:15.170225 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d889b0f8-cfa4-4330-9d0a-d9f54d0e82f0 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:15.192463 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-d889b0f8-cfa4-4330-9d0a-d9f54d0e82f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:15.192463 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:15.192463 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:15.192463 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:15.192463 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:15.192463 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:15.192463 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:15.192463 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:15.192463 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:15.192463 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:15.192463 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:15.192463 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:15.192463 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:15.192463 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:15.192463 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:15.193486 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:15.193486 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:15.193486 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:15.193486 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:15.193486 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:15.193486 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:15.193486 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:15.193486 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:15.193486 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:15.193486 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:15.193486 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:15.193486 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:15.193486 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:15.193486 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:15.193486 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:15.193486 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:15.193486 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:15.195018 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:15.195018 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:15.195018 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:15.195018 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:15.197654 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 233/472] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:15.199591 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad8051-dc02-4614-8055-f88be632ef0a None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:15.200215 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad8051-dc02-4614-8055-f88be632ef0a None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:15.200710 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad8051-dc02-4614-8055-f88be632ef0a None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:15.202563 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 234/473] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:15.204070 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad8051-dc02-4614-8055-f88be632ef0a None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:15.205352 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2af88-359c-49f9-bd5a-59fbc49fd2c7 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:15.245668 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:15.253844 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e6c2b-fa92-4533-ad0c-1edf8b6579c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:15.254659 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e6c2b-fa92-4533-ad0c-1edf8b6579c8 None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:15.255002 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e6c2b-fa92-4533-ad0c-1edf8b6579c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:15.255938 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e6c2b-fa92-4533-ad0c-1edf8b6579c8 None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:15.256292 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236e6c2b-fa92-4533-ad0c-1edf8b6579c8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:15.258592 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236e6c2b-fa92-4533-ad0c-1edf8b6579c8 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:15.336935 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad8051-dc02-4614-8055-f88be632ef0a None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:15.371695 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50eb697-c0b6-4038-af8f-c9ae20b8bdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:15.372360 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50eb697-c0b6-4038-af8f-c9ae20b8bdc1 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:15.372646 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50eb697-c0b6-4038-af8f-c9ae20b8bdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:15.372978 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50eb697-c0b6-4038-af8f-c9ae20b8bdc1 None admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:15.373705 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50eb697-c0b6-4038-af8f-c9ae20b8bdc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:15.374015 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50eb697-c0b6-4038-af8f-c9ae20b8bdc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:15.374236 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 240/474] 10.222.0.60 () {60 vars in 1132 bytes} [Thu Jul 21 19:15:15 2022] POST /identity/v3/users => generated 248 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:15:15.375401 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50eb697-c0b6-4038-af8f-c9ae20b8bdc1 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:15.379671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea801a-dc6b-4f8d-9b3a-1cbaf8629583 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:15.380025 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea801a-dc6b-4f8d-9b3a-1cbaf8629583 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:15.380308 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea801a-dc6b-4f8d-9b3a-1cbaf8629583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:15.404195 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 235/475] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:15.410152 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50eb697-c0b6-4038-af8f-c9ae20b8bdc1 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:15.424179 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-72ea801a-dc6b-4f8d-9b3a-1cbaf8629583 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:15.425399 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-72ea801a-dc6b-4f8d-9b3a-1cbaf8629583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:15.560448 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:15.567810 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:15.578746 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 241/476] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:15:15.580473 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50eb697-c0b6-4038-af8f-c9ae20b8bdc1 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:15.607269 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea801a-dc6b-4f8d-9b3a-1cbaf8629583 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:15.634014 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bec83f-d613-4b6f-a265-502d90b55e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:15.635238 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bec83f-d613-4b6f-a265-502d90b55e1b None admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:15.635880 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bec83f-d613-4b6f-a265-502d90b55e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:15.636347 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bec83f-d613-4b6f-a265-502d90b55e1b None admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:15.637801 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bec83f-d613-4b6f-a265-502d90b55e1b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:15.640669 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bec83f-d613-4b6f-a265-502d90b55e1b None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:15.726464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea801a-dc6b-4f8d-9b3a-1cbaf8629583 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:15.734733 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 236/477] 10.222.0.60 () {60 vars in 1132 bytes} [Thu Jul 21 19:15:15 2022] POST /identity/v3/users => generated 249 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:15:15.779476 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148b3b2-11a3-4f9e-88fe-f8d09f1dbed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:15.780489 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148b3b2-11a3-4f9e-88fe-f8d09f1dbed0 None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:15.780950 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148b3b2-11a3-4f9e-88fe-f8d09f1dbed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:15.781427 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148b3b2-11a3-4f9e-88fe-f8d09f1dbed0 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:15.782424 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5148b3b2-11a3-4f9e-88fe-f8d09f1dbed0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:15.784059 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5148b3b2-11a3-4f9e-88fe-f8d09f1dbed0 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:15.821269 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.sql.core [None req-5148b3b2-11a3-4f9e-88fe-f8d09f1dbed0 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 21 19:15:15.821269 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 21 19:15:15.821269 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [parameters: {'id': 'c553f869a21d497ea4e1ef67f67724d6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 21 19:15:15.821269 dv-cinder-749155-9-smb devstack@keystone.service[80338]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80338) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 21 19:15:15.842487 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-5148b3b2-11a3-4f9e-88fe-f8d09f1dbed0 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 21 19:15:15.842487 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:15.842487 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 19:15:15.842487 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 19:15:15.842487 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 19:15:15.842487 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 19:15:15.842487 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 19:15:15.842487 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 19:15:15.842487 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 19:15:15.842487 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application conn.query(q) Jul 21 19:15:15.842487 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 19:15:15.842487 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 19:15:15.842487 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 19:15:15.842487 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application result.read() Jul 21 19:15:15.842487 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 19:15:15.843469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 19:15:15.843469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 19:15:15.843469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 19:15:15.843469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 19:15:15.843469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 19:15:15.843469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 19:15:15.843469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 19:15:15.843469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 21 19:15:15.843469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:15.843469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 21 19:15:15.843469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:15.843469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:15.843469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 21 19:15:15.843469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 21 19:15:15.843469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 21 19:15:15.843469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return ref.to_dict() Jul 21 19:15:15.843469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 19:15:15.843469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application next(self.gen) Jul 21 19:15:15.844398 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 21 19:15:15.844398 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application yield resource Jul 21 19:15:15.844398 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 19:15:15.844398 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application next(self.gen) Jul 21 19:15:15.844398 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 21 19:15:15.844398 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self.session.rollback() Jul 21 19:15:15.844398 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 21 19:15:15.844398 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self.force_reraise() Jul 21 19:15:15.844398 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 21 19:15:15.844398 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise self.value Jul 21 19:15:15.844398 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 21 19:15:15.844398 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 21 19:15:15.844398 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 21 19:15:15.844398 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application session.commit() Jul 21 19:15:15.844398 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 21 19:15:15.844398 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 21 19:15:15.844398 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 21 19:15:15.845334 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._prepare_impl() Jul 21 19:15:15.845334 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 21 19:15:15.845334 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self.session.flush() Jul 21 19:15:15.845334 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 21 19:15:15.845334 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._flush(objects) Jul 21 19:15:15.845334 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 21 19:15:15.845334 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 21 19:15:15.845334 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 21 19:15:15.845334 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application compat.raise_( Jul 21 19:15:15.845334 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 19:15:15.845334 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception Jul 21 19:15:15.845334 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 21 19:15:15.845334 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application flush_context.execute() Jul 21 19:15:15.845334 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 21 19:15:15.845334 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rec.execute(self) Jul 21 19:15:15.845334 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 21 19:15:15.845334 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 21 19:15:15.846537 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 21 19:15:15.846537 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 21 19:15:15.846537 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 21 19:15:15.846537 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 21 19:15:15.846537 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 21 19:15:15.846537 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 21 19:15:15.846537 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 21 19:15:15.846537 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 21 19:15:15.846537 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 21 19:15:15.846537 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 21 19:15:15.846537 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 21 19:15:15.846537 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 21 19:15:15.846537 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 21 19:15:15.846537 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 21 19:15:15.846537 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 19:15:15.846537 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception Jul 21 19:15:15.848476 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 19:15:15.848476 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 19:15:15.848476 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 19:15:15.848476 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 19:15:15.848476 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 19:15:15.848476 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 19:15:15.848476 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 19:15:15.848476 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application conn.query(q) Jul 21 19:15:15.848476 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 19:15:15.848476 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 19:15:15.848476 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 19:15:15.848476 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application result.read() Jul 21 19:15:15.848476 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 19:15:15.848476 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 19:15:15.848476 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 19:15:15.848476 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 19:15:15.851020 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 19:15:15.851020 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 19:15:15.851020 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 19:15:15.851020 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 19:15:15.851020 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 21 19:15:15.851020 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 21 19:15:15.851020 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [parameters: {'id': 'c553f869a21d497ea4e1ef67f67724d6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 21 19:15:15.851020 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 21 19:15:15.851020 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:15.851020 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 19:15:15.851020 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:15.851020 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:15.851020 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:15.851020 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:15.851020 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:15.851020 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:15.853021 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:15.853021 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:15.853021 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:15.853021 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:15.853021 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:15.853021 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:15.853021 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 21 19:15:15.853021 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 21 19:15:15.853021 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:15.853021 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:15.853021 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 21 19:15:15.853021 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 21 19:15:15.853021 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 21 19:15:15.853021 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 21 19:15:15.853021 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 21 19:15:15.853021 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:15.857130 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 242/478] 10.222.0.60 () {60 vars in 1131 bytes} [Thu Jul 21 19:15:15 2022] POST /identity/v3/roles => generated 144 bytes in 250 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:15.863564 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bec83f-d613-4b6f-a265-502d90b55e1b None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:15.992215 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bec83f-d613-4b6f-a265-502d90b55e1b None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:16.031358 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3415c-571c-4d1b-973e-01b8fd3e12e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:16.032583 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3415c-571c-4d1b-973e-01b8fd3e12e5 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:16.033070 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3415c-571c-4d1b-973e-01b8fd3e12e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:16.033548 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3415c-571c-4d1b-973e-01b8fd3e12e5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:16.049650 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3415c-571c-4d1b-973e-01b8fd3e12e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:15:16.055270 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:16.063157 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-c8d3415c-571c-4d1b-973e-01b8fd3e12e5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 19:15:16.063157 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:16.063157 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:16.063157 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:16.063157 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:16.063157 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:16.063157 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:16.063157 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:16.063157 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:16.063157 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:16.063157 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:16.063157 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:16.063157 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:15:16.063157 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:15:16.063157 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:15:16.063157 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:15:16.065994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:15:16.065994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:15:16.065994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:15:16.065994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:15:16.065994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:16.065994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:16.065994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:16.065994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:16.065994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:16.065994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:16.065994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:16.065994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:16.065994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:16.065994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:16.065994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:16.065994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:16.066852 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:16.066852 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:16.066852 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:16.066852 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:16.066852 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:15:16.066852 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:15:16.066852 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:15:16.066852 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:15:16.066852 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:15:16.066852 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:15:16.066852 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 19:15:16.066852 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:16.066852 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 237/479] 10.222.0.60 () {56 vars in 1114 bytes} [Thu Jul 21 19:15:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:16.070621 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148b3b2-11a3-4f9e-88fe-f8d09f1dbed0 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:16.135324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:16.180821 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148b3b2-11a3-4f9e-88fe-f8d09f1dbed0 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:16.223019 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5052a10-97c6-44d1-a271-78debcb9a7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:16.224108 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5052a10-97c6-44d1-a271-78debcb9a7f3 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:16.224592 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5052a10-97c6-44d1-a271-78debcb9a7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:16.225063 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5052a10-97c6-44d1-a271-78debcb9a7f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:16.226592 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5052a10-97c6-44d1-a271-78debcb9a7f3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:16.231266 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5052a10-97c6-44d1-a271-78debcb9a7f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:16.233071 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5052a10-97c6-44d1-a271-78debcb9a7f3 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:16.243410 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 243/480] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:15:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:16.826437 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343136f9-c0dd-4d76-b2ba-46ff3e1dfbc0 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:16.826947 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343136f9-c0dd-4d76-b2ba-46ff3e1dfbc0 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:16.827022 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343136f9-c0dd-4d76-b2ba-46ff3e1dfbc0 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:16.828625 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 238/481] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:16.833813 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1236fa1-2cbd-40b8-82ca-2da0729ef068 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:16.834233 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1236fa1-2cbd-40b8-82ca-2da0729ef068 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:16.834402 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1236fa1-2cbd-40b8-82ca-2da0729ef068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:16.863562 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-a1236fa1-2cbd-40b8-82ca-2da0729ef068 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:16.864768 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-a1236fa1-2cbd-40b8-82ca-2da0729ef068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:16.947748 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 244/482] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:15:16.985456 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343136f9-c0dd-4d76-b2ba-46ff3e1dfbc0 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:17.130641 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343136f9-c0dd-4d76-b2ba-46ff3e1dfbc0 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:17.173381 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e81f414-96e5-4525-ad93-b8a97d24780f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:17.174184 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81f414-96e5-4525-ad93-b8a97d24780f None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:17.174474 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81f414-96e5-4525-ad93-b8a97d24780f None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:17.174751 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81f414-96e5-4525-ad93-b8a97d24780f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:17.185232 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e81f414-96e5-4525-ad93-b8a97d24780f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:15:17.192905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-2e81f414-96e5-4525-ad93-b8a97d24780f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 19:15:17.192905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:17.192905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:17.192905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:17.192905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:17.192905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:17.192905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:17.192905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:17.192905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:17.192905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:17.192905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:17.192905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:17.192905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:15:17.192905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:15:17.192905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:15:17.192905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:15:17.193782 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:15:17.193782 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:15:17.193782 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:15:17.193782 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:15:17.193782 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:17.193782 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:17.193782 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:17.193782 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:17.193782 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:17.193782 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:17.193782 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:17.193782 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:17.193782 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:17.193782 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:17.193782 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:17.193782 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:17.195164 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:17.195164 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:17.195164 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:17.195164 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:17.195164 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:15:17.195164 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:15:17.195164 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:15:17.195164 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:15:17.195164 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:15:17.195164 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:15:17.195164 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 19:15:17.195164 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:17.195164 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 239/483] 10.222.0.60 () {56 vars in 1102 bytes} [Thu Jul 21 19:15:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:17.202496 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1236fa1-2cbd-40b8-82ca-2da0729ef068 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:17.270791 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:17.334148 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1236fa1-2cbd-40b8-82ca-2da0729ef068 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:17.370672 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53406018-e225-4b73-82f3-b3d189f7a833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:17.371344 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53406018-e225-4b73-82f3-b3d189f7a833 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:17.371660 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53406018-e225-4b73-82f3-b3d189f7a833 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:17.371940 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53406018-e225-4b73-82f3-b3d189f7a833 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:17.372692 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53406018-e225-4b73-82f3-b3d189f7a833 None admin] RBAC: Adding query filter params (name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:17.372999 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53406018-e225-4b73-82f3-b3d189f7a833 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:17.374370 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53406018-e225-4b73-82f3-b3d189f7a833 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:17.383625 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 245/484] 10.222.0.60 () {56 vars in 1103 bytes} [Thu Jul 21 19:15:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:17.392542 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e81f414-96e5-4525-ad93-b8a97d24780f None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:17.474650 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:17.532694 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e81f414-96e5-4525-ad93-b8a97d24780f None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:17.578875 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99307fdd-417e-45d7-aa28-8a6b23200a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:17.579696 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99307fdd-417e-45d7-aa28-8a6b23200a28 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:17.579978 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99307fdd-417e-45d7-aa28-8a6b23200a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:17.580253 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99307fdd-417e-45d7-aa28-8a6b23200a28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:17.594321 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99307fdd-417e-45d7-aa28-8a6b23200a28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:17.595807 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99307fdd-417e-45d7-aa28-8a6b23200a28 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:17.624797 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-99307fdd-417e-45d7-aa28-8a6b23200a28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:17.624797 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:17.624797 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:17.624797 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:17.624797 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:17.624797 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:17.624797 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:17.624797 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:17.624797 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:17.624797 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:17.624797 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:17.624797 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:17.624797 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:17.624797 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:17.624797 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:17.625675 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:17.625675 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:17.625675 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:17.625675 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:17.625675 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:17.625675 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:17.625675 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:17.625675 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:17.625675 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:17.625675 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:17.625675 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:17.625675 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:17.625675 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:17.625675 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:17.625675 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:17.625675 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:17.625675 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:17.626540 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:17.626540 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:17.626540 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:17.626540 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:17.626540 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 240/485] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:17.632615 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99307fdd-417e-45d7-aa28-8a6b23200a28 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:17.633132 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf6f1a-85b8-493b-97e8-81c019b66a83 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:17.633431 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf6f1a-85b8-493b-97e8-81c019b66a83 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:17.633770 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf6f1a-85b8-493b-97e8-81c019b66a83 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:17.635326 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 246/486] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:17.641208 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b848587-fb3e-4bb5-b56f-58003bf9bcee None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:17.641499 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b848587-fb3e-4bb5-b56f-58003bf9bcee None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:17.641777 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b848587-fb3e-4bb5-b56f-58003bf9bcee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:17.688440 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-0b848587-fb3e-4bb5-b56f-58003bf9bcee None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:17.689643 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-0b848587-fb3e-4bb5-b56f-58003bf9bcee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:17.746647 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99307fdd-417e-45d7-aa28-8a6b23200a28 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:17.773202 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:17.790505 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 247/487] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:15:17.821810 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed237fd-72c3-4601-9aa3-842460580320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:17.822491 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed237fd-72c3-4601-9aa3-842460580320 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:17.822780 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed237fd-72c3-4601-9aa3-842460580320 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:17.823059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed237fd-72c3-4601-9aa3-842460580320 None admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:17.823817 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed237fd-72c3-4601-9aa3-842460580320 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:17.824128 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed237fd-72c3-4601-9aa3-842460580320 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:17.825521 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed237fd-72c3-4601-9aa3-842460580320 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:17.829124 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b848587-fb3e-4bb5-b56f-58003bf9bcee None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:17.853684 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 241/488] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:15:17.859659 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed237fd-72c3-4601-9aa3-842460580320 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:17.889610 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:17.975330 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b848587-fb3e-4bb5-b56f-58003bf9bcee None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:18.027107 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca49d0-0362-4f08-8715-776e2edcbfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:18.028551 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca49d0-0362-4f08-8715-776e2edcbfa0 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:18.030144 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca49d0-0362-4f08-8715-776e2edcbfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:18.031866 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca49d0-0362-4f08-8715-776e2edcbfa0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:18.046107 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed237fd-72c3-4601-9aa3-842460580320 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:18.052734 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca49d0-0362-4f08-8715-776e2edcbfa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:15:18.061215 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-62ca49d0-0362-4f08-8715-776e2edcbfa0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 19:15:18.061215 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:18.061215 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:18.061215 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:18.061215 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:18.061215 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:18.061215 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:18.061215 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:18.061215 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:18.061215 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:18.061215 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:18.061215 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:18.061215 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:15:18.061215 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:15:18.061215 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:15:18.061215 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:15:18.062128 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:15:18.062128 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:15:18.062128 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:15:18.062128 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:15:18.062128 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:18.062128 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:18.062128 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:18.062128 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:18.062128 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:18.062128 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:18.062128 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:18.062128 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:18.062128 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:18.062128 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:18.062128 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:18.062128 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:18.062933 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:18.062933 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:18.062933 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:18.062933 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:18.062933 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:15:18.062933 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:15:18.062933 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:15:18.062933 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:15:18.062933 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:15:18.062933 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:15:18.062933 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 19:15:18.062933 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:18.065767 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 248/489] 10.222.0.60 () {56 vars in 1102 bytes} [Thu Jul 21 19:15:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:15:18.072858 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca49d0-0362-4f08-8715-776e2edcbfa0 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:18.121927 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc960c4-bfe9-4671-afa9-22844afe95e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:18.122732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc960c4-bfe9-4671-afa9-22844afe95e7 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:18.123015 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc960c4-bfe9-4671-afa9-22844afe95e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:18.123289 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc960c4-bfe9-4671-afa9-22844afe95e7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:18.132875 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc960c4-bfe9-4671-afa9-22844afe95e7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:18.134571 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc960c4-bfe9-4671-afa9-22844afe95e7 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:18.151811 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-5fc960c4-bfe9-4671-afa9-22844afe95e7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 19:15:18.151811 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:18.151811 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:18.151811 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:18.151811 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:18.151811 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:18.151811 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:18.151811 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:18.151811 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:18.151811 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:18.151811 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:18.151811 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:18.151811 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 19:15:18.151811 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 19:15:18.151811 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 19:15:18.151811 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 19:15:18.152720 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:18.152720 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:18.152720 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 19:15:18.152720 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:15:18.152720 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 19:15:18.152720 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:15:18.152720 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:18.152720 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:18.152720 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:18.152720 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:18.152720 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:18.152720 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:18.152720 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:18.152720 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:18.152720 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:18.152720 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:18.152720 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:18.152720 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:18.153604 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:18.153604 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:18.153604 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 19:15:18.153604 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 19:15:18.153604 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 19:15:18.153604 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 19:15:18.153604 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 19:15:18.153604 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 19:15:18.153604 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 19:15:18.153604 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:18.156127 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 242/490] 10.222.0.60 () {56 vars in 1093 bytes} [Thu Jul 21 19:15:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:15:18.162606 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c7575-031b-4aef-ad90-65c63ac882e7 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:18.163318 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c7575-031b-4aef-ad90-65c63ac882e7 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:18.163818 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c7575-031b-4aef-ad90-65c63ac882e7 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:18.166519 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 243/491] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:18 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:18.167825 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c7575-031b-4aef-ad90-65c63ac882e7 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:18.198196 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca49d0-0362-4f08-8715-776e2edcbfa0 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:18.199928 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:18.205376 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:18.233314 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd663e6-9d66-4241-985e-551b4dfddd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:18.234278 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd663e6-9d66-4241-985e-551b4dfddd72 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:18.234567 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd663e6-9d66-4241-985e-551b4dfddd72 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:18.234844 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd663e6-9d66-4241-985e-551b4dfddd72 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:18.235638 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd663e6-9d66-4241-985e-551b4dfddd72 None admin] RBAC: Adding query filter params (name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:18.235950 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd663e6-9d66-4241-985e-551b4dfddd72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:18.237618 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd663e6-9d66-4241-985e-551b4dfddd72 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:18.251525 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 249/492] 10.222.0.60 () {56 vars in 1103 bytes} [Thu Jul 21 19:15:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:18.253048 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b13c3c-2d25-4172-98e6-1e8715c59068 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:18.253489 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b13c3c-2d25-4172-98e6-1e8715c59068 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:18.253926 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b13c3c-2d25-4172-98e6-1e8715c59068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:18.279232 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-03b13c3c-2d25-4172-98e6-1e8715c59068 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:18.280871 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-03b13c3c-2d25-4172-98e6-1e8715c59068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:18.303219 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c7575-031b-4aef-ad90-65c63ac882e7 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:18.346759 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7ac70-e120-453c-a0ad-a8451f91b037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:18.347701 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7ac70-e120-453c-a0ad-a8451f91b037 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:18.348124 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7ac70-e120-453c-a0ad-a8451f91b037 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:18.348578 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7ac70-e120-453c-a0ad-a8451f91b037 None admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:18.349627 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7ac70-e120-453c-a0ad-a8451f91b037 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:18.350080 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7ac70-e120-453c-a0ad-a8451f91b037 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:18.351842 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7ac70-e120-453c-a0ad-a8451f91b037 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:18.375533 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 250/493] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:15:18.376437 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b13c3c-2d25-4172-98e6-1e8715c59068 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:18.400311 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 244/494] 10.222.0.60 () {56 vars in 1133 bytes} [Thu Jul 21 19:15:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:18.400311 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6f7ff-1b3d-4d3d-9ff1-4a947d33e90f None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:18.400311 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6f7ff-1b3d-4d3d-9ff1-4a947d33e90f None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:18.400311 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6f7ff-1b3d-4d3d-9ff1-4a947d33e90f None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:18.400311 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 245/495] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:18.404008 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6f7ff-1b3d-4d3d-9ff1-4a947d33e90f None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:18.494465 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:18.495903 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:18.502017 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b13c3c-2d25-4172-98e6-1e8715c59068 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:18.509160 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6f7ff-1b3d-4d3d-9ff1-4a947d33e90f None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:18.542153 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527afce3-cfa6-4469-b1fb-a80eb7585dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:18.542377 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b64b6-0242-44de-b23d-db48133e41b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:18.542956 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527afce3-cfa6-4469-b1fb-a80eb7585dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:18.543140 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b64b6-0242-44de-b23d-db48133e41b4 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:18.543240 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527afce3-cfa6-4469-b1fb-a80eb7585dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:18.543413 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b64b6-0242-44de-b23d-db48133e41b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:18.543535 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527afce3-cfa6-4469-b1fb-a80eb7585dd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:18.547848 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b64b6-0242-44de-b23d-db48133e41b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:18.554605 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b64b6-0242-44de-b23d-db48133e41b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:15:18.556073 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527afce3-cfa6-4469-b1fb-a80eb7585dd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:18.557533 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527afce3-cfa6-4469-b1fb-a80eb7585dd5 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:18.562275 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-bc5b64b6-0242-44de-b23d-db48133e41b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 19:15:18.562275 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:18.562275 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:18.562275 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:18.562275 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:18.562275 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:18.562275 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:18.562275 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:18.562275 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:18.562275 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:18.562275 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:18.562275 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:18.562275 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:15:18.562275 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:15:18.562275 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:15:18.562275 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:15:18.563148 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:15:18.563148 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:15:18.563148 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:15:18.563148 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:15:18.563148 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:18.563148 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:18.563148 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:18.563148 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:18.563148 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:18.563148 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:18.563148 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:18.563148 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:18.563148 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:18.563148 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:18.563148 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:18.563148 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:18.564292 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:18.564292 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:18.564292 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:18.564292 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:18.564292 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:15:18.564292 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:15:18.564292 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:15:18.564292 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:15:18.564292 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:15:18.564292 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:15:18.564292 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 19:15:18.564292 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:18.568336 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 246/496] 10.222.0.60 () {56 vars in 1102 bytes} [Thu Jul 21 19:15:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:18.569382 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b64b6-0242-44de-b23d-db48133e41b4 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:18.578470 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-527afce3-cfa6-4469-b1fb-a80eb7585dd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:18.578470 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:18.578470 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:18.578470 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:18.578470 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:18.578470 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:18.578470 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:18.578470 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:18.578470 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:18.578470 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:18.578470 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:18.578470 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:18.578470 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:18.578470 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:18.578470 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:18.579326 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:18.579326 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:18.579326 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:18.579326 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:18.579326 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:18.579326 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:18.579326 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:18.579326 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:18.579326 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:18.579326 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:18.579326 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:18.579326 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:18.579326 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:18.579326 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:18.579326 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:18.579326 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:18.579326 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:18.580227 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:18.580227 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:18.580227 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:18.580227 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:18.580818 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 251/497] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:18.581726 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5785371-4318-4932-8bba-b6d2d40597b1 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:18.582017 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5785371-4318-4932-8bba-b6d2d40597b1 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:18.582298 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5785371-4318-4932-8bba-b6d2d40597b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:18.599972 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-a5785371-4318-4932-8bba-b6d2d40597b1 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:18.601689 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-a5785371-4318-4932-8bba-b6d2d40597b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:18.675572 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 252/498] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:15:18.675572 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5785371-4318-4932-8bba-b6d2d40597b1 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:18.682815 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b64b6-0242-44de-b23d-db48133e41b4 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:18.718202 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b3ac4e-9e66-4fdc-b366-02ad6861e59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:18.718850 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3ac4e-9e66-4fdc-b366-02ad6861e59d None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:18.719127 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3ac4e-9e66-4fdc-b366-02ad6861e59d None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:18.719405 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3ac4e-9e66-4fdc-b366-02ad6861e59d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:18.737921 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:18.765352 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:18.791330 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5785371-4318-4932-8bba-b6d2d40597b1 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:18.794763 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b3ac4e-9e66-4fdc-b366-02ad6861e59d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:18.796259 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b3ac4e-9e66-4fdc-b366-02ad6861e59d None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:18.828314 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0332a851-38fe-4988-90b4-f430039c1cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:18.829129 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332a851-38fe-4988-90b4-f430039c1cca None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:18.829361 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332a851-38fe-4988-90b4-f430039c1cca None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:18.829636 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332a851-38fe-4988-90b4-f430039c1cca None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:18.830485 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0332a851-38fe-4988-90b4-f430039c1cca None admin] RBAC: Adding query filter params (name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:18.830793 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0332a851-38fe-4988-90b4-f430039c1cca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:18.832188 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0332a851-38fe-4988-90b4-f430039c1cca None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:18.843596 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 253/499] 10.222.0.60 () {56 vars in 1103 bytes} [Thu Jul 21 19:15:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:18.844600 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0332a851-38fe-4988-90b4-f430039c1cca None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:18.905544 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 247/500] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:15:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 19:15:18.906451 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b3ac4e-9e66-4fdc-b366-02ad6861e59d None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:18.952228 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0332a851-38fe-4988-90b4-f430039c1cca None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:18.958419 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:18.988739 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56131e-89e8-4f73-91ae-9d54d1ed6940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:18.989758 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56131e-89e8-4f73-91ae-9d54d1ed6940 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:18.990048 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56131e-89e8-4f73-91ae-9d54d1ed6940 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:18.990334 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56131e-89e8-4f73-91ae-9d54d1ed6940 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:18.991638 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d56131e-89e8-4f73-91ae-9d54d1ed6940 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:18.991953 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d56131e-89e8-4f73-91ae-9d54d1ed6940 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:18.993339 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d56131e-89e8-4f73-91ae-9d54d1ed6940 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:19.001061 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:19.006222 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 254/501] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:19.011081 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56131e-89e8-4f73-91ae-9d54d1ed6940 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:19.012903 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b3ac4e-9e66-4fdc-b366-02ad6861e59d None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:19.045974 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee891fd-4c3c-49ca-a189-bc5a4d9ca076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:19.046756 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee891fd-4c3c-49ca-a189-bc5a4d9ca076 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:19.047033 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee891fd-4c3c-49ca-a189-bc5a4d9ca076 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:19.047311 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee891fd-4c3c-49ca-a189-bc5a4d9ca076 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:19.058084 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee891fd-4c3c-49ca-a189-bc5a4d9ca076 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:15:19.065692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-cee891fd-4c3c-49ca-a189-bc5a4d9ca076 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 19:15:19.065692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:19.065692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:19.065692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:19.065692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:19.065692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:19.065692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:19.065692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:19.065692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:19.065692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:19.065692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:19.065692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:19.065692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:15:19.065692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:15:19.065692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:15:19.065692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:15:19.066597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:15:19.066597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:15:19.066597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:15:19.066597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:15:19.066597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:19.066597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:19.066597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:19.066597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:19.066597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:19.066597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:19.066597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:19.066597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:19.066597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:19.066597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:19.066597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:19.066597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:19.067464 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:19.067464 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:19.067464 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:19.067464 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:19.067464 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:15:19.067464 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:15:19.067464 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:15:19.067464 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:15:19.067464 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:15:19.067464 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:15:19.067464 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 19:15:19.067464 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:19.068113 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 248/502] 10.222.0.60 () {56 vars in 1102 bytes} [Thu Jul 21 19:15:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:19.068738 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee891fd-4c3c-49ca-a189-bc5a4d9ca076 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:19.109572 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56131e-89e8-4f73-91ae-9d54d1ed6940 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:19.144042 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c33c363-4d16-47c0-9443-9b1cdba6965f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:19.144838 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c33c363-4d16-47c0-9443-9b1cdba6965f None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:19.145126 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c33c363-4d16-47c0-9443-9b1cdba6965f None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:19.145408 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c33c363-4d16-47c0-9443-9b1cdba6965f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:19.155672 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c33c363-4d16-47c0-9443-9b1cdba6965f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:19.157154 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c33c363-4d16-47c0-9443-9b1cdba6965f None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:19.166252 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee891fd-4c3c-49ca-a189-bc5a4d9ca076 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:19.175016 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:19.176460 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-2c33c363-4d16-47c0-9443-9b1cdba6965f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:19.176460 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:19.176460 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:19.176460 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:19.176460 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:19.176460 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:19.176460 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:19.176460 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:19.176460 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:19.176460 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:19.176460 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:19.176460 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:19.176460 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:19.176460 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:19.176460 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:19.177319 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:19.177319 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:19.177319 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:19.177319 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:19.177319 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:19.177319 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:19.177319 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:19.177319 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:19.177319 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:19.177319 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:19.177319 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:19.177319 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:19.177319 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:19.177319 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:19.177319 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:19.177319 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:19.177319 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:19.184111 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:19.184111 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:19.184111 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:19.184111 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:19.184111 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 255/503] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:19.184111 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d672e-171c-4831-8346-b63d5184a450 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:19.184111 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d672e-171c-4831-8346-b63d5184a450 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:19.184111 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d672e-171c-4831-8346-b63d5184a450 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:19.184111 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 256/504] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:19.184599 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66d672e-171c-4831-8346-b63d5184a450 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:19.204029 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03102d1a-28c5-42b6-b37e-679b57898795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:19.204780 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03102d1a-28c5-42b6-b37e-679b57898795 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:19.205061 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03102d1a-28c5-42b6-b37e-679b57898795 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:19.205331 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03102d1a-28c5-42b6-b37e-679b57898795 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:19.215750 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03102d1a-28c5-42b6-b37e-679b57898795 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:19.217204 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03102d1a-28c5-42b6-b37e-679b57898795 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:19.233699 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-03102d1a-28c5-42b6-b37e-679b57898795 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:19.233699 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:19.233699 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:19.233699 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:19.233699 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:19.233699 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:19.233699 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:19.233699 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:19.233699 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:19.233699 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:19.233699 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:19.233699 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:19.233699 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:19.233699 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:19.233699 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:19.234674 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:19.234674 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:19.234674 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:19.234674 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:19.234674 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:19.234674 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:19.234674 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:19.234674 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:19.234674 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:19.234674 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:19.234674 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:19.234674 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:19.234674 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:19.234674 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:19.234674 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:19.234674 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:19.234674 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:19.235839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:19.235839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:19.235839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:19.235839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:19.235839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 249/505] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:19.235839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03102d1a-28c5-42b6-b37e-679b57898795 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:19.240374 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:19.293537 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66d672e-171c-4831-8346-b63d5184a450 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:19.328447 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd9b4c-be28-473b-b4ce-e64d387f0e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:19.329232 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd9b4c-be28-473b-b4ce-e64d387f0e5a None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:19.329511 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd9b4c-be28-473b-b4ce-e64d387f0e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:19.329783 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd9b4c-be28-473b-b4ce-e64d387f0e5a None admin] PATH_INFO: `/v3/users/glance` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:19.335187 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03102d1a-28c5-42b6-b37e-679b57898795 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:19.336757 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd9b4c-be28-473b-b4ce-e64d387f0e5a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:19.338198 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd9b4c-be28-473b-b4ce-e64d387f0e5a None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:19.354491 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-1dfd9b4c-be28-473b-b4ce-e64d387f0e5a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 21 19:15:19.354491 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:19.354491 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:19.354491 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:19.354491 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:19.354491 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:19.354491 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:19.354491 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:19.354491 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:19.354491 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:19.354491 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:19.354491 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:19.354491 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 19:15:19.354491 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 19:15:19.354491 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 19:15:19.354491 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 19:15:19.355379 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:19.355379 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:19.355379 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 19:15:19.355379 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:15:19.355379 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 19:15:19.355379 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:15:19.355379 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:19.355379 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:19.355379 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:19.355379 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:19.355379 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:19.355379 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:19.355379 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:19.355379 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:19.355379 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:19.355379 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:19.355379 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:19.355379 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:19.356328 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:19.356328 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:19.356328 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 19:15:19.356328 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 19:15:19.356328 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 19:15:19.356328 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 19:15:19.356328 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 19:15:19.356328 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 19:15:19.356328 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 21 19:15:19.356328 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:19.356328 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 257/506] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:15:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:19.357487 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd9b4c-be28-473b-b4ce-e64d387f0e5a None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:19.372125 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a56852-08d2-4423-b22f-4bbf84c39e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:19.372786 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a56852-08d2-4423-b22f-4bbf84c39e23 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:19.373066 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a56852-08d2-4423-b22f-4bbf84c39e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:19.373345 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a56852-08d2-4423-b22f-4bbf84c39e23 None admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:19.374084 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a56852-08d2-4423-b22f-4bbf84c39e23 None admin] RBAC: Adding query filter params (name=service) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:19.374391 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a56852-08d2-4423-b22f-4bbf84c39e23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:19.375796 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a56852-08d2-4423-b22f-4bbf84c39e23 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:19.383486 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 250/507] 10.222.0.60 () {56 vars in 1103 bytes} [Thu Jul 21 19:15:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:19.384637 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424ebda-0909-4494-bece-4adc8e33a9d3 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:19.384952 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424ebda-0909-4494-bece-4adc8e33a9d3 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:19.385249 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424ebda-0909-4494-bece-4adc8e33a9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:19.401172 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-c424ebda-0909-4494-bece-4adc8e33a9d3 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:19.402377 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-c424ebda-0909-4494-bece-4adc8e33a9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:19.418454 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:19.463778 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd9b4c-be28-473b-b4ce-e64d387f0e5a None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:19.471061 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 251/508] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:15:19.471919 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424ebda-0909-4494-bece-4adc8e33a9d3 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:19.477336 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:19.503550 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb06e9-61e7-4e14-b8cf-5450398fcef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:19.504213 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb06e9-61e7-4e14-b8cf-5450398fcef7 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:19.504495 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb06e9-61e7-4e14-b8cf-5450398fcef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:19.504779 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb06e9-61e7-4e14-b8cf-5450398fcef7 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:19.505496 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb06e9-61e7-4e14-b8cf-5450398fcef7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:19.505805 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb06e9-61e7-4e14-b8cf-5450398fcef7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:19.507226 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb06e9-61e7-4e14-b8cf-5450398fcef7 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:19.519208 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 258/509] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:19.519954 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb06e9-61e7-4e14-b8cf-5450398fcef7 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:19.570347 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424ebda-0909-4494-bece-4adc8e33a9d3 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:19.602718 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e632d56-35f6-4ee7-9c93-9cc6d0ec366a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:19.603378 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e632d56-35f6-4ee7-9c93-9cc6d0ec366a None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:19.603747 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e632d56-35f6-4ee7-9c93-9cc6d0ec366a None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:19.603964 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e632d56-35f6-4ee7-9c93-9cc6d0ec366a None admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:19.604693 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e632d56-35f6-4ee7-9c93-9cc6d0ec366a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:19.604998 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e632d56-35f6-4ee7-9c93-9cc6d0ec366a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:19.606363 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e632d56-35f6-4ee7-9c93-9cc6d0ec366a None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:19.617744 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 252/510] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:19.618360 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e632d56-35f6-4ee7-9c93-9cc6d0ec366a None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:19.619504 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb06e9-61e7-4e14-b8cf-5450398fcef7 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:19.633910 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:19.654613 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42730d-07c9-4c4f-b020-54b94c4a5a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:19.655278 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42730d-07c9-4c4f-b020-54b94c4a5a18 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:19.655604 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42730d-07c9-4c4f-b020-54b94c4a5a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:19.655886 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42730d-07c9-4c4f-b020-54b94c4a5a18 None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:19.656723 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd42730d-07c9-4c4f-b020-54b94c4a5a18 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:19.657032 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd42730d-07c9-4c4f-b020-54b94c4a5a18 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:19.658467 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd42730d-07c9-4c4f-b020-54b94c4a5a18 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:19.696305 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 259/511] 10.222.0.60 () {56 vars in 1137 bytes} [Thu Jul 21 19:15:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:19.697121 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42730d-07c9-4c4f-b020-54b94c4a5a18 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:19.717098 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e632d56-35f6-4ee7-9c93-9cc6d0ec366a None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:19.724577 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:19.750081 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5c092-18a3-49d9-87e2-e6f996f227ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:19.750869 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5c092-18a3-49d9-87e2-e6f996f227ce None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:19.751195 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5c092-18a3-49d9-87e2-e6f996f227ce None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:19.751490 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5c092-18a3-49d9-87e2-e6f996f227ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:19.761239 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc5c092-18a3-49d9-87e2-e6f996f227ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:19.762664 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc5c092-18a3-49d9-87e2-e6f996f227ce None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:19.779971 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-2fc5c092-18a3-49d9-87e2-e6f996f227ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:19.779971 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:19.779971 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:19.779971 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:19.779971 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:19.779971 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:19.779971 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:19.779971 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:19.779971 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:19.779971 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:19.779971 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:19.779971 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:19.779971 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:19.779971 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:19.779971 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:19.780994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:19.780994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:19.780994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:19.780994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:19.780994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:19.780994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:19.780994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:19.780994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:19.780994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:19.780994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:19.780994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:19.780994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:19.780994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:19.780994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:19.780994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:19.780994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:19.780994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:19.786740 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:19.786740 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:19.786740 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:19.786740 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:19.786740 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 253/512] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:19.786740 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5c092-18a3-49d9-87e2-e6f996f227ce None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:19.796275 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42730d-07c9-4c4f-b020-54b94c4a5a18 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:19.829425 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65293cc5-eb79-4409-a52a-49df84c8ade6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:19.830210 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65293cc5-eb79-4409-a52a-49df84c8ade6 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:19.830493 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65293cc5-eb79-4409-a52a-49df84c8ade6 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:19.830766 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65293cc5-eb79-4409-a52a-49df84c8ade6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:19.841222 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65293cc5-eb79-4409-a52a-49df84c8ade6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:19.842696 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65293cc5-eb79-4409-a52a-49df84c8ade6 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:19.843867 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:19.861783 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-65293cc5-eb79-4409-a52a-49df84c8ade6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:19.861783 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:19.861783 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:19.861783 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:19.861783 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:19.861783 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:19.861783 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:19.861783 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:19.861783 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:19.861783 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:19.861783 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:19.861783 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:19.861783 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:19.861783 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:19.861783 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:19.862657 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:19.862657 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:19.862657 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:19.862657 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:19.862657 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:19.862657 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:19.862657 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:19.862657 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:19.862657 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:19.862657 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:19.862657 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:19.862657 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:19.862657 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:19.862657 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:19.862657 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:19.862657 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:19.862657 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:19.863628 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:19.863628 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:19.863628 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:19.863628 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:19.863628 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 260/513] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:19.863902 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65293cc5-eb79-4409-a52a-49df84c8ade6 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:19.885729 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5c092-18a3-49d9-87e2-e6f996f227ce None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:19.919046 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a9c7b-1e42-496e-95a6-3482272e6168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:19.919868 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a9c7b-1e42-496e-95a6-3482272e6168 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:19.920150 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a9c7b-1e42-496e-95a6-3482272e6168 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:19.920420 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a9c7b-1e42-496e-95a6-3482272e6168 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:19.929264 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6a9c7b-1e42-496e-95a6-3482272e6168 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:19.930789 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6a9c7b-1e42-496e-95a6-3482272e6168 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:19.944732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-3a6a9c7b-1e42-496e-95a6-3482272e6168 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 19:15:19.944732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:19.944732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:19.944732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:19.944732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:19.944732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:19.944732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:19.944732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:19.944732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:19.944732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:19.944732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:19.944732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:19.944732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 19:15:19.944732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 19:15:19.944732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 19:15:19.944732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 19:15:19.945613 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:19.945613 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:19.945613 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 19:15:19.945613 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:15:19.945613 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 19:15:19.945613 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:15:19.945613 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:19.945613 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:19.945613 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:19.945613 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:19.945613 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:19.945613 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:19.945613 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:19.945613 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:19.945613 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:19.945613 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:19.945613 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:19.945613 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:19.946795 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:19.946795 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:19.946795 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 19:15:19.946795 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 19:15:19.946795 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 19:15:19.946795 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 19:15:19.946795 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 19:15:19.946795 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 19:15:19.946795 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 19:15:19.946795 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:19.946795 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 254/514] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:15:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:19.946795 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a9c7b-1e42-496e-95a6-3482272e6168 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:19.951855 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:19.972964 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65293cc5-eb79-4409-a52a-49df84c8ade6 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:20.011181 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e07abec-a131-4e87-8977-502cf994c1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:20.012002 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07abec-a131-4e87-8977-502cf994c1a3 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:20.012289 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07abec-a131-4e87-8977-502cf994c1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:20.012565 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07abec-a131-4e87-8977-502cf994c1a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:20.020936 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e07abec-a131-4e87-8977-502cf994c1a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:20.022989 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e07abec-a131-4e87-8977-502cf994c1a3 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:20.037641 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-8e07abec-a131-4e87-8977-502cf994c1a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:15:20.037641 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:20.037641 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:20.037641 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:20.037641 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:20.037641 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:20.037641 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:20.037641 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:20.037641 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:20.037641 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:20.037641 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:20.037641 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:20.037641 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 19:15:20.037641 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 19:15:20.037641 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 19:15:20.039254 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 19:15:20.039254 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:20.039254 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:20.039254 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:20.039254 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:20.039254 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:20.039254 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:20.039254 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:20.039254 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:20.039254 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:20.039254 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:20.039254 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:20.039254 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:20.039254 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:20.039254 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:20.039254 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:20.039254 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:20.040196 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 19:15:20.040196 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 19:15:20.040196 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 19:15:20.040196 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 19:15:20.040196 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 19:15:20.040196 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 19:15:20.040196 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:15:20.040196 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:20.040196 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 261/515] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:15:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:20.040674 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e07abec-a131-4e87-8977-502cf994c1a3 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:20.050311 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a9c7b-1e42-496e-95a6-3482272e6168 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:20.075210 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:20.086069 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9a1b9-ae27-4efc-86cb-1ab7592d573e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:20.086713 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9a1b9-ae27-4efc-86cb-1ab7592d573e None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:20.090491 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9a1b9-ae27-4efc-86cb-1ab7592d573e None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:20.090491 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9a1b9-ae27-4efc-86cb-1ab7592d573e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:20.141005 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e07abec-a131-4e87-8977-502cf994c1a3 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:20.151393 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc9a1b9-ae27-4efc-86cb-1ab7592d573e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:20.152882 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc9a1b9-ae27-4efc-86cb-1ab7592d573e None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:20.174241 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ab870-edac-4a2a-b4ba-c06b6db2d650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:20.174893 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ab870-edac-4a2a-b4ba-c06b6db2d650 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:20.175177 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ab870-edac-4a2a-b4ba-c06b6db2d650 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:20.175473 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ab870-edac-4a2a-b4ba-c06b6db2d650 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:20.176190 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ab870-edac-4a2a-b4ba-c06b6db2d650 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:20.176494 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ab870-edac-4a2a-b4ba-c06b6db2d650 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:20.178114 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ab870-edac-4a2a-b4ba-c06b6db2d650 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:20.186825 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:20.190171 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 262/516] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:20.190956 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ab870-edac-4a2a-b4ba-c06b6db2d650 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:20.255038 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 255/517] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:15:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 19:15:20.255831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9a1b9-ae27-4efc-86cb-1ab7592d573e None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:20.280832 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:20.294117 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ab870-edac-4a2a-b4ba-c06b6db2d650 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:20.328247 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff5da4-486f-414e-93a6-4ce704dd787f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:20.328910 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff5da4-486f-414e-93a6-4ce704dd787f None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:20.329198 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff5da4-486f-414e-93a6-4ce704dd787f None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:20.329471 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff5da4-486f-414e-93a6-4ce704dd787f None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:20.330185 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff5da4-486f-414e-93a6-4ce704dd787f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:20.330490 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff5da4-486f-414e-93a6-4ce704dd787f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:20.331895 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff5da4-486f-414e-93a6-4ce704dd787f None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:20.343662 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 263/518] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:20.344437 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff5da4-486f-414e-93a6-4ce704dd787f None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:20.354091 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9a1b9-ae27-4efc-86cb-1ab7592d573e None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:20.388126 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebb682-7c0e-4eac-85b5-942c8803b182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:20.388791 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebb682-7c0e-4eac-85b5-942c8803b182 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:20.389073 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebb682-7c0e-4eac-85b5-942c8803b182 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:20.389348 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebb682-7c0e-4eac-85b5-942c8803b182 None admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:20.390179 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ebb682-7c0e-4eac-85b5-942c8803b182 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:20.390489 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ebb682-7c0e-4eac-85b5-942c8803b182 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:20.391939 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ebb682-7c0e-4eac-85b5-942c8803b182 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:20.408463 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:20.408709 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 256/519] 10.222.0.60 () {56 vars in 1137 bytes} [Thu Jul 21 19:15:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:20.409493 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebb682-7c0e-4eac-85b5-942c8803b182 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:20.451745 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff5da4-486f-414e-93a6-4ce704dd787f None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:20.485772 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3bec17-f7c9-4f4d-9bb6-622e2d907316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:20.486430 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3bec17-f7c9-4f4d-9bb6-622e2d907316 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:20.486722 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3bec17-f7c9-4f4d-9bb6-622e2d907316 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:20.487003 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3bec17-f7c9-4f4d-9bb6-622e2d907316 None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:20.487837 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3bec17-f7c9-4f4d-9bb6-622e2d907316 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:20.488151 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3bec17-f7c9-4f4d-9bb6-622e2d907316 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:20.489601 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3bec17-f7c9-4f4d-9bb6-622e2d907316 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:20.491594 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:20.509958 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 264/520] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Jul 21 19:15:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:20.509958 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3bec17-f7c9-4f4d-9bb6-622e2d907316 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:20.510768 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebb682-7c0e-4eac-85b5-942c8803b182 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:20.544863 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a044ea-1514-4b82-a092-93db8482fbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:20.545757 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a044ea-1514-4b82-a092-93db8482fbae None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:20.546111 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a044ea-1514-4b82-a092-93db8482fbae None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:20.546460 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a044ea-1514-4b82-a092-93db8482fbae None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:20.554253 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a044ea-1514-4b82-a092-93db8482fbae None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:20.555870 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a044ea-1514-4b82-a092-93db8482fbae None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:20.570642 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-c4a044ea-1514-4b82-a092-93db8482fbae None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 19:15:20.570642 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:20.570642 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:20.570642 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:20.570642 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:20.570642 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:20.570642 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:20.570642 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:20.570642 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:20.570642 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:20.570642 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:20.570642 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:20.570642 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 19:15:20.570642 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 19:15:20.570642 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 19:15:20.570642 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 19:15:20.571616 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:20.571616 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:20.571616 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 19:15:20.571616 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:15:20.571616 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 19:15:20.571616 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:15:20.571616 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:20.571616 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:20.571616 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:20.571616 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:20.571616 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:20.571616 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:20.571616 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:20.571616 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:20.571616 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:20.571616 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:20.571616 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:20.571616 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:20.572661 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:20.572661 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:20.572661 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 19:15:20.572661 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 19:15:20.572661 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 19:15:20.572661 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 19:15:20.572661 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 19:15:20.572661 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 19:15:20.572661 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 19:15:20.572661 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:20.572661 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 257/521] 10.222.0.60 () {56 vars in 1102 bytes} [Thu Jul 21 19:15:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:20.572661 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a044ea-1514-4b82-a092-93db8482fbae None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:20.612719 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3bec17-f7c9-4f4d-9bb6-622e2d907316 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:20.634275 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:20.648411 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5fff43-da23-4057-9a3a-cc7c8dbee333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:20.649219 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fff43-da23-4057-9a3a-cc7c8dbee333 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:20.649510 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fff43-da23-4057-9a3a-cc7c8dbee333 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:20.651639 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fff43-da23-4057-9a3a-cc7c8dbee333 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:20.659925 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5fff43-da23-4057-9a3a-cc7c8dbee333 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:20.661458 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5fff43-da23-4057-9a3a-cc7c8dbee333 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:20.670139 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a044ea-1514-4b82-a092-93db8482fbae None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:20.679785 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-2a5fff43-da23-4057-9a3a-cc7c8dbee333 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:20.679785 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:20.679785 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:20.679785 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:20.679785 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:20.679785 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:20.679785 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:20.679785 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:20.679785 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:20.679785 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:20.679785 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:20.679785 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:20.679785 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:20.679785 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:20.679785 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:20.680808 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:20.680808 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:20.680808 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:20.680808 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:20.680808 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:20.680808 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:20.680808 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:20.680808 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:20.680808 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:20.680808 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:20.680808 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:20.680808 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:20.680808 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:20.680808 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:20.680808 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:20.680808 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:20.680808 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:20.681713 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:20.681713 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:20.681713 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:20.681713 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:20.681713 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 265/522] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:20.682267 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5fff43-da23-4057-9a3a-cc7c8dbee333 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:20.706546 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b7628-70be-4540-8f0f-8923d7465149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:20.707212 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b7628-70be-4540-8f0f-8923d7465149 None admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:20.707541 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b7628-70be-4540-8f0f-8923d7465149 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:20.707814 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b7628-70be-4540-8f0f-8923d7465149 None admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:20.708508 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b7628-70be-4540-8f0f-8923d7465149 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:20.709950 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b7628-70be-4540-8f0f-8923d7465149 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:20.780457 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5fff43-da23-4057-9a3a-cc7c8dbee333 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:20.814574 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5987a-7118-4697-bc83-b77d0e4abb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:20.815210 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5987a-7118-4697-bc83-b77d0e4abb49 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:20.815523 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5987a-7118-4697-bc83-b77d0e4abb49 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:20.815806 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5987a-7118-4697-bc83-b77d0e4abb49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:20.821655 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:20.827040 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 258/523] 10.222.0.60 () {60 vars in 1132 bytes} [Thu Jul 21 19:15:20 2022] POST /identity/v3/users => generated 247 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:15:20.827862 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b7628-70be-4540-8f0f-8923d7465149 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:20.861937 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:20.892878 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de5987a-7118-4697-bc83-b77d0e4abb49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:20.894425 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de5987a-7118-4697-bc83-b77d0e4abb49 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:20.943357 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b7628-70be-4540-8f0f-8923d7465149 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:20.983843 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a14a09-f0e5-45f2-b27d-8991288461bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:20.984412 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a14a09-f0e5-45f2-b27d-8991288461bd None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:20.984706 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a14a09-f0e5-45f2-b27d-8991288461bd None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:20.984985 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a14a09-f0e5-45f2-b27d-8991288461bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:20.985828 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a14a09-f0e5-45f2-b27d-8991288461bd None admin] RBAC: Adding query filter params (role.id=beeebaa4e16c40f387f05b67124a424d, scope.project.id=9847b5e8bc0b4483bbce060a48f405f4, user.id=6b4d98e967814e5f84f5f0d67ebb3c17) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:20.986150 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a14a09-f0e5-45f2-b27d-8991288461bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:20.988878 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a14a09-f0e5-45f2-b27d-8991288461bd None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:20.994866 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 259/524] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:15:20 2022] GET /identity/v3/role_assignments?user.id=6b4d98e967814e5f84f5f0d67ebb3c17&scope.project.id=9847b5e8bc0b4483bbce060a48f405f4&role.id=beeebaa4e16c40f387f05b67124a424d => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:20.995538 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a14a09-f0e5-45f2-b27d-8991288461bd None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:21.012161 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 266/525] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:15:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 19:15:21.012161 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5987a-7118-4697-bc83-b77d0e4abb49 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:21.084298 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:21.118513 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:21.130261 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a14a09-f0e5-45f2-b27d-8991288461bd None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:21.166422 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5987a-7118-4697-bc83-b77d0e4abb49 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:21.172030 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff49935-42d4-4d17-907b-91a457926185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:21.172800 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff49935-42d4-4d17-907b-91a457926185 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:21.173086 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff49935-42d4-4d17-907b-91a457926185 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:21.173376 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff49935-42d4-4d17-907b-91a457926185 None admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:21.176225 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff49935-42d4-4d17-907b-91a457926185 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:21.176225 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff49935-42d4-4d17-907b-91a457926185 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:21.179062 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff49935-42d4-4d17-907b-91a457926185 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:21.207602 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 260/526] 10.222.0.60 () {56 vars in 1139 bytes} [Thu Jul 21 19:15:20 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:21.208496 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff49935-42d4-4d17-907b-91a457926185 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:21.218236 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25639f3a-f26c-462e-86b0-79c95be0b323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:21.218909 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25639f3a-f26c-462e-86b0-79c95be0b323 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:21.219197 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25639f3a-f26c-462e-86b0-79c95be0b323 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:21.219510 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25639f3a-f26c-462e-86b0-79c95be0b323 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:21.220239 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25639f3a-f26c-462e-86b0-79c95be0b323 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:21.220552 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25639f3a-f26c-462e-86b0-79c95be0b323 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:21.222512 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25639f3a-f26c-462e-86b0-79c95be0b323 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:21.239692 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 267/527] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:21.241108 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25639f3a-f26c-462e-86b0-79c95be0b323 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:21.334384 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff49935-42d4-4d17-907b-91a457926185 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:21.357992 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:21.362345 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25639f3a-f26c-462e-86b0-79c95be0b323 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:21.373997 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b542bbc1-bf63-45a4-836a-d797b9c90bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:21.374907 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542bbc1-bf63-45a4-836a-d797b9c90bdf None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:21.375257 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542bbc1-bf63-45a4-836a-d797b9c90bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:21.382283 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542bbc1-bf63-45a4-836a-d797b9c90bdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:21.387025 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b542bbc1-bf63-45a4-836a-d797b9c90bdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:21.388636 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b542bbc1-bf63-45a4-836a-d797b9c90bdf None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:21.395242 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:21.401631 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debbd37-9dbe-413f-9df6-bbed198115bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:21.402330 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debbd37-9dbe-413f-9df6-bbed198115bb None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:21.402738 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debbd37-9dbe-413f-9df6-bbed198115bb None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:21.403119 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debbd37-9dbe-413f-9df6-bbed198115bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:21.410788 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-b542bbc1-bf63-45a4-836a-d797b9c90bdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:21.410788 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:21.410788 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:21.410788 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:21.410788 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:21.410788 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:21.410788 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:21.410788 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:21.410788 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:21.410788 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:21.410788 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:21.410788 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:21.410788 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:21.410788 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:21.410788 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:21.411697 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:21.411697 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:21.411697 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:21.411697 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:21.411697 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:21.411697 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:21.411697 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:21.411697 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:21.411697 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:21.411697 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:21.411697 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:21.411697 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:21.411697 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:21.411697 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:21.411697 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:21.411697 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:21.411697 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:21.412556 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:21.412556 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:21.412556 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:21.412556 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:21.415137 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 261/528] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:21.416111 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b542bbc1-bf63-45a4-836a-d797b9c90bdf None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:21.503724 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6debbd37-9dbe-413f-9df6-bbed198115bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:21.505464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6debbd37-9dbe-413f-9df6-bbed198115bb None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:21.551343 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b542bbc1-bf63-45a4-836a-d797b9c90bdf None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:21.599722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a89b5-b81a-4f3e-89da-0ae7e1772b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:21.603385 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a89b5-b81a-4f3e-89da-0ae7e1772b49 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:21.603714 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a89b5-b81a-4f3e-89da-0ae7e1772b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:21.603995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a89b5-b81a-4f3e-89da-0ae7e1772b49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:21.615155 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a89b5-b81a-4f3e-89da-0ae7e1772b49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:21.617386 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a89b5-b81a-4f3e-89da-0ae7e1772b49 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:21.618891 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 268/529] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:15:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 19:15:21.624187 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debbd37-9dbe-413f-9df6-bbed198115bb None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:21.637027 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-635a89b5-b81a-4f3e-89da-0ae7e1772b49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:15:21.637027 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:21.637027 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:21.637027 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:21.637027 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:21.637027 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:21.637027 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:21.637027 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:21.637027 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:21.637027 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:21.637027 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:21.637027 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:21.637027 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 19:15:21.637027 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 19:15:21.637027 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 19:15:21.637919 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 19:15:21.637919 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:21.637919 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:21.637919 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:21.637919 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:21.637919 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:21.637919 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:21.637919 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:21.637919 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:21.637919 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:21.637919 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:21.637919 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:21.637919 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:21.637919 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:21.637919 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:21.637919 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:21.637919 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:21.638755 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 19:15:21.638755 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 19:15:21.638755 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 19:15:21.638755 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 19:15:21.638755 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 19:15:21.638755 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 19:15:21.638755 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:15:21.638755 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:21.642079 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 262/530] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:15:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:21.643696 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a89b5-b81a-4f3e-89da-0ae7e1772b49 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:21.665745 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:21.689082 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:21.758708 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debbd37-9dbe-413f-9df6-bbed198115bb None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:21.765326 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a89b5-b81a-4f3e-89da-0ae7e1772b49 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:21.803703 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26790d1b-67db-4708-b32a-09d58385c6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:21.804813 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26790d1b-67db-4708-b32a-09d58385c6a4 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:21.805106 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26790d1b-67db-4708-b32a-09d58385c6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:21.805430 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26790d1b-67db-4708-b32a-09d58385c6a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:21.805670 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc504f66-503f-4a49-b777-24a5c1fb02bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:21.806701 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc504f66-503f-4a49-b777-24a5c1fb02bd None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:21.807482 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc504f66-503f-4a49-b777-24a5c1fb02bd None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:21.807977 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc504f66-503f-4a49-b777-24a5c1fb02bd None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:21.809291 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc504f66-503f-4a49-b777-24a5c1fb02bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:21.809794 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc504f66-503f-4a49-b777-24a5c1fb02bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:21.811356 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc504f66-503f-4a49-b777-24a5c1fb02bd None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:21.816412 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26790d1b-67db-4708-b32a-09d58385c6a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:21.817952 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26790d1b-67db-4708-b32a-09d58385c6a4 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:21.826534 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 269/531] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:21.827561 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc504f66-503f-4a49-b777-24a5c1fb02bd None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:21.844696 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-26790d1b-67db-4708-b32a-09d58385c6a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:21.844696 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:21.844696 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:21.844696 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:21.844696 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:21.844696 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:21.844696 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:21.844696 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:21.844696 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:21.844696 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:21.844696 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:21.844696 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:21.844696 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:21.844696 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:21.844696 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:21.845574 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:21.845574 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:21.845574 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:21.845574 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:21.845574 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:21.845574 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:21.845574 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:21.845574 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:21.845574 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:21.845574 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:21.845574 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:21.845574 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:21.845574 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:21.845574 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:21.845574 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:21.845574 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:21.845574 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:21.846401 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:21.846401 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:21.846401 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:21.846401 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:21.851215 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 263/532] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:21.852167 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26790d1b-67db-4708-b32a-09d58385c6a4 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:21.940173 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:21.951654 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc504f66-503f-4a49-b777-24a5c1fb02bd None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:21.960900 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:21.981520 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26790d1b-67db-4708-b32a-09d58385c6a4 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:21.990298 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13041be3-662a-442c-bddc-6aa5de7601f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:21.991755 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13041be3-662a-442c-bddc-6aa5de7601f5 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:21.992593 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13041be3-662a-442c-bddc-6aa5de7601f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:21.992728 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13041be3-662a-442c-bddc-6aa5de7601f5 None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:21.993639 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13041be3-662a-442c-bddc-6aa5de7601f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:21.994056 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13041be3-662a-442c-bddc-6aa5de7601f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:21.995646 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13041be3-662a-442c-bddc-6aa5de7601f5 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:22.012277 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 270/533] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Jul 21 19:15:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:22.013329 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13041be3-662a-442c-bddc-6aa5de7601f5 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:22.027615 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d52ea-e0b0-4be4-856f-0d7230c115fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:22.028810 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d52ea-e0b0-4be4-856f-0d7230c115fd None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:22.029277 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d52ea-e0b0-4be4-856f-0d7230c115fd None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:22.029903 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d52ea-e0b0-4be4-856f-0d7230c115fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:22.040205 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4d52ea-e0b0-4be4-856f-0d7230c115fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:22.042202 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4d52ea-e0b0-4be4-856f-0d7230c115fd None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:22.060732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-2f4d52ea-e0b0-4be4-856f-0d7230c115fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:15:22.060732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:22.060732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:22.060732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:22.060732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:22.060732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:22.060732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:22.060732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:22.060732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:22.060732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:22.060732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:22.060732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:22.060732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 19:15:22.060732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 19:15:22.060732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 19:15:22.061656 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 19:15:22.061656 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:22.061656 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:22.061656 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:22.061656 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:22.061656 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:22.061656 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:22.061656 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:22.061656 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:22.061656 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:22.061656 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:22.061656 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:22.061656 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:22.061656 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:22.061656 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:22.061656 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:22.061656 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:22.062499 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 19:15:22.062499 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 19:15:22.062499 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 19:15:22.062499 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 19:15:22.062499 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 19:15:22.062499 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 19:15:22.062499 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:15:22.062499 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:22.065351 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 264/534] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:15:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:22.066308 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d52ea-e0b0-4be4-856f-0d7230c115fd None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:22.147068 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13041be3-662a-442c-bddc-6aa5de7601f5 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:22.185324 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d52ea-e0b0-4be4-856f-0d7230c115fd None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:22.185910 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c0c84-407c-4968-bc18-f2483d18f371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:22.186899 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c0c84-407c-4968-bc18-f2483d18f371 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:22.187328 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c0c84-407c-4968-bc18-f2483d18f371 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:22.187937 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c0c84-407c-4968-bc18-f2483d18f371 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:22.188840 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c0c84-407c-4968-bc18-f2483d18f371 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:22.189317 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c0c84-407c-4968-bc18-f2483d18f371 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:22.190889 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c0c84-407c-4968-bc18-f2483d18f371 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:22.204131 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 271/535] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:22.205200 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c0c84-407c-4968-bc18-f2483d18f371 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:22.221086 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:22.229996 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e900b-050a-410c-b85e-1ac3b916985a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:22.230821 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e900b-050a-410c-b85e-1ac3b916985a None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:22.231256 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e900b-050a-410c-b85e-1ac3b916985a None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:22.231672 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e900b-050a-410c-b85e-1ac3b916985a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:22.232806 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e900b-050a-410c-b85e-1ac3b916985a None admin] RBAC: Adding query filter params (role.id=beeebaa4e16c40f387f05b67124a424d, scope.project.id=9847b5e8bc0b4483bbce060a48f405f4, user.id=1a23a8e608f94d5d8153dcf7e79250f7) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:22.233203 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e900b-050a-410c-b85e-1ac3b916985a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:22.234812 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e900b-050a-410c-b85e-1ac3b916985a None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:22.241579 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 265/536] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:15:22 2022] GET /identity/v3/role_assignments?user.id=1a23a8e608f94d5d8153dcf7e79250f7&scope.project.id=9847b5e8bc0b4483bbce060a48f405f4&role.id=beeebaa4e16c40f387f05b67124a424d => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:22.242631 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e900b-050a-410c-b85e-1ac3b916985a None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:22.262963 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:22.322656 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c0c84-407c-4968-bc18-f2483d18f371 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:22.363349 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98340ea-ac7a-4dc1-9768-2154959a094b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:22.364668 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98340ea-ac7a-4dc1-9768-2154959a094b None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:22.367466 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98340ea-ac7a-4dc1-9768-2154959a094b None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:22.368828 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98340ea-ac7a-4dc1-9768-2154959a094b None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:22.370602 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98340ea-ac7a-4dc1-9768-2154959a094b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:22.371330 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98340ea-ac7a-4dc1-9768-2154959a094b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:22.374287 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98340ea-ac7a-4dc1-9768-2154959a094b None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:22.400589 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 272/537] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Jul 21 19:15:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:22.408281 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98340ea-ac7a-4dc1-9768-2154959a094b None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:22.454853 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e900b-050a-410c-b85e-1ac3b916985a None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:22.491804 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:22.518175 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98340ea-ac7a-4dc1-9768-2154959a094b None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:22.524122 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cfd179-3587-496b-a37b-a6b07a1f6b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:22.528793 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfd179-3587-496b-a37b-a6b07a1f6b55 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:22.528793 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfd179-3587-496b-a37b-a6b07a1f6b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:22.528793 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfd179-3587-496b-a37b-a6b07a1f6b55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:22.538273 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cfd179-3587-496b-a37b-a6b07a1f6b55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:22.541313 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cfd179-3587-496b-a37b-a6b07a1f6b55 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:22.558695 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c04d52-ae47-4463-b67d-0f42332e4351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:22.559391 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c04d52-ae47-4463-b67d-0f42332e4351 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:22.559706 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c04d52-ae47-4463-b67d-0f42332e4351 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:22.559991 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c04d52-ae47-4463-b67d-0f42332e4351 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:22.560831 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c04d52-ae47-4463-b67d-0f42332e4351 None admin] RBAC: Adding query filter params (role.id=beeebaa4e16c40f387f05b67124a424d, scope.project.id=9847b5e8bc0b4483bbce060a48f405f4, user.id=591016b95ab24d3a8de83089a141d914) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:22.561152 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c04d52-ae47-4463-b67d-0f42332e4351 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:22.562600 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c04d52-ae47-4463-b67d-0f42332e4351 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:22.568576 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 273/538] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:15:22 2022] GET /identity/v3/role_assignments?user.id=591016b95ab24d3a8de83089a141d914&scope.project.id=9847b5e8bc0b4483bbce060a48f405f4&role.id=beeebaa4e16c40f387f05b67124a424d => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:22.571890 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-a5cfd179-3587-496b-a37b-a6b07a1f6b55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:15:22.571890 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:22.571890 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:22.571890 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:22.571890 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:22.571890 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:22.571890 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:22.571890 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:22.571890 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:22.571890 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:22.571890 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:22.571890 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:22.571890 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 19:15:22.571890 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 19:15:22.571890 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 19:15:22.572722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 19:15:22.572722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:22.572722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:22.572722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:22.572722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:22.572722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:22.572722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:22.572722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:22.572722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:22.572722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:22.572722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:22.572722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:22.572722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:22.572722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:22.572722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:22.572722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:22.572722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:22.573940 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 19:15:22.573940 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 19:15:22.573940 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 19:15:22.573940 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 19:15:22.573940 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 19:15:22.573940 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 19:15:22.573940 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:15:22.573940 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:22.573940 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 266/539] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:15:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:22.585092 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c04d52-ae47-4463-b67d-0f42332e4351 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:22.763409 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c04d52-ae47-4463-b67d-0f42332e4351 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:22.809977 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c9b88-45ba-4047-aeae-8928d869b697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:22.810645 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c9b88-45ba-4047-aeae-8928d869b697 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:22.810928 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c9b88-45ba-4047-aeae-8928d869b697 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:22.811206 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c9b88-45ba-4047-aeae-8928d869b697 None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:22.812030 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c9b88-45ba-4047-aeae-8928d869b697 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:22.812339 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c9b88-45ba-4047-aeae-8928d869b697 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:22.813772 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c9b88-45ba-4047-aeae-8928d869b697 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:22.828393 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:22.831146 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 274/540] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Jul 21 19:15:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:22.837920 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cfd179-3587-496b-a37b-a6b07a1f6b55 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:22.924060 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:22.968088 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cfd179-3587-496b-a37b-a6b07a1f6b55 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:23.003848 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b7a04e-013d-4d77-8041-459baa87e7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:23.004515 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7a04e-013d-4d77-8041-459baa87e7fd None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:23.004830 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7a04e-013d-4d77-8041-459baa87e7fd None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:23.005111 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7a04e-013d-4d77-8041-459baa87e7fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:23.005948 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b7a04e-013d-4d77-8041-459baa87e7fd None admin] RBAC: Adding query filter params (role.id=beeebaa4e16c40f387f05b67124a424d, scope.project.id=9847b5e8bc0b4483bbce060a48f405f4, user.id=b1908b2f87d5442da8ba826489cb2018) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:23.006264 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b7a04e-013d-4d77-8041-459baa87e7fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:23.008265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b7a04e-013d-4d77-8041-459baa87e7fd None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:23.014662 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 267/541] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:15:22 2022] GET /identity/v3/role_assignments?user.id=b1908b2f87d5442da8ba826489cb2018&scope.project.id=9847b5e8bc0b4483bbce060a48f405f4&role.id=beeebaa4e16c40f387f05b67124a424d => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:23.135407 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066571f4-d564-4e77-87ef-53b2ddc79dbe None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:23.135985 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066571f4-d564-4e77-87ef-53b2ddc79dbe None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:23.136265 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066571f4-d564-4e77-87ef-53b2ddc79dbe None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:23.138088 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 275/542] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:23.143972 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f9f0c-df1f-4b43-81c5-0d99c5313643 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:23.144266 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f9f0c-df1f-4b43-81c5-0d99c5313643 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:23.144538 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f9f0c-df1f-4b43-81c5-0d99c5313643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:23.172716 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-172f9f0c-df1f-4b43-81c5-0d99c5313643 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:23.173977 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-172f9f0c-df1f-4b43-81c5-0d99c5313643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:23.265819 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 268/543] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 19:15:23.295366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066571f4-d564-4e77-87ef-53b2ddc79dbe None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:23.415790 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066571f4-d564-4e77-87ef-53b2ddc79dbe None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:23.435085 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a8132-fc92-4777-b0ad-d957166b19a7 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:23.435085 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a8132-fc92-4777-b0ad-d957166b19a7 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:23.435085 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a8132-fc92-4777-b0ad-d957166b19a7 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:23.436113 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 269/544] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:23.441185 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4c432-70e8-4db6-bd93-83079d9426d6 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:23.441482 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4c432-70e8-4db6-bd93-83079d9426d6 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:23.441762 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4c432-70e8-4db6-bd93-83079d9426d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:23.455728 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf09b3-c729-4430-9879-240f9c0a41d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:23.456533 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf09b3-c729-4430-9879-240f9c0a41d4 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:23.456819 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf09b3-c729-4430-9879-240f9c0a41d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:23.457096 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf09b3-c729-4430-9879-240f9c0a41d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:23.480186 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-e2e4c432-70e8-4db6-bd93-83079d9426d6 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:23.480786 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf09b3-c729-4430-9879-240f9c0a41d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:15:23.481428 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-e2e4c432-70e8-4db6-bd93-83079d9426d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:23.489472 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-edbf09b3-c729-4430-9879-240f9c0a41d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 19:15:23.489472 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:23.489472 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:23.489472 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:23.489472 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:23.489472 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:23.489472 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:23.489472 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:23.489472 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:23.489472 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:23.489472 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:23.489472 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:23.489472 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:15:23.489472 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:15:23.489472 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:15:23.489472 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:15:23.490357 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:15:23.490357 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:15:23.490357 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:15:23.490357 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:15:23.490357 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:23.490357 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:23.490357 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:23.490357 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:23.490357 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:23.490357 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:23.490357 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:23.490357 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:23.490357 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:23.490357 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:23.490357 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:23.490357 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:23.491992 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:23.491992 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:23.491992 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:23.491992 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:23.491992 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:15:23.491992 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:15:23.491992 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:15:23.491992 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:15:23.491992 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:15:23.491992 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:15:23.491992 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 19:15:23.491992 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:23.494865 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 276/545] 10.222.0.60 () {56 vars in 1102 bytes} [Thu Jul 21 19:15:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:23.500675 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf09b3-c729-4430-9879-240f9c0a41d4 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:23.605324 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:23.619826 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:23.641902 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 270/546] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:15:23.655298 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf09b3-c729-4430-9879-240f9c0a41d4 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:23.672643 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e4c432-70e8-4db6-bd93-83079d9426d6 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:23.708002 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983957c-390b-47cf-8ee5-0d5bba381368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:23.708684 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983957c-390b-47cf-8ee5-0d5bba381368 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:23.708974 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983957c-390b-47cf-8ee5-0d5bba381368 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:23.709257 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983957c-390b-47cf-8ee5-0d5bba381368 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:23.710058 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983957c-390b-47cf-8ee5-0d5bba381368 None admin] RBAC: Adding query filter params (name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:23.710404 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983957c-390b-47cf-8ee5-0d5bba381368 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:23.711911 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983957c-390b-47cf-8ee5-0d5bba381368 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:23.736175 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 277/547] 10.222.0.60 () {56 vars in 1103 bytes} [Thu Jul 21 19:15:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:15:23.738421 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983957c-390b-47cf-8ee5-0d5bba381368 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:23.889966 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e4c432-70e8-4db6-bd93-83079d9426d6 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:23.906874 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983957c-390b-47cf-8ee5-0d5bba381368 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:23.939854 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:23.948709 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca56234e-e804-4b31-b81f-845d16167c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:23.949521 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56234e-e804-4b31-b81f-845d16167c44 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:23.949806 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56234e-e804-4b31-b81f-845d16167c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:23.950090 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56234e-e804-4b31-b81f-845d16167c44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:23.965870 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c4d90-2aca-4451-bbca-1f8dbde20a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:23.966706 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c4d90-2aca-4451-bbca-1f8dbde20a67 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:23.966994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c4d90-2aca-4451-bbca-1f8dbde20a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:23.967272 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c4d90-2aca-4451-bbca-1f8dbde20a67 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:23.977731 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca56234e-e804-4b31-b81f-845d16167c44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:23.979253 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca56234e-e804-4b31-b81f-845d16167c44 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:23.996076 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586c4d90-2aca-4451-bbca-1f8dbde20a67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:15:24.003526 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-ca56234e-e804-4b31-b81f-845d16167c44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:24.003526 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:24.003526 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:24.003526 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:24.003526 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:24.003526 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:24.003526 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:24.003526 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:24.003526 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:24.003526 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:24.003526 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:24.003526 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:24.003526 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:24.003526 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:24.003526 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:24.004346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:24.004346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:24.004346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:24.004346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:24.004346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:24.004346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:24.004346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:24.004346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:24.004346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:24.004346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:24.004346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:24.004346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:24.004346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:24.004346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:24.004346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:24.004346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:24.004346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:24.005695 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:24.005695 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:24.005695 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:24.005695 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:24.005914 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-586c4d90-2aca-4451-bbca-1f8dbde20a67 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 19:15:24.005914 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:24.005914 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:24.005914 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:24.005914 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:24.005914 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:24.005914 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:24.005914 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:24.005914 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:24.005914 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:24.005914 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:24.005914 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:24.005914 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:15:24.005914 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:15:24.005914 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:15:24.005914 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:15:24.008019 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:15:24.008019 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:15:24.008019 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:15:24.008019 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:15:24.008019 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:24.008019 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:24.008019 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:24.008019 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:24.008019 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:24.008019 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:24.008019 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:24.008019 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:24.008019 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:24.008019 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:24.008019 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:24.008019 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:24.009982 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:24.009982 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:24.009982 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:24.009982 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:24.009982 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:15:24.009982 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:15:24.009982 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:15:24.009982 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:15:24.009982 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:15:24.009982 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:15:24.009982 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 19:15:24.009982 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:24.011464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 278/548] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:24.011916 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 271/549] 10.222.0.60 () {56 vars in 1102 bytes} [Thu Jul 21 19:15:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:15:24.018228 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c4d90-2aca-4451-bbca-1f8dbde20a67 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:24.018468 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca56234e-e804-4b31-b81f-845d16167c44 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:24.076935 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:24.132713 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c4d90-2aca-4451-bbca-1f8dbde20a67 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:24.170334 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af259bf-a804-4b1f-9844-2505201a3516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:24.170984 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af259bf-a804-4b1f-9844-2505201a3516 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:24.171341 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af259bf-a804-4b1f-9844-2505201a3516 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:24.171817 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af259bf-a804-4b1f-9844-2505201a3516 None admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:24.172690 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af259bf-a804-4b1f-9844-2505201a3516 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:24.173045 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af259bf-a804-4b1f-9844-2505201a3516 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:24.174448 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af259bf-a804-4b1f-9844-2505201a3516 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:24.188995 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca56234e-e804-4b31-b81f-845d16167c44 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:24.201560 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 272/550] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:24.207112 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af259bf-a804-4b1f-9844-2505201a3516 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:24.246992 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc76dbeb-40e7-4525-aaba-078b040a3bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:24.247697 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76dbeb-40e7-4525-aaba-078b040a3bfe None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:24.247982 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76dbeb-40e7-4525-aaba-078b040a3bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:24.248263 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76dbeb-40e7-4525-aaba-078b040a3bfe None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:24.249005 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc76dbeb-40e7-4525-aaba-078b040a3bfe None admin] RBAC: Adding query filter params (name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:24.249316 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc76dbeb-40e7-4525-aaba-078b040a3bfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:24.250700 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc76dbeb-40e7-4525-aaba-078b040a3bfe None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:24.277731 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 279/551] 10.222.0.60 () {56 vars in 1103 bytes} [Thu Jul 21 19:15:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:24.283494 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc76dbeb-40e7-4525-aaba-078b040a3bfe None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:24.329175 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:24.402784 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af259bf-a804-4b1f-9844-2505201a3516 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:24.419129 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:24.449074 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ba156-6642-4146-8272-c24190c210f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:24.449892 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ba156-6642-4146-8272-c24190c210f6 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:24.450204 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ba156-6642-4146-8272-c24190c210f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:24.450514 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ba156-6642-4146-8272-c24190c210f6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:24.466404 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19ba156-6642-4146-8272-c24190c210f6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:24.467913 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19ba156-6642-4146-8272-c24190c210f6 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:24.473455 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc76dbeb-40e7-4525-aaba-078b040a3bfe None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:24.503736 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-a19ba156-6642-4146-8272-c24190c210f6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 19:15:24.503736 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:24.503736 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:24.503736 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:24.503736 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:24.503736 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:24.503736 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:24.503736 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:24.503736 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:24.503736 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:24.503736 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:24.503736 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:24.503736 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 19:15:24.503736 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 19:15:24.503736 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 19:15:24.503736 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 19:15:24.504728 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:24.504728 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:24.504728 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 19:15:24.504728 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:15:24.504728 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 19:15:24.504728 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:15:24.504728 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:24.504728 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:24.504728 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:24.504728 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:24.504728 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:24.504728 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:24.504728 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:24.504728 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:24.504728 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:24.504728 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:24.504728 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:24.504728 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:24.505639 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:24.505639 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:24.505639 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 19:15:24.505639 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 19:15:24.505639 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 19:15:24.505639 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 19:15:24.505639 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 19:15:24.505639 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 19:15:24.505639 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 19:15:24.505639 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:24.507634 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 273/552] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Jul 21 19:15:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:15:24.512582 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ba156-6642-4146-8272-c24190c210f6 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:24.545758 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d3746-5db0-4ead-bcfd-2dd0bb54d682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:24.546564 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d3746-5db0-4ead-bcfd-2dd0bb54d682 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:24.546847 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d3746-5db0-4ead-bcfd-2dd0bb54d682 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:24.547121 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d3746-5db0-4ead-bcfd-2dd0bb54d682 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:24.570500 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d3746-5db0-4ead-bcfd-2dd0bb54d682 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:24.571996 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d3746-5db0-4ead-bcfd-2dd0bb54d682 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:24.608995 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-818d3746-5db0-4ead-bcfd-2dd0bb54d682 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:24.608995 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:24.608995 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:24.608995 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:24.608995 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:24.608995 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:24.608995 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:24.608995 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:24.608995 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:24.608995 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:24.608995 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:24.608995 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:24.608995 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:24.608995 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:24.608995 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:24.609952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:24.609952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:24.609952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:24.609952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:24.609952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:24.609952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:24.609952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:24.609952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:24.609952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:24.609952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:24.609952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:24.609952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:24.609952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:24.609952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:24.609952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:24.609952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:24.609952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:24.610815 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:24.610815 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:24.610815 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:24.610815 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:24.616256 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 280/553] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:24.617139 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d3746-5db0-4ead-bcfd-2dd0bb54d682 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:24.719120 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ba156-6642-4146-8272-c24190c210f6 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:24.733872 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:24.755264 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d3746-5db0-4ead-bcfd-2dd0bb54d682 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:24.758034 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6eb8f7-314f-4222-a40c-88d5cd6af93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:24.759793 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6eb8f7-314f-4222-a40c-88d5cd6af93d None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:24.760276 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6eb8f7-314f-4222-a40c-88d5cd6af93d None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:24.760745 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6eb8f7-314f-4222-a40c-88d5cd6af93d None admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:24.761775 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6eb8f7-314f-4222-a40c-88d5cd6af93d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:24.762290 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6eb8f7-314f-4222-a40c-88d5cd6af93d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:24.764477 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6eb8f7-314f-4222-a40c-88d5cd6af93d None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:24.790417 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 274/554] 10.222.0.60 () {56 vars in 1135 bytes} [Thu Jul 21 19:15:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:24.792309 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ce7c1-2f9a-4611-b9ea-f89878d952aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:24.792704 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7e026-0c39-42a3-8c97-410be4e1a721 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:24.793117 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ce7c1-2f9a-4611-b9ea-f89878d952aa None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:24.793466 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7e026-0c39-42a3-8c97-410be4e1a721 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:24.793570 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ce7c1-2f9a-4611-b9ea-f89878d952aa None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:24.793911 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ce7c1-2f9a-4611-b9ea-f89878d952aa None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:24.794388 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7e026-0c39-42a3-8c97-410be4e1a721 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:24.794855 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ce7c1-2f9a-4611-b9ea-f89878d952aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:24.795229 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ce7c1-2f9a-4611-b9ea-f89878d952aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:24.800251 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ce7c1-2f9a-4611-b9ea-f89878d952aa None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:24.800378 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 275/555] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:24.801300 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7e026-0c39-42a3-8c97-410be4e1a721 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:24.813395 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 281/556] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:24.814751 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d561fb2-3f23-4eb3-8d1e-e18e03a68982 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:24.815042 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d561fb2-3f23-4eb3-8d1e-e18e03a68982 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:24.815369 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d561fb2-3f23-4eb3-8d1e-e18e03a68982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:24.833081 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-3d561fb2-3f23-4eb3-8d1e-e18e03a68982 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:24.835111 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3d561fb2-3f23-4eb3-8d1e-e18e03a68982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:24.841474 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:24.920461 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7e026-0c39-42a3-8c97-410be4e1a721 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:24.933301 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 282/557] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:15:24.933301 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d561fb2-3f23-4eb3-8d1e-e18e03a68982 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:24.972649 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf01d9-b67f-4086-bfc9-4ecf737b028a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:24.973220 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf01d9-b67f-4086-bfc9-4ecf737b028a None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:24.973503 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf01d9-b67f-4086-bfc9-4ecf737b028a None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:24.973775 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf01d9-b67f-4086-bfc9-4ecf737b028a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:25.031134 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:25.045918 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf01d9-b67f-4086-bfc9-4ecf737b028a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:25.048025 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf01d9-b67f-4086-bfc9-4ecf737b028a None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:25.060114 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d561fb2-3f23-4eb3-8d1e-e18e03a68982 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:25.079990 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:25.097692 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0d8ef-4110-4878-95e1-0536d73158d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:25.098486 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0d8ef-4110-4878-95e1-0536d73158d8 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:25.098785 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0d8ef-4110-4878-95e1-0536d73158d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:25.099043 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0d8ef-4110-4878-95e1-0536d73158d8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:25.106582 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc0d8ef-4110-4878-95e1-0536d73158d8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:25.108092 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc0d8ef-4110-4878-95e1-0536d73158d8 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:25.123199 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-ebc0d8ef-4110-4878-95e1-0536d73158d8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 19:15:25.123199 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:25.123199 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:25.123199 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:25.123199 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:25.123199 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:25.123199 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:25.123199 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:25.123199 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:25.123199 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:25.123199 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:25.123199 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:25.123199 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 19:15:25.123199 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 19:15:25.123199 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 19:15:25.123199 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 19:15:25.124647 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:25.124647 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:25.124647 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 19:15:25.124647 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:15:25.124647 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 19:15:25.124647 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:15:25.124647 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:25.124647 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:25.124647 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:25.124647 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:25.124647 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:25.124647 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:25.124647 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:25.124647 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:25.124647 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:25.124647 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:25.124647 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:25.124647 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:25.126011 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:25.126011 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:25.126011 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 19:15:25.126011 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 19:15:25.126011 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 19:15:25.126011 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 19:15:25.126011 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 19:15:25.126011 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 19:15:25.126011 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 19:15:25.126011 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:25.129412 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 283/558] 10.222.0.60 () {56 vars in 1093 bytes} [Thu Jul 21 19:15:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:25.130059 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0d8ef-4110-4878-95e1-0536d73158d8 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:25.159621 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 276/559] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:15:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 19:15:25.159621 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269fe366-2702-4530-b38d-2083dd7b5e75 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:25.159621 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269fe366-2702-4530-b38d-2083dd7b5e75 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:25.159621 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269fe366-2702-4530-b38d-2083dd7b5e75 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:25.159621 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 277/560] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:25.159621 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269fe366-2702-4530-b38d-2083dd7b5e75 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:25.242250 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0d8ef-4110-4878-95e1-0536d73158d8 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:25.274641 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269fe366-2702-4530-b38d-2083dd7b5e75 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:25.278670 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86721d7a-eb7a-48a9-9c93-fe90ea87d313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:25.279482 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86721d7a-eb7a-48a9-9c93-fe90ea87d313 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:25.279767 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86721d7a-eb7a-48a9-9c93-fe90ea87d313 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:25.280037 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86721d7a-eb7a-48a9-9c93-fe90ea87d313 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:25.282342 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:25.291353 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86721d7a-eb7a-48a9-9c93-fe90ea87d313 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:15:25.299358 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-86721d7a-eb7a-48a9-9c93-fe90ea87d313 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 19:15:25.299358 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:25.299358 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:25.299358 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:25.299358 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:25.299358 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:25.299358 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:25.299358 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:25.299358 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:25.299358 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:25.299358 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:25.299358 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:25.299358 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:15:25.299358 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:15:25.299358 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:15:25.299358 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:15:25.300624 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:15:25.300624 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:15:25.300624 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:15:25.300624 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:15:25.300624 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:25.300624 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:25.300624 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:25.300624 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:25.300624 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:25.300624 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:25.300624 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:25.300624 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:25.300624 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:25.300624 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:25.300624 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:25.300624 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:25.301592 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:25.301592 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:25.301592 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:25.301592 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:25.301592 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:15:25.301592 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:15:25.301592 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:15:25.301592 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:15:25.301592 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:15:25.301592 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:15:25.301592 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 19:15:25.301592 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:25.301592 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 284/561] 10.222.0.60 () {56 vars in 1102 bytes} [Thu Jul 21 19:15:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:25.302298 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86721d7a-eb7a-48a9-9c93-fe90ea87d313 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:25.313125 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:25.319857 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7477dc20-487f-47d9-b082-a58604d5240b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:25.320907 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477dc20-487f-47d9-b082-a58604d5240b None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:25.321206 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477dc20-487f-47d9-b082-a58604d5240b None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:25.321575 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477dc20-487f-47d9-b082-a58604d5240b None admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:25.322319 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7477dc20-487f-47d9-b082-a58604d5240b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:25.322627 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7477dc20-487f-47d9-b082-a58604d5240b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:25.324118 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7477dc20-487f-47d9-b082-a58604d5240b None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:25.341285 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 278/562] 10.222.0.60 () {56 vars in 1133 bytes} [Thu Jul 21 19:15:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:25.342740 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aafd387-3552-4419-b694-8ef52fa3d65b None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:25.343036 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aafd387-3552-4419-b694-8ef52fa3d65b None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:25.343314 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aafd387-3552-4419-b694-8ef52fa3d65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:25.365434 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-7aafd387-3552-4419-b694-8ef52fa3d65b None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:25.366712 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-7aafd387-3552-4419-b694-8ef52fa3d65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:25.424023 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86721d7a-eb7a-48a9-9c93-fe90ea87d313 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:25.437200 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 279/563] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:15:25.438062 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aafd387-3552-4419-b694-8ef52fa3d65b None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:25.459011 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f6927-0e6f-433a-8b5f-bbf8894aabf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:25.460411 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f6927-0e6f-433a-8b5f-bbf8894aabf6 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:25.460700 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f6927-0e6f-433a-8b5f-bbf8894aabf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:25.460979 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f6927-0e6f-433a-8b5f-bbf8894aabf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:25.471755 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f6927-0e6f-433a-8b5f-bbf8894aabf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:25.473244 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f6927-0e6f-433a-8b5f-bbf8894aabf6 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:25.490200 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-b34f6927-0e6f-433a-8b5f-bbf8894aabf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:25.490200 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:25.490200 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:25.490200 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:25.490200 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:25.490200 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:25.490200 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:25.490200 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:25.490200 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:25.490200 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:25.490200 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:25.490200 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:25.490200 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:25.490200 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:25.490200 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:25.491172 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:25.491172 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:25.491172 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:25.491172 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:25.491172 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:25.491172 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:25.491172 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:25.491172 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:25.491172 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:25.491172 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:25.491172 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:25.491172 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:25.491172 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:25.491172 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:25.491172 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:25.491172 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:25.491172 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:25.492377 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:25.492377 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:25.492377 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:25.492377 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:25.492377 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 285/564] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:25.492377 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f6927-0e6f-433a-8b5f-bbf8894aabf6 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:25.538781 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:25.540218 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aafd387-3552-4419-b694-8ef52fa3d65b None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:25.557409 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:25.573722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be358ad9-fd8d-4536-844c-8d59fcd607a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:25.574383 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be358ad9-fd8d-4536-844c-8d59fcd607a0 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:25.574663 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be358ad9-fd8d-4536-844c-8d59fcd607a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:25.574946 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be358ad9-fd8d-4536-844c-8d59fcd607a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:25.575713 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be358ad9-fd8d-4536-844c-8d59fcd607a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:25.576017 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be358ad9-fd8d-4536-844c-8d59fcd607a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:25.577409 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be358ad9-fd8d-4536-844c-8d59fcd607a0 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:25.585812 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 280/565] 10.222.0.60 () {56 vars in 1103 bytes} [Thu Jul 21 19:15:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:25.587014 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d66e0-4c90-4753-b01e-ffa440f7294b None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:25.587304 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d66e0-4c90-4753-b01e-ffa440f7294b None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:25.587610 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d66e0-4c90-4753-b01e-ffa440f7294b None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:25.589010 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 281/566] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:25.589624 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d66e0-4c90-4753-b01e-ffa440f7294b None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:25.596659 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f6927-0e6f-433a-8b5f-bbf8894aabf6 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:25.630308 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ed6cd-8d12-4621-a61b-b98e6d7a9b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:25.631119 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ed6cd-8d12-4621-a61b-b98e6d7a9b90 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:25.632101 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ed6cd-8d12-4621-a61b-b98e6d7a9b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:25.632470 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ed6cd-8d12-4621-a61b-b98e6d7a9b90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:25.642921 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ed6cd-8d12-4621-a61b-b98e6d7a9b90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:25.644414 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ed6cd-8d12-4621-a61b-b98e6d7a9b90 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:25.662136 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-e65ed6cd-8d12-4621-a61b-b98e6d7a9b90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:25.662136 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:25.662136 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:25.662136 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:25.662136 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:25.662136 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:25.662136 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:25.662136 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:25.662136 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:25.662136 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:25.662136 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:25.662136 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:25.662136 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:25.662136 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:25.662136 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:25.663069 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:25.663069 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:25.663069 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:25.663069 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:25.663069 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:25.663069 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:25.663069 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:25.663069 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:25.663069 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:25.663069 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:25.663069 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:25.663069 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:25.663069 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:25.663069 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:25.663069 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:25.663069 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:25.663069 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:25.664113 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:25.664113 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:25.664113 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:25.664113 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:25.664113 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 286/567] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:25.664532 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ed6cd-8d12-4621-a61b-b98e6d7a9b90 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:25.690386 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d66e0-4c90-4753-b01e-ffa440f7294b None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:25.723636 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7689fb-88a2-4194-b2db-be494fa96000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:25.724424 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7689fb-88a2-4194-b2db-be494fa96000 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:25.724707 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7689fb-88a2-4194-b2db-be494fa96000 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:25.724992 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7689fb-88a2-4194-b2db-be494fa96000 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:25.734907 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7689fb-88a2-4194-b2db-be494fa96000 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:15:25.743359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-5d7689fb-88a2-4194-b2db-be494fa96000 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 19:15:25.743359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:25.743359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:25.743359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:25.743359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:25.743359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:25.743359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:25.743359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:25.743359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:25.743359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:25.743359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:25.743359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:25.743359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:15:25.743359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:15:25.743359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:15:25.743359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:15:25.744472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:15:25.744472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:15:25.744472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:15:25.744472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:15:25.744472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:25.744472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:25.744472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:25.744472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:25.744472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:25.744472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:25.744472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:25.744472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:25.744472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:25.744472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:25.744472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:25.744472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:25.750153 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:25.750153 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:25.750153 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:25.750153 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:25.750153 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:15:25.750153 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:15:25.750153 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:15:25.750153 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:15:25.750153 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:15:25.750153 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:15:25.750153 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 19:15:25.750153 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:25.750153 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 282/568] 10.222.0.60 () {56 vars in 1102 bytes} [Thu Jul 21 19:15:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:25.750153 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7689fb-88a2-4194-b2db-be494fa96000 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:25.762866 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:25.766622 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ed6cd-8d12-4621-a61b-b98e6d7a9b90 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:25.787142 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:25.799889 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b026e9-1290-47c6-91ef-6cebf4d75447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:25.800555 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b026e9-1290-47c6-91ef-6cebf4d75447 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:25.800845 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b026e9-1290-47c6-91ef-6cebf4d75447 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:25.801119 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b026e9-1290-47c6-91ef-6cebf4d75447 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:25.801837 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b026e9-1290-47c6-91ef-6cebf4d75447 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:25.802141 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b026e9-1290-47c6-91ef-6cebf4d75447 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:25.805820 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b026e9-1290-47c6-91ef-6cebf4d75447 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:25.818006 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 287/569] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:25.819901 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243669ef-0910-41f9-9bbc-bfdf8bbbaa68 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:25.820189 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243669ef-0910-41f9-9bbc-bfdf8bbbaa68 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:25.820448 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243669ef-0910-41f9-9bbc-bfdf8bbbaa68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:25.836664 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-243669ef-0910-41f9-9bbc-bfdf8bbbaa68 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:25.837830 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-243669ef-0910-41f9-9bbc-bfdf8bbbaa68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:25.845764 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7689fb-88a2-4194-b2db-be494fa96000 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:25.878702 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf6d00-6b1d-40f2-a5d6-03baf4285b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:25.879513 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf6d00-6b1d-40f2-a5d6-03baf4285b50 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:25.879800 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf6d00-6b1d-40f2-a5d6-03baf4285b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:25.880077 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf6d00-6b1d-40f2-a5d6-03baf4285b50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:25.890902 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf6d00-6b1d-40f2-a5d6-03baf4285b50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:25.892381 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf6d00-6b1d-40f2-a5d6-03baf4285b50 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:25.904452 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 288/570] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:15:25.905271 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243669ef-0910-41f9-9bbc-bfdf8bbbaa68 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:25.909715 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-5acf6d00-6b1d-40f2-a5d6-03baf4285b50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:25.909715 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:25.909715 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:25.909715 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:25.909715 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:25.909715 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:25.909715 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:25.909715 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:25.909715 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:25.909715 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:25.909715 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:25.909715 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:25.909715 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:25.909715 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:25.909715 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:25.910747 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:25.910747 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:25.910747 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:25.910747 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:25.910747 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:25.910747 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:25.910747 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:25.910747 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:25.910747 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:25.910747 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:25.910747 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:25.910747 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:25.910747 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:25.910747 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:25.910747 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:25.910747 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:25.910747 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:25.911954 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:25.911954 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:25.911954 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:25.911954 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:25.911954 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 283/571] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:25.913305 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf6d00-6b1d-40f2-a5d6-03baf4285b50 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:26.001542 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:26.004187 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:26.013023 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf6d00-6b1d-40f2-a5d6-03baf4285b50 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:26.013906 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243669ef-0910-41f9-9bbc-bfdf8bbbaa68 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:26.045535 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61997355-1219-4cc7-b6ea-a0d79b51dd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:26.046194 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61997355-1219-4cc7-b6ea-a0d79b51dd2a None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:26.046744 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61997355-1219-4cc7-b6ea-a0d79b51dd2a None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:26.046744 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61997355-1219-4cc7-b6ea-a0d79b51dd2a None admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:26.047479 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61997355-1219-4cc7-b6ea-a0d79b51dd2a None admin] RBAC: Adding query filter params (name=service) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:26.047786 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61997355-1219-4cc7-b6ea-a0d79b51dd2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:26.049181 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61997355-1219-4cc7-b6ea-a0d79b51dd2a None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:26.049604 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cccad5a-3b2b-44ba-840e-1dac02c3ebee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:26.050273 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cccad5a-3b2b-44ba-840e-1dac02c3ebee None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:26.050559 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cccad5a-3b2b-44ba-840e-1dac02c3ebee None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:26.050839 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cccad5a-3b2b-44ba-840e-1dac02c3ebee None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:26.051595 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cccad5a-3b2b-44ba-840e-1dac02c3ebee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:26.051911 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cccad5a-3b2b-44ba-840e-1dac02c3ebee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:26.054119 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cccad5a-3b2b-44ba-840e-1dac02c3ebee None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:26.057970 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 284/572] 10.222.0.60 () {56 vars in 1103 bytes} [Thu Jul 21 19:15:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:26.058762 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61997355-1219-4cc7-b6ea-a0d79b51dd2a None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:26.065782 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 289/573] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:26.066590 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cccad5a-3b2b-44ba-840e-1dac02c3ebee None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:26.159072 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61997355-1219-4cc7-b6ea-a0d79b51dd2a None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:26.168142 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cccad5a-3b2b-44ba-840e-1dac02c3ebee None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:26.192295 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8884a68-82bf-4aca-89bb-67bf8cad4657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:26.193084 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8884a68-82bf-4aca-89bb-67bf8cad4657 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:26.193374 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8884a68-82bf-4aca-89bb-67bf8cad4657 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:26.193647 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8884a68-82bf-4aca-89bb-67bf8cad4657 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:26.200884 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8884a68-82bf-4aca-89bb-67bf8cad4657 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:26.201704 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f6647-27ad-45b2-8edc-858f38dccc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:26.202340 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8884a68-82bf-4aca-89bb-67bf8cad4657 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:26.202497 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f6647-27ad-45b2-8edc-858f38dccc2c None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:26.202787 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f6647-27ad-45b2-8edc-858f38dccc2c None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:26.203069 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f6647-27ad-45b2-8edc-858f38dccc2c None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:26.203833 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f6647-27ad-45b2-8edc-858f38dccc2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:26.204145 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f6647-27ad-45b2-8edc-858f38dccc2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:26.205504 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f6647-27ad-45b2-8edc-858f38dccc2c None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:26.217232 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 290/574] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:26.218033 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f6647-27ad-45b2-8edc-858f38dccc2c None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:26.221176 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-c8884a68-82bf-4aca-89bb-67bf8cad4657 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:15:26.221176 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:26.221176 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:26.221176 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:26.221176 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:26.221176 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:26.221176 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:26.221176 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:26.221176 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:26.221176 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:26.221176 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:26.221176 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:26.221176 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 19:15:26.221176 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 19:15:26.221176 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 19:15:26.222079 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 19:15:26.222079 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:26.222079 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:26.222079 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:26.222079 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:26.222079 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:26.222079 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:26.222079 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:26.222079 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:26.222079 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:26.222079 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:26.222079 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:26.222079 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:26.222079 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:26.222079 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:26.222079 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:26.222079 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:26.222981 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 19:15:26.222981 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 19:15:26.222981 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 19:15:26.222981 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 19:15:26.222981 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 19:15:26.222981 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 19:15:26.222981 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:15:26.222981 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:26.222981 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 285/575] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:15:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:26.224306 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8884a68-82bf-4aca-89bb-67bf8cad4657 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:26.234150 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:26.240410 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:26.321614 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8884a68-82bf-4aca-89bb-67bf8cad4657 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:26.322339 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f6647-27ad-45b2-8edc-858f38dccc2c None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:26.354063 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4d9ab-c3d3-481d-a46f-d4fc311eb179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:26.354925 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4d9ab-c3d3-481d-a46f-d4fc311eb179 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:26.355209 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4d9ab-c3d3-481d-a46f-d4fc311eb179 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:26.355507 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4d9ab-c3d3-481d-a46f-d4fc311eb179 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:26.356361 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30b93f-eafe-4f06-b115-430fd00e187b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:26.357152 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30b93f-eafe-4f06-b115-430fd00e187b None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:26.357438 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30b93f-eafe-4f06-b115-430fd00e187b None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:26.357714 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30b93f-eafe-4f06-b115-430fd00e187b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:26.365266 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4d9ab-c3d3-481d-a46f-d4fc311eb179 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:26.367511 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4d9ab-c3d3-481d-a46f-d4fc311eb179 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:26.370741 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a30b93f-eafe-4f06-b115-430fd00e187b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:15:26.378818 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-7a30b93f-eafe-4f06-b115-430fd00e187b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 19:15:26.378818 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:26.378818 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:26.378818 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:26.378818 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:26.378818 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:26.378818 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:26.378818 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:26.378818 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:26.378818 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:26.378818 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:26.378818 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:26.378818 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:15:26.378818 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:15:26.378818 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:15:26.378818 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:15:26.379864 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:15:26.379864 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:15:26.379864 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:15:26.379864 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:15:26.379864 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:26.379864 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:26.379864 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:26.379864 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:26.379864 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:26.379864 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:26.379864 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:26.379864 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:26.379864 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:26.379864 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:26.379864 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:26.379864 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:26.380710 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:26.380710 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:26.380710 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:26.380710 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:26.380710 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:15:26.380710 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:15:26.380710 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:15:26.380710 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:15:26.380710 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:15:26.380710 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:15:26.380710 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 19:15:26.380710 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:26.380710 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 291/576] 10.222.0.60 () {56 vars in 1102 bytes} [Thu Jul 21 19:15:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:26.381980 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30b93f-eafe-4f06-b115-430fd00e187b None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:26.384562 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-9fa4d9ab-c3d3-481d-a46f-d4fc311eb179 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:26.384562 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:26.384562 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:26.384562 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:26.384562 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:26.384562 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:26.384562 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:26.384562 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:26.384562 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:26.384562 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:26.384562 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:26.384562 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:26.384562 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:26.384562 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:26.384562 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:26.385645 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:26.385645 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:26.385645 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:26.385645 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:26.385645 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:26.385645 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:26.385645 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:26.385645 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:26.385645 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:26.385645 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:26.385645 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:26.385645 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:26.385645 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:26.385645 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:26.385645 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:26.385645 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:26.385645 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:26.386534 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:26.386534 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:26.386534 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:26.386534 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:26.386534 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 286/577] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:26.386534 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4d9ab-c3d3-481d-a46f-d4fc311eb179 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:26.453470 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:26.457470 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:26.486702 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30b93f-eafe-4f06-b115-430fd00e187b None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:26.491039 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4d9ab-c3d3-481d-a46f-d4fc311eb179 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:26.519589 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba3f1b-d754-4261-91eb-fa3a9da55274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:26.520379 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba3f1b-d754-4261-91eb-fa3a9da55274 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:26.520671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba3f1b-d754-4261-91eb-fa3a9da55274 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:26.520945 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba3f1b-d754-4261-91eb-fa3a9da55274 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:26.523780 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3971d-ba7a-4f26-84ec-2a735dfd0d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:26.524592 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3971d-ba7a-4f26-84ec-2a735dfd0d4c None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:26.524871 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3971d-ba7a-4f26-84ec-2a735dfd0d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:26.525141 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3971d-ba7a-4f26-84ec-2a735dfd0d4c None admin] PATH_INFO: `/v3/users/glance` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:26.528079 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beba3f1b-d754-4261-91eb-fa3a9da55274 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:26.529514 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beba3f1b-d754-4261-91eb-fa3a9da55274 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:26.532483 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c3971d-ba7a-4f26-84ec-2a735dfd0d4c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:26.533888 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c3971d-ba7a-4f26-84ec-2a735dfd0d4c None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:26.544226 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-beba3f1b-d754-4261-91eb-fa3a9da55274 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:15:26.544226 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:26.544226 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:26.544226 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:26.544226 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:26.544226 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:26.544226 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:26.544226 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:26.544226 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:26.544226 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:26.544226 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:26.544226 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:26.544226 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 19:15:26.544226 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 19:15:26.544226 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 19:15:26.545081 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 19:15:26.545081 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:26.545081 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:26.545081 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:26.545081 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:26.545081 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:26.545081 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:26.545081 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:26.545081 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:26.545081 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:26.545081 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:26.545081 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:26.545081 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:26.545081 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:26.545081 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:26.545081 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:26.545081 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:26.545964 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 19:15:26.545964 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 19:15:26.545964 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 19:15:26.545964 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 19:15:26.545964 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 19:15:26.545964 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 19:15:26.545964 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:15:26.545964 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:26.545964 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 292/578] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:15:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:26.546705 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba3f1b-d754-4261-91eb-fa3a9da55274 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:26.548058 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-92c3971d-ba7a-4f26-84ec-2a735dfd0d4c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 21 19:15:26.548058 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:26.548058 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:26.548058 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:26.548058 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:26.548058 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:26.548058 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:26.548058 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:26.548058 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:26.548058 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:26.548058 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:26.548058 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:26.548058 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 19:15:26.548058 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 19:15:26.548058 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 19:15:26.548058 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 19:15:26.549125 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:26.549125 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:26.549125 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 19:15:26.549125 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:15:26.549125 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 19:15:26.549125 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:15:26.549125 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:26.549125 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:26.549125 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:26.549125 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:26.549125 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:26.549125 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:26.549125 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:26.549125 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:26.549125 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:26.549125 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:26.549125 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:26.549125 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:26.552043 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:26.552043 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:26.552043 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 19:15:26.552043 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 19:15:26.552043 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 19:15:26.552043 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 19:15:26.552043 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 19:15:26.552043 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 19:15:26.552043 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 21 19:15:26.552043 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:26.552043 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 287/579] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:15:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:26.552043 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3971d-ba7a-4f26-84ec-2a735dfd0d4c None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:26.646767 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3971d-ba7a-4f26-84ec-2a735dfd0d4c None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:26.648832 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba3f1b-d754-4261-91eb-fa3a9da55274 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:26.674018 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:26.679747 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:26.686477 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c2f0a0-92ab-4ecf-8cae-384875e063f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:26.686477 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2f0a0-92ab-4ecf-8cae-384875e063f2 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:26.686477 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2f0a0-92ab-4ecf-8cae-384875e063f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:26.686477 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2f0a0-92ab-4ecf-8cae-384875e063f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:26.686876 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c2f0a0-92ab-4ecf-8cae-384875e063f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:26.686876 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c2f0a0-92ab-4ecf-8cae-384875e063f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:26.686876 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c2f0a0-92ab-4ecf-8cae-384875e063f2 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:26.687589 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273aa87e-4b12-4cdc-859d-0fabc797104f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:26.688245 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273aa87e-4b12-4cdc-859d-0fabc797104f None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:26.688529 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273aa87e-4b12-4cdc-859d-0fabc797104f None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:26.688809 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273aa87e-4b12-4cdc-859d-0fabc797104f None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:26.689587 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273aa87e-4b12-4cdc-859d-0fabc797104f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:26.689898 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273aa87e-4b12-4cdc-859d-0fabc797104f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:26.691316 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273aa87e-4b12-4cdc-859d-0fabc797104f None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:26.694762 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 288/580] 10.222.0.60 () {56 vars in 1103 bytes} [Thu Jul 21 19:15:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:26.695560 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c2f0a0-92ab-4ecf-8cae-384875e063f2 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:26.707800 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 293/581] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Jul 21 19:15:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:26.707800 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273aa87e-4b12-4cdc-859d-0fabc797104f None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:26.795143 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c2f0a0-92ab-4ecf-8cae-384875e063f2 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:26.800758 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273aa87e-4b12-4cdc-859d-0fabc797104f None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:26.829035 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc204c-d7ff-428a-b0a6-7bd6da60da4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:26.829684 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc204c-d7ff-428a-b0a6-7bd6da60da4f None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:26.829965 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc204c-d7ff-428a-b0a6-7bd6da60da4f None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:26.830237 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc204c-d7ff-428a-b0a6-7bd6da60da4f None admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:26.830947 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc204c-d7ff-428a-b0a6-7bd6da60da4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:26.831251 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc204c-d7ff-428a-b0a6-7bd6da60da4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:26.832641 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc204c-d7ff-428a-b0a6-7bd6da60da4f None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:26.836034 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf745dd4-3902-49df-9e8c-bd52a82de90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:26.836684 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf745dd4-3902-49df-9e8c-bd52a82de90b None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:26.836968 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf745dd4-3902-49df-9e8c-bd52a82de90b None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:26.837247 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf745dd4-3902-49df-9e8c-bd52a82de90b None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:26.838018 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf745dd4-3902-49df-9e8c-bd52a82de90b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:26.838328 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf745dd4-3902-49df-9e8c-bd52a82de90b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:26.839749 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf745dd4-3902-49df-9e8c-bd52a82de90b None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:26.844774 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 289/582] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:26.845565 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc204c-d7ff-428a-b0a6-7bd6da60da4f None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:26.851855 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 294/583] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Jul 21 19:15:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:26.852655 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf745dd4-3902-49df-9e8c-bd52a82de90b None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:26.893382 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:26.903726 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:26.942553 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc204c-d7ff-428a-b0a6-7bd6da60da4f None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:26.950882 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf745dd4-3902-49df-9e8c-bd52a82de90b None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:26.975582 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe48031-e514-4d12-a718-64f0290d3d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:26.976254 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe48031-e514-4d12-a718-64f0290d3d55 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:26.976538 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe48031-e514-4d12-a718-64f0290d3d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:26.976816 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe48031-e514-4d12-a718-64f0290d3d55 None admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:26.977658 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe48031-e514-4d12-a718-64f0290d3d55 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:26.977954 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe48031-e514-4d12-a718-64f0290d3d55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:26.979378 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe48031-e514-4d12-a718-64f0290d3d55 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:26.985456 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba4fe8-f1f8-4995-8599-2dd56db87f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:26.986237 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba4fe8-f1f8-4995-8599-2dd56db87f1d None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:26.986515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba4fe8-f1f8-4995-8599-2dd56db87f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:26.986789 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba4fe8-f1f8-4995-8599-2dd56db87f1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:26.996115 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 290/584] 10.222.0.60 () {56 vars in 1137 bytes} [Thu Jul 21 19:15:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:26.996675 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba4fe8-f1f8-4995-8599-2dd56db87f1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:26.996905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe48031-e514-4d12-a718-64f0290d3d55 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:26.998148 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba4fe8-f1f8-4995-8599-2dd56db87f1d None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:27.017291 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-69ba4fe8-f1f8-4995-8599-2dd56db87f1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:27.017291 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:27.017291 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:27.017291 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:27.017291 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:27.017291 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:27.017291 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:27.017291 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:27.017291 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:27.017291 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:27.017291 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:27.017291 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:27.017291 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:27.017291 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:27.017291 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:27.018456 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:27.018456 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:27.018456 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:27.018456 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:27.018456 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:27.018456 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:27.018456 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:27.018456 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:27.018456 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:27.018456 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:27.018456 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:27.018456 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:27.018456 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:27.018456 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:27.018456 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:27.018456 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:27.018456 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:27.024726 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:27.024726 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:27.024726 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:27.024726 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:27.024726 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 295/585] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:27.024726 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba4fe8-f1f8-4995-8599-2dd56db87f1d None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:27.093579 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe48031-e514-4d12-a718-64f0290d3d55 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:27.101547 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:27.116515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:27.119634 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba4fe8-f1f8-4995-8599-2dd56db87f1d None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:27.127243 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770a469-0c88-4f26-bf7a-79fb6a817140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:27.127924 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770a469-0c88-4f26-bf7a-79fb6a817140 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:27.128207 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770a469-0c88-4f26-bf7a-79fb6a817140 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:27.128479 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770a469-0c88-4f26-bf7a-79fb6a817140 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:27.129301 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770a469-0c88-4f26-bf7a-79fb6a817140 None admin] RBAC: Adding query filter params (role.id=beeebaa4e16c40f387f05b67124a424d, scope.project.id=9847b5e8bc0b4483bbce060a48f405f4, user.id=0aa579af53a6441a9205cf82864a640e) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:27.129608 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770a469-0c88-4f26-bf7a-79fb6a817140 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:27.131101 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770a469-0c88-4f26-bf7a-79fb6a817140 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:27.136285 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 291/586] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:15:26 2022] GET /identity/v3/role_assignments?user.id=0aa579af53a6441a9205cf82864a640e&scope.project.id=9847b5e8bc0b4483bbce060a48f405f4&role.id=beeebaa4e16c40f387f05b67124a424d => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:27.137026 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770a469-0c88-4f26-bf7a-79fb6a817140 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:27.160391 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e116d-e485-4641-ad15-73a0db11d613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:27.161184 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e116d-e485-4641-ad15-73a0db11d613 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:27.161473 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e116d-e485-4641-ad15-73a0db11d613 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:27.161756 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e116d-e485-4641-ad15-73a0db11d613 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:27.171074 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e116d-e485-4641-ad15-73a0db11d613 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:27.172598 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e116d-e485-4641-ad15-73a0db11d613 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:27.189662 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-5a8e116d-e485-4641-ad15-73a0db11d613 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 19:15:27.189662 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:27.189662 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:27.189662 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:27.189662 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:27.189662 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:27.189662 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:27.189662 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:27.189662 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:27.189662 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:27.189662 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:27.189662 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:27.189662 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 19:15:27.189662 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 19:15:27.189662 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 19:15:27.189662 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 19:15:27.195542 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:27.195542 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:27.195542 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 19:15:27.195542 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:15:27.195542 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 19:15:27.195542 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:15:27.195542 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:27.195542 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:27.195542 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:27.195542 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:27.195542 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:27.195542 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:27.195542 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:27.195542 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:27.195542 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:27.195542 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:27.195542 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:27.195542 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:27.196529 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:27.196529 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:27.196529 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 19:15:27.196529 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 19:15:27.196529 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 19:15:27.196529 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 19:15:27.196529 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 19:15:27.196529 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 19:15:27.196529 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 19:15:27.196529 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:27.196529 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 296/587] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:15:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:27.197149 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e116d-e485-4641-ad15-73a0db11d613 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:27.307052 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770a469-0c88-4f26-bf7a-79fb6a817140 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:27.342827 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12119d-a907-4e30-a243-9bec6504bdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:27.343771 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12119d-a907-4e30-a243-9bec6504bdf2 None admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:27.344041 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12119d-a907-4e30-a243-9bec6504bdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:27.344316 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12119d-a907-4e30-a243-9bec6504bdf2 None admin] PATH_INFO: `/v3/projects/9847b5e8bc0b4483bbce060a48f405f4/users/6b4d98e967814e5f84f5f0d67ebb3c17/roles/beeebaa4e16c40f387f05b67124a424d` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:27.346479 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e116d-e485-4641-ad15-73a0db11d613 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:27.359831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be12119d-a907-4e30-a243-9bec6504bdf2 None admin] RBAC: Authorizing `identity:create_grant(project_id=9847b5e8bc0b4483bbce060a48f405f4, user_id=6b4d98e967814e5f84f5f0d67ebb3c17, role_id=beeebaa4e16c40f387f05b67124a424d)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:27.361268 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be12119d-a907-4e30-a243-9bec6504bdf2 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:27.386942 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670d9da-5200-4dbe-94fc-a5bddb0828ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:27.387765 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670d9da-5200-4dbe-94fc-a5bddb0828ba None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:27.388048 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670d9da-5200-4dbe-94fc-a5bddb0828ba None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:27.388323 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670d9da-5200-4dbe-94fc-a5bddb0828ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:27.399344 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7670d9da-5200-4dbe-94fc-a5bddb0828ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:27.400869 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7670d9da-5200-4dbe-94fc-a5bddb0828ba None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:27.425782 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-7670d9da-5200-4dbe-94fc-a5bddb0828ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:27.425782 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:27.425782 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:27.425782 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:27.425782 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:27.425782 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:27.425782 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:27.425782 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:27.425782 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:27.425782 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:27.425782 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:27.425782 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:27.425782 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:27.425782 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:27.425782 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:27.427204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:27.427204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:27.427204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:27.427204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:27.427204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:27.427204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:27.427204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:27.427204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:27.427204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:27.427204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:27.427204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:27.427204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:27.427204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:27.427204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:27.427204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:27.427204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:27.427204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:27.428387 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:27.428387 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:27.428387 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:27.428387 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:27.428387 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 297/588] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:27.428387 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670d9da-5200-4dbe-94fc-a5bddb0828ba None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:27.441628 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:27.492621 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 292/589] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Jul 21 19:15:27 2022] PUT /identity/v3/projects/9847b5e8bc0b4483bbce060a48f405f4/users/6b4d98e967814e5f84f5f0d67ebb3c17/roles/beeebaa4e16c40f387f05b67124a424d => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:15:27.493654 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12119d-a907-4e30-a243-9bec6504bdf2 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:27.524961 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:27.543825 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670d9da-5200-4dbe-94fc-a5bddb0828ba None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:27.591057 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cdc0d0-cfda-4729-9343-0c0cfb1b19ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:27.592197 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdc0d0-cfda-4729-9343-0c0cfb1b19ed None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:27.592700 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdc0d0-cfda-4729-9343-0c0cfb1b19ed None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:27.593244 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdc0d0-cfda-4729-9343-0c0cfb1b19ed None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:27.594275 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cdc0d0-cfda-4729-9343-0c0cfb1b19ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:27.594798 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cdc0d0-cfda-4729-9343-0c0cfb1b19ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:27.596505 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cdc0d0-cfda-4729-9343-0c0cfb1b19ed None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:27.614613 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 298/590] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:27.616110 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cdc0d0-cfda-4729-9343-0c0cfb1b19ed None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:27.632223 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12119d-a907-4e30-a243-9bec6504bdf2 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:27.678501 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c413b9-e178-4390-99e5-9e42ab2b6b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:27.679409 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c413b9-e178-4390-99e5-9e42ab2b6b0d None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:27.679735 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c413b9-e178-4390-99e5-9e42ab2b6b0d None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:27.680015 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c413b9-e178-4390-99e5-9e42ab2b6b0d None admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:27.681261 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c413b9-e178-4390-99e5-9e42ab2b6b0d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:27.681573 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c413b9-e178-4390-99e5-9e42ab2b6b0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:27.683575 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c413b9-e178-4390-99e5-9e42ab2b6b0d None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:27.704309 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 293/591] 10.222.0.60 () {56 vars in 1137 bytes} [Thu Jul 21 19:15:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:27.705394 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c413b9-e178-4390-99e5-9e42ab2b6b0d None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:27.715160 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:27.748914 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cdc0d0-cfda-4729-9343-0c0cfb1b19ed None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:27.785770 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e0fa9-c1e8-48a1-9772-15b005a60e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:27.786611 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e0fa9-c1e8-48a1-9772-15b005a60e01 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:27.786987 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e0fa9-c1e8-48a1-9772-15b005a60e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:27.787418 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e0fa9-c1e8-48a1-9772-15b005a60e01 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:27.788562 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e0fa9-c1e8-48a1-9772-15b005a60e01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:27.788984 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e0fa9-c1e8-48a1-9772-15b005a60e01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:27.790518 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e0fa9-c1e8-48a1-9772-15b005a60e01 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:27.804671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 299/592] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:27.805641 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e0fa9-c1e8-48a1-9772-15b005a60e01 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:27.817420 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:27.846712 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c413b9-e178-4390-99e5-9e42ab2b6b0d None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:27.885984 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967b968-94de-4866-b317-7aed7e5ddb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:27.887169 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967b968-94de-4866-b317-7aed7e5ddb0d None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:27.887656 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967b968-94de-4866-b317-7aed7e5ddb0d None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:27.888099 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967b968-94de-4866-b317-7aed7e5ddb0d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:27.896485 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967b968-94de-4866-b317-7aed7e5ddb0d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:27.899407 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967b968-94de-4866-b317-7aed7e5ddb0d None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:27.915418 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-6967b968-94de-4866-b317-7aed7e5ddb0d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 19:15:27.915418 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:27.915418 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:27.915418 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:27.915418 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:27.915418 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:27.915418 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:27.915418 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:27.915418 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:27.915418 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:27.915418 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:27.915418 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:27.915418 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 19:15:27.915418 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 19:15:27.915418 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 19:15:27.915418 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 19:15:27.916612 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:27.916612 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:27.916612 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 19:15:27.916612 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:15:27.916612 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 19:15:27.916612 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:15:27.916612 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:27.916612 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:27.916612 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:27.916612 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:27.916612 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:27.916612 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:27.916612 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:27.916612 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:27.916612 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:27.916612 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:27.916612 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:27.916612 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:27.917794 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:27.917794 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:27.917794 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 19:15:27.917794 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 19:15:27.917794 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 19:15:27.917794 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 19:15:27.917794 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 19:15:27.917794 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 19:15:27.917794 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 19:15:27.917794 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:27.923466 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e0fa9-c1e8-48a1-9772-15b005a60e01 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:27.923758 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 294/593] 10.222.0.60 () {56 vars in 1102 bytes} [Thu Jul 21 19:15:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:27.924768 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967b968-94de-4866-b317-7aed7e5ddb0d None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:27.953658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:27.959039 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fbaefd-392d-477c-8997-f9b17dfdde97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:27.960621 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbaefd-392d-477c-8997-f9b17dfdde97 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:27.960976 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbaefd-392d-477c-8997-f9b17dfdde97 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:27.961365 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbaefd-392d-477c-8997-f9b17dfdde97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:27.972030 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fbaefd-392d-477c-8997-f9b17dfdde97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:27.975237 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fbaefd-392d-477c-8997-f9b17dfdde97 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:27.993819 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-e8fbaefd-392d-477c-8997-f9b17dfdde97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:27.993819 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:27.993819 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:27.993819 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:27.993819 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:27.993819 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:27.993819 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:27.993819 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:27.993819 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:27.993819 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:27.993819 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:27.993819 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:27.993819 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:27.993819 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:27.993819 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:27.994877 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:27.994877 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:27.994877 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:27.994877 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:27.994877 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:27.994877 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:27.994877 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:27.994877 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:27.994877 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:27.994877 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:27.994877 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:27.994877 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:27.994877 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:27.994877 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:27.994877 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:27.994877 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:27.994877 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:27.995885 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:27.995885 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:27.995885 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:27.995885 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:27.995885 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 300/594] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:27.995885 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fbaefd-392d-477c-8997-f9b17dfdde97 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:28.046652 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967b968-94de-4866-b317-7aed7e5ddb0d None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:28.093295 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4481f4-41c9-4b42-8086-fb9feb1a2ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:28.094579 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4481f4-41c9-4b42-8086-fb9feb1a2ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:28.095660 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4481f4-41c9-4b42-8086-fb9feb1a2ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:28.096147 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4481f4-41c9-4b42-8086-fb9feb1a2ee2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:28.102439 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fbaefd-392d-477c-8997-f9b17dfdde97 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:28.105294 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4481f4-41c9-4b42-8086-fb9feb1a2ee2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:28.106996 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4481f4-41c9-4b42-8086-fb9feb1a2ee2 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:28.109013 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:28.124343 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-4d4481f4-41c9-4b42-8086-fb9feb1a2ee2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:15:28.124343 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:28.124343 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:28.124343 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:28.124343 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:28.124343 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:28.124343 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:28.124343 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:28.124343 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:28.124343 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:28.124343 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:28.124343 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:28.124343 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 19:15:28.124343 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 19:15:28.124343 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 19:15:28.125265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 19:15:28.125265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:28.125265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:28.125265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:28.125265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:28.125265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:28.125265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:28.125265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:28.125265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:28.125265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:28.125265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:28.125265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:28.125265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:28.125265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:28.125265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:28.125265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:28.125265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:28.126154 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 19:15:28.126154 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 19:15:28.126154 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 19:15:28.126154 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 19:15:28.126154 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 19:15:28.126154 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 19:15:28.126154 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:15:28.126154 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:28.128440 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 295/595] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:15:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:28.129517 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4481f4-41c9-4b42-8086-fb9feb1a2ee2 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:28.147241 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7561001d-659e-4526-9372-00642dca72de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:28.148322 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561001d-659e-4526-9372-00642dca72de None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:28.148674 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561001d-659e-4526-9372-00642dca72de None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:28.148960 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561001d-659e-4526-9372-00642dca72de None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:28.149926 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7561001d-659e-4526-9372-00642dca72de None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:28.150247 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7561001d-659e-4526-9372-00642dca72de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:28.151729 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7561001d-659e-4526-9372-00642dca72de None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:28.177259 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 301/596] 10.222.0.60 () {56 vars in 1139 bytes} [Thu Jul 21 19:15:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:28.177259 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7561001d-659e-4526-9372-00642dca72de None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:28.224016 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:28.249950 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4481f4-41c9-4b42-8086-fb9feb1a2ee2 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:28.288413 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d37d0-a786-4c8d-a90e-fa7bb64672fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:28.289659 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d37d0-a786-4c8d-a90e-fa7bb64672fe None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:28.290120 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7561001d-659e-4526-9372-00642dca72de None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:28.290377 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d37d0-a786-4c8d-a90e-fa7bb64672fe None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:28.290874 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d37d0-a786-4c8d-a90e-fa7bb64672fe None admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:28.291923 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077d37d0-a786-4c8d-a90e-fa7bb64672fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:28.292545 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077d37d0-a786-4c8d-a90e-fa7bb64672fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:28.294106 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077d37d0-a786-4c8d-a90e-fa7bb64672fe None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:28.307668 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 296/597] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:28.308938 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d37d0-a786-4c8d-a90e-fa7bb64672fe None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:28.328393 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ec6a4-7360-4fdd-b021-9345f3b17b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:28.329085 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ec6a4-7360-4fdd-b021-9345f3b17b9e None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:28.329344 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ec6a4-7360-4fdd-b021-9345f3b17b9e None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:28.329627 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ec6a4-7360-4fdd-b021-9345f3b17b9e None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:28.330426 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ec6a4-7360-4fdd-b021-9345f3b17b9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:28.330841 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ec6a4-7360-4fdd-b021-9345f3b17b9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:28.336756 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ec6a4-7360-4fdd-b021-9345f3b17b9e None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:28.351363 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 302/598] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Jul 21 19:15:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:28.352280 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ec6a4-7360-4fdd-b021-9345f3b17b9e None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:28.385240 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:28.431596 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d37d0-a786-4c8d-a90e-fa7bb64672fe None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:28.463447 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ec6a4-7360-4fdd-b021-9345f3b17b9e None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:28.464987 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:28.469795 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703f74a-ac56-491c-b842-faf4063491ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:28.470843 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703f74a-ac56-491c-b842-faf4063491ce None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:28.471328 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703f74a-ac56-491c-b842-faf4063491ce None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:28.471931 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703f74a-ac56-491c-b842-faf4063491ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:28.483171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f703f74a-ac56-491c-b842-faf4063491ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:28.484899 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f703f74a-ac56-491c-b842-faf4063491ce None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:28.500856 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f9f6bd-edb2-49bb-a921-630f7006f2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:28.501790 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9f6bd-edb2-49bb-a921-630f7006f2f0 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:28.502085 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9f6bd-edb2-49bb-a921-630f7006f2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:28.502368 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9f6bd-edb2-49bb-a921-630f7006f2f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:28.504742 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-f703f74a-ac56-491c-b842-faf4063491ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:28.504742 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:28.504742 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:28.504742 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:28.504742 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:28.504742 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:28.504742 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:28.504742 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:28.504742 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:28.504742 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:28.504742 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:28.504742 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:28.504742 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:28.504742 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:28.504742 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:28.505597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:28.505597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:28.505597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:28.505597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:28.505597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:28.505597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:28.505597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:28.505597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:28.505597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:28.505597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:28.505597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:28.505597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:28.505597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:28.505597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:28.505597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:28.505597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:28.505597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:28.507020 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:28.507020 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:28.507020 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:28.507020 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:28.513464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f9f6bd-edb2-49bb-a921-630f7006f2f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:28.513464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f9f6bd-edb2-49bb-a921-630f7006f2f0 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:28.513868 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 297/599] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:28.514891 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703f74a-ac56-491c-b842-faf4063491ce None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:28.529768 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-92f9f6bd-edb2-49bb-a921-630f7006f2f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:15:28.529768 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:28.529768 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:28.529768 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:28.529768 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:28.529768 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:28.529768 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:28.529768 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:28.529768 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:28.529768 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:28.529768 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:28.529768 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:28.529768 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 19:15:28.529768 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 19:15:28.529768 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 19:15:28.530817 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 19:15:28.530817 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:28.530817 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:28.530817 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:28.530817 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:28.530817 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:28.530817 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:28.530817 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:28.530817 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:28.530817 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:28.530817 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:28.530817 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:28.530817 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:28.530817 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:28.530817 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:28.530817 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:28.530817 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:28.531740 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 19:15:28.531740 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 19:15:28.531740 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 19:15:28.531740 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 19:15:28.531740 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 19:15:28.531740 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 19:15:28.531740 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:15:28.531740 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:28.532159 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 303/600] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:15:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:28.533016 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f9f6bd-edb2-49bb-a921-630f7006f2f0 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:28.626962 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703f74a-ac56-491c-b842-faf4063491ce None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:28.639175 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:28.642059 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f9f6bd-edb2-49bb-a921-630f7006f2f0 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:28.665070 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce433e34-c30f-49fa-91f7-fc3ad1f6dbd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:28.666363 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce433e34-c30f-49fa-91f7-fc3ad1f6dbd4 None admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:28.666833 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce433e34-c30f-49fa-91f7-fc3ad1f6dbd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:28.667316 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce433e34-c30f-49fa-91f7-fc3ad1f6dbd4 None admin] PATH_INFO: `/v3/projects/9847b5e8bc0b4483bbce060a48f405f4/users/1a23a8e608f94d5d8153dcf7e79250f7/roles/beeebaa4e16c40f387f05b67124a424d` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:28.682258 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75a39b-d138-4bb7-b641-cbec88003c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:28.682907 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75a39b-d138-4bb7-b641-cbec88003c98 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:28.683202 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75a39b-d138-4bb7-b641-cbec88003c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:28.683531 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75a39b-d138-4bb7-b641-cbec88003c98 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:28.684493 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75a39b-d138-4bb7-b641-cbec88003c98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:28.684684 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75a39b-d138-4bb7-b641-cbec88003c98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:28.686088 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75a39b-d138-4bb7-b641-cbec88003c98 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:28.688312 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce433e34-c30f-49fa-91f7-fc3ad1f6dbd4 None admin] RBAC: Authorizing `identity:create_grant(project_id=9847b5e8bc0b4483bbce060a48f405f4, user_id=1a23a8e608f94d5d8153dcf7e79250f7, role_id=beeebaa4e16c40f387f05b67124a424d)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:28.690099 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce433e34-c30f-49fa-91f7-fc3ad1f6dbd4 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:28.704958 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 304/601] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:28.704958 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75a39b-d138-4bb7-b641-cbec88003c98 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:28.729852 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:28.773676 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 298/602] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Jul 21 19:15:28 2022] PUT /identity/v3/projects/9847b5e8bc0b4483bbce060a48f405f4/users/1a23a8e608f94d5d8153dcf7e79250f7/roles/beeebaa4e16c40f387f05b67124a424d => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:15:28.774994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce433e34-c30f-49fa-91f7-fc3ad1f6dbd4 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:28.835824 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75a39b-d138-4bb7-b641-cbec88003c98 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:28.898835 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce433e34-c30f-49fa-91f7-fc3ad1f6dbd4 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:28.912241 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da4009-8e50-4448-83df-9efd4d3be857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:28.912973 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da4009-8e50-4448-83df-9efd4d3be857 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:28.913239 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da4009-8e50-4448-83df-9efd4d3be857 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:28.913554 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da4009-8e50-4448-83df-9efd4d3be857 None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:28.914312 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6da4009-8e50-4448-83df-9efd4d3be857 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:28.914619 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6da4009-8e50-4448-83df-9efd4d3be857 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:28.916099 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6da4009-8e50-4448-83df-9efd4d3be857 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:28.938822 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 305/603] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Jul 21 19:15:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:28.939881 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2720517-fdac-4235-888a-967dc60d580e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:28.940973 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2720517-fdac-4235-888a-967dc60d580e None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:28.941478 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2720517-fdac-4235-888a-967dc60d580e None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:28.941970 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2720517-fdac-4235-888a-967dc60d580e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:28.945397 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da4009-8e50-4448-83df-9efd4d3be857 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:28.951189 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2720517-fdac-4235-888a-967dc60d580e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:28.953140 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2720517-fdac-4235-888a-967dc60d580e None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:28.968417 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-a2720517-fdac-4235-888a-967dc60d580e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:15:28.968417 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:28.968417 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:28.968417 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:28.968417 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:28.968417 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:28.968417 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:28.968417 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:28.968417 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:28.968417 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:28.968417 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:28.968417 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:28.968417 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 19:15:28.968417 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 19:15:28.968417 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 19:15:28.969369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 19:15:28.969369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:28.969369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:28.969369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:28.969369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:28.969369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:28.969369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:28.969369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:28.969369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:28.969369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:28.969369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:28.969369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:28.969369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:28.969369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:28.969369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:28.969369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:28.969369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:28.970273 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 19:15:28.970273 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 19:15:28.970273 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 19:15:28.970273 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 19:15:28.970273 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 19:15:28.970273 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 19:15:28.970273 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:15:28.970273 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:28.972834 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 299/604] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:15:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:28.979191 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2720517-fdac-4235-888a-967dc60d580e None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:29.004021 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:29.093196 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2720517-fdac-4235-888a-967dc60d580e None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:29.105307 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:29.125395 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da4009-8e50-4448-83df-9efd4d3be857 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:29.132583 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7001f7-408e-46f0-8ce3-534f958dfde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:29.133932 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7001f7-408e-46f0-8ce3-534f958dfde2 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:29.134427 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7001f7-408e-46f0-8ce3-534f958dfde2 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:29.134915 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7001f7-408e-46f0-8ce3-534f958dfde2 None admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:29.135944 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7001f7-408e-46f0-8ce3-534f958dfde2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:29.136455 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7001f7-408e-46f0-8ce3-534f958dfde2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:29.138102 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7001f7-408e-46f0-8ce3-534f958dfde2 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:29.159165 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 300/605] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Jul 21 19:15:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:29.165560 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e5cb4f-078a-4e0a-88eb-e51d2a3ce503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:29.166195 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7001f7-408e-46f0-8ce3-534f958dfde2 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:29.166609 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5cb4f-078a-4e0a-88eb-e51d2a3ce503 None admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:29.166972 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5cb4f-078a-4e0a-88eb-e51d2a3ce503 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:29.167296 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5cb4f-078a-4e0a-88eb-e51d2a3ce503 None admin] PATH_INFO: `/v3/projects/9847b5e8bc0b4483bbce060a48f405f4/users/591016b95ab24d3a8de83089a141d914/roles/beeebaa4e16c40f387f05b67124a424d` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:29.184875 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e5cb4f-078a-4e0a-88eb-e51d2a3ce503 None admin] RBAC: Authorizing `identity:create_grant(project_id=9847b5e8bc0b4483bbce060a48f405f4, user_id=591016b95ab24d3a8de83089a141d914, role_id=beeebaa4e16c40f387f05b67124a424d)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:29.186525 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e5cb4f-078a-4e0a-88eb-e51d2a3ce503 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:29.260363 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:29.279948 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7001f7-408e-46f0-8ce3-534f958dfde2 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:29.314426 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56acaa48-a505-4c0d-8a34-98fd36ecce97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:29.315323 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acaa48-a505-4c0d-8a34-98fd36ecce97 None admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:29.315638 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acaa48-a505-4c0d-8a34-98fd36ecce97 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:29.315918 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acaa48-a505-4c0d-8a34-98fd36ecce97 None admin] PATH_INFO: `/v3/projects/9847b5e8bc0b4483bbce060a48f405f4/users/b1908b2f87d5442da8ba826489cb2018/roles/beeebaa4e16c40f387f05b67124a424d` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:29.332205 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 306/606] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Jul 21 19:15:28 2022] PUT /identity/v3/projects/9847b5e8bc0b4483bbce060a48f405f4/users/591016b95ab24d3a8de83089a141d914/roles/beeebaa4e16c40f387f05b67124a424d => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:15:29.340248 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56acaa48-a505-4c0d-8a34-98fd36ecce97 None admin] RBAC: Authorizing `identity:create_grant(project_id=9847b5e8bc0b4483bbce060a48f405f4, user_id=b1908b2f87d5442da8ba826489cb2018, role_id=beeebaa4e16c40f387f05b67124a424d)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:29.340407 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20287e3a-db7c-4c4b-ba6e-b2c2bccedf09 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:29.340407 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20287e3a-db7c-4c4b-ba6e-b2c2bccedf09 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:29.340407 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20287e3a-db7c-4c4b-ba6e-b2c2bccedf09 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:29.340629 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56acaa48-a505-4c0d-8a34-98fd36ecce97 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:29.340702 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 307/607] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:29.343113 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a515e-3d97-454b-b717-4fed3fe9b6a6 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:29.343937 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a515e-3d97-454b-b717-4fed3fe9b6a6 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:29.344429 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a515e-3d97-454b-b717-4fed3fe9b6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:29.368966 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-ce6a515e-3d97-454b-b717-4fed3fe9b6a6 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:29.371120 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ce6a515e-3d97-454b-b717-4fed3fe9b6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:29.441969 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 301/608] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Jul 21 19:15:29 2022] PUT /identity/v3/projects/9847b5e8bc0b4483bbce060a48f405f4/users/b1908b2f87d5442da8ba826489cb2018/roles/beeebaa4e16c40f387f05b67124a424d => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:15:29.465390 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 308/609] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 19:15:29.504026 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56acaa48-a505-4c0d-8a34-98fd36ecce97 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:29.623009 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56acaa48-a505-4c0d-8a34-98fd36ecce97 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:29.654556 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:29.668151 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b4091-6fe6-4e2f-9d36-0cb2ba024b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:29.672518 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b4091-6fe6-4e2f-9d36-0cb2ba024b63 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:29.672518 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b4091-6fe6-4e2f-9d36-0cb2ba024b63 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:29.672518 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b4091-6fe6-4e2f-9d36-0cb2ba024b63 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:29.681041 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b4091-6fe6-4e2f-9d36-0cb2ba024b63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:15:29.688817 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-b45b4091-6fe6-4e2f-9d36-0cb2ba024b63 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 19:15:29.688817 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:29.688817 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:29.688817 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:29.688817 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:29.688817 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:29.688817 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:29.688817 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:29.688817 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:29.688817 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:29.688817 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:29.688817 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:29.688817 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:15:29.688817 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:15:29.688817 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:15:29.688817 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:15:29.689839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:15:29.689839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:15:29.689839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:15:29.689839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:15:29.689839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:29.689839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:29.689839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:29.689839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:29.689839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:29.689839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:29.689839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:29.689839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:29.689839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:29.689839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:29.689839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:29.689839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:29.691351 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:29.691351 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:29.691351 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:29.691351 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:29.691351 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:15:29.691351 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:15:29.691351 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:15:29.691351 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:15:29.691351 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:15:29.691351 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:15:29.691351 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 19:15:29.691351 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:29.691351 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 302/610] 10.222.0.60 () {56 vars in 1102 bytes} [Thu Jul 21 19:15:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:29.692278 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e54306-806f-47ba-87b1-d27c4802d058 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:29.692278 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e54306-806f-47ba-87b1-d27c4802d058 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:29.692578 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e54306-806f-47ba-87b1-d27c4802d058 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:29.694142 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 309/611] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:29.696333 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b4091-6fe6-4e2f-9d36-0cb2ba024b63 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:29.700395 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8b67e-64d8-4f3e-aafd-3b92e67e35dc None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:29.700745 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8b67e-64d8-4f3e-aafd-3b92e67e35dc None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:29.701031 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8b67e-64d8-4f3e-aafd-3b92e67e35dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:29.721283 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-bbe8b67e-64d8-4f3e-aafd-3b92e67e35dc None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:29.722471 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-bbe8b67e-64d8-4f3e-aafd-3b92e67e35dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:29.785391 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:29.797978 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 310/612] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:15:29.801095 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b4091-6fe6-4e2f-9d36-0cb2ba024b63 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:29.823575 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8b67e-64d8-4f3e-aafd-3b92e67e35dc None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:29.837434 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55455bd-6c44-4a54-ad43-d49f03336b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:29.838108 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55455bd-6c44-4a54-ad43-d49f03336b0a None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:29.838389 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55455bd-6c44-4a54-ad43-d49f03336b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:29.838663 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55455bd-6c44-4a54-ad43-d49f03336b0a None admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:29.839407 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55455bd-6c44-4a54-ad43-d49f03336b0a None admin] RBAC: Adding query filter params (name=service) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:29.839748 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55455bd-6c44-4a54-ad43-d49f03336b0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:29.841150 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55455bd-6c44-4a54-ad43-d49f03336b0a None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:29.850208 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 303/613] 10.222.0.60 () {56 vars in 1103 bytes} [Thu Jul 21 19:15:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:29.856285 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55455bd-6c44-4a54-ad43-d49f03336b0a None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:29.941334 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:29.994485 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55455bd-6c44-4a54-ad43-d49f03336b0a None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:30.010742 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8b67e-64d8-4f3e-aafd-3b92e67e35dc None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:30.032342 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63232484-5d4a-474b-8551-78aa989f4878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:30.033170 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63232484-5d4a-474b-8551-78aa989f4878 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:30.033493 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63232484-5d4a-474b-8551-78aa989f4878 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:30.033773 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63232484-5d4a-474b-8551-78aa989f4878 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:30.045771 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63232484-5d4a-474b-8551-78aa989f4878 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:30.046268 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a54f19-01b3-4104-b64c-f155b5d2e1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:30.047065 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a54f19-01b3-4104-b64c-f155b5d2e1d4 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:30.047234 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63232484-5d4a-474b-8551-78aa989f4878 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:30.047399 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a54f19-01b3-4104-b64c-f155b5d2e1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:30.047646 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a54f19-01b3-4104-b64c-f155b5d2e1d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:30.058393 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a54f19-01b3-4104-b64c-f155b5d2e1d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:15:30.065491 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-63232484-5d4a-474b-8551-78aa989f4878 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:30.065491 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:30.065491 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:30.065491 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:30.065491 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:30.065491 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:30.065491 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:30.065491 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:30.065491 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:30.065491 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:30.065491 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:30.065491 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:30.065491 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:30.065491 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:30.065491 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:30.069291 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:30.069291 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:30.069291 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:30.069291 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:30.069291 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:30.069291 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:30.069291 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:30.069291 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:30.069291 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:30.069291 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:30.069291 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:30.069291 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:30.069291 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:30.069291 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:30.069291 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:30.069291 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:30.069291 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:30.071395 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:30.071395 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:30.071395 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:30.071395 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:30.071979 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-b1a54f19-01b3-4104-b64c-f155b5d2e1d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 19:15:30.071979 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:30.071979 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:30.071979 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:30.071979 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:30.071979 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:30.071979 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:30.071979 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:30.071979 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:30.071979 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:30.071979 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:30.071979 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:30.071979 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:15:30.071979 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:15:30.071979 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:15:30.071979 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:15:30.075427 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:15:30.075427 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:15:30.075427 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:15:30.075427 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:15:30.075427 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:30.075427 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:30.075427 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:30.075427 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:30.075427 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:30.075427 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:30.075427 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:30.075427 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:30.075427 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:30.075427 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:30.075427 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:30.075427 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:30.077432 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:30.077432 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:30.077432 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:30.077432 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:30.077432 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:15:30.077432 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:15:30.077432 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:15:30.077432 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:15:30.077432 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:15:30.077432 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:15:30.077432 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 19:15:30.077432 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:30.078905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 304/614] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:30.079061 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 311/615] 10.222.0.60 () {56 vars in 1102 bytes} [Thu Jul 21 19:15:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:15:30.079206 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63232484-5d4a-474b-8551-78aa989f4878 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:30.079359 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a54f19-01b3-4104-b64c-f155b5d2e1d4 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:30.159491 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:30.206209 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63232484-5d4a-474b-8551-78aa989f4878 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:30.208487 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:30.244326 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a59c0d-a5cc-4ae9-a7c1-db6f5e39eb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:30.245021 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a59c0d-a5cc-4ae9-a7c1-db6f5e39eb71 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:30.245316 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a59c0d-a5cc-4ae9-a7c1-db6f5e39eb71 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:30.245575 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a59c0d-a5cc-4ae9-a7c1-db6f5e39eb71 None admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:30.246309 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a59c0d-a5cc-4ae9-a7c1-db6f5e39eb71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:30.246624 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a59c0d-a5cc-4ae9-a7c1-db6f5e39eb71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:30.248161 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a59c0d-a5cc-4ae9-a7c1-db6f5e39eb71 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:30.262457 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 305/616] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:30.265130 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a54f19-01b3-4104-b64c-f155b5d2e1d4 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:30.271458 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a59c0d-a5cc-4ae9-a7c1-db6f5e39eb71 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:30.353148 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728bdc95-8750-498a-b501-1814b3f0cc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:30.354224 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728bdc95-8750-498a-b501-1814b3f0cc4a None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:30.354732 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728bdc95-8750-498a-b501-1814b3f0cc4a None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:30.355220 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728bdc95-8750-498a-b501-1814b3f0cc4a None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:30.356207 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728bdc95-8750-498a-b501-1814b3f0cc4a None admin] RBAC: Adding query filter params (name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:30.356720 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728bdc95-8750-498a-b501-1814b3f0cc4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:30.358296 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728bdc95-8750-498a-b501-1814b3f0cc4a None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:30.372397 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 312/617] 10.222.0.60 () {56 vars in 1103 bytes} [Thu Jul 21 19:15:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:30.374357 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728bdc95-8750-498a-b501-1814b3f0cc4a None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:30.379336 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a59c0d-a5cc-4ae9-a7c1-db6f5e39eb71 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:30.416877 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a8902a-5d13-4314-97b0-ddce7b0fb8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:30.417708 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8902a-5d13-4314-97b0-ddce7b0fb8f7 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:30.417999 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8902a-5d13-4314-97b0-ddce7b0fb8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:30.418282 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8902a-5d13-4314-97b0-ddce7b0fb8f7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:30.431476 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a8902a-5d13-4314-97b0-ddce7b0fb8f7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:30.431476 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a8902a-5d13-4314-97b0-ddce7b0fb8f7 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:30.443047 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-b8a8902a-5d13-4314-97b0-ddce7b0fb8f7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 19:15:30.443047 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:30.443047 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:30.443047 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:30.443047 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:30.443047 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:30.443047 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:30.443047 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:30.443047 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:30.443047 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:30.443047 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:30.443047 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:30.443047 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 19:15:30.443047 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 19:15:30.443047 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 19:15:30.443047 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 19:15:30.444660 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:30.444660 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:30.444660 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 19:15:30.444660 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:15:30.444660 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 19:15:30.444660 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:15:30.444660 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:30.444660 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:30.444660 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:30.444660 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:30.444660 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:30.444660 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:30.444660 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:30.444660 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:30.444660 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:30.444660 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:30.444660 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:30.444660 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:30.446374 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:30.446374 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:30.446374 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 19:15:30.446374 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 19:15:30.446374 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 19:15:30.446374 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 19:15:30.446374 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 19:15:30.446374 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 19:15:30.446374 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 19:15:30.446374 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:30.446374 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 306/618] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Jul 21 19:15:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:30.450711 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a8902a-5d13-4314-97b0-ddce7b0fb8f7 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:30.487896 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:30.558411 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a8902a-5d13-4314-97b0-ddce7b0fb8f7 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:30.594662 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a99c54a-e99c-4508-a41b-62050a4a099b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:30.595401 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99c54a-e99c-4508-a41b-62050a4a099b None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:30.595734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99c54a-e99c-4508-a41b-62050a4a099b None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:30.596020 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99c54a-e99c-4508-a41b-62050a4a099b None admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:30.596924 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a99c54a-e99c-4508-a41b-62050a4a099b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:30.597248 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a99c54a-e99c-4508-a41b-62050a4a099b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:30.598923 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a99c54a-e99c-4508-a41b-62050a4a099b None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:30.618358 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 307/619] 10.222.0.60 () {56 vars in 1135 bytes} [Thu Jul 21 19:15:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:15:30.623835 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a99c54a-e99c-4508-a41b-62050a4a099b None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:30.641571 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728bdc95-8750-498a-b501-1814b3f0cc4a None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:30.680877 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:30.731375 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a99c54a-e99c-4508-a41b-62050a4a099b None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:30.747711 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:30.769846 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ce6a5-0083-468a-ac36-30f44ecf532b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:30.770650 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ce6a5-0083-468a-ac36-30f44ecf532b None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:30.770946 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ce6a5-0083-468a-ac36-30f44ecf532b None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:30.771233 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ce6a5-0083-468a-ac36-30f44ecf532b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:30.772509 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0c126-02e1-41f9-852d-bf4d9f67dea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:30.773304 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0c126-02e1-41f9-852d-bf4d9f67dea8 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:30.773589 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0c126-02e1-41f9-852d-bf4d9f67dea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:30.773864 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0c126-02e1-41f9-852d-bf4d9f67dea8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:30.793368 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ce6a5-0083-468a-ac36-30f44ecf532b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:30.794903 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ce6a5-0083-468a-ac36-30f44ecf532b None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:30.798390 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f0c126-02e1-41f9-852d-bf4d9f67dea8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:30.799923 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f0c126-02e1-41f9-852d-bf4d9f67dea8 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:30.828157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-30f0c126-02e1-41f9-852d-bf4d9f67dea8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:30.828157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:30.828157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:30.828157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:30.828157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:30.828157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:30.828157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:30.828157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:30.828157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:30.828157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:30.828157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:30.828157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:30.828157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:30.828157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:30.828157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:30.829123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:30.829123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:30.829123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:30.829123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:30.829123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:30.829123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:30.829123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:30.829123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:30.829123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:30.829123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:30.829123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:30.829123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:30.829123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:30.829123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:30.829123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:30.829123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:30.829123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:30.830461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:30.830461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:30.830461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:30.830461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:30.830461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 313/620] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 456 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:15:30.836374 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0c126-02e1-41f9-852d-bf4d9f67dea8 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:30.837335 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-939ce6a5-0083-468a-ac36-30f44ecf532b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:30.837335 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:30.837335 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:30.837335 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:30.837335 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:30.837335 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:30.837335 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:30.837335 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:30.837335 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:30.837335 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:30.837335 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:30.837335 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:30.837335 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:30.837335 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:30.837335 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:30.838207 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:30.838207 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:30.838207 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:30.838207 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:30.838207 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:30.838207 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:30.838207 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:30.838207 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:30.838207 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:30.838207 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:30.838207 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:30.838207 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:30.838207 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:30.838207 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:30.838207 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:30.838207 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:30.838207 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:30.839672 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:30.839672 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:30.839672 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:30.839672 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:30.847056 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 308/621] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:15:30.848081 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ce6a5-0083-468a-ac36-30f44ecf532b None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:31.049487 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ce6a5-0083-468a-ac36-30f44ecf532b None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:31.061714 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0c126-02e1-41f9-852d-bf4d9f67dea8 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:31.114295 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e12e37-d5fe-4883-89c6-500a818b4432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:31.114975 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e12e37-d5fe-4883-89c6-500a818b4432 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:31.115264 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e12e37-d5fe-4883-89c6-500a818b4432 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:31.116087 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e12e37-d5fe-4883-89c6-500a818b4432 None admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:31.120931 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e12e37-d5fe-4883-89c6-500a818b4432 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:31.121268 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e12e37-d5fe-4883-89c6-500a818b4432 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:31.122678 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e12e37-d5fe-4883-89c6-500a818b4432 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:31.129488 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e5247-e6fe-4216-b488-f08717ecfd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:31.130166 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e5247-e6fe-4216-b488-f08717ecfd38 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:31.130452 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e5247-e6fe-4216-b488-f08717ecfd38 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:31.130734 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e5247-e6fe-4216-b488-f08717ecfd38 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:31.131811 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e5247-e6fe-4216-b488-f08717ecfd38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:31.132194 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e5247-e6fe-4216-b488-f08717ecfd38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:31.133578 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e5247-e6fe-4216-b488-f08717ecfd38 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:31.147768 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:31.148706 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 314/622] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:15:31.154320 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e5247-e6fe-4216-b488-f08717ecfd38 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:31.159951 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 309/623] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:31.166909 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e12e37-d5fe-4883-89c6-500a818b4432 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:31.206151 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:31.329431 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e5247-e6fe-4216-b488-f08717ecfd38 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:31.329776 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e12e37-d5fe-4883-89c6-500a818b4432 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:31.367809 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ded751-f37a-492a-9eb7-ebcccad23e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:31.368608 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ded751-f37a-492a-9eb7-ebcccad23e90 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:31.368892 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ded751-f37a-492a-9eb7-ebcccad23e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:31.369168 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ded751-f37a-492a-9eb7-ebcccad23e90 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:31.370540 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4437b0-ccbc-445a-8e41-ac86a6a789e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:31.371616 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4437b0-ccbc-445a-8e41-ac86a6a789e9 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:31.372510 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4437b0-ccbc-445a-8e41-ac86a6a789e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:31.372794 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4437b0-ccbc-445a-8e41-ac86a6a789e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:31.376671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ded751-f37a-492a-9eb7-ebcccad23e90 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:31.378116 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ded751-f37a-492a-9eb7-ebcccad23e90 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:31.381581 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4437b0-ccbc-445a-8e41-ac86a6a789e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:31.383147 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4437b0-ccbc-445a-8e41-ac86a6a789e9 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:31.393470 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-50ded751-f37a-492a-9eb7-ebcccad23e90 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 19:15:31.393470 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:31.393470 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:31.393470 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:31.393470 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:31.393470 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:31.393470 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:31.393470 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:31.393470 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:31.393470 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:31.393470 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:31.393470 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:31.393470 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 19:15:31.393470 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 19:15:31.393470 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 19:15:31.393470 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 19:15:31.394437 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:31.394437 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:31.394437 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 19:15:31.394437 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:15:31.394437 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 19:15:31.394437 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:15:31.394437 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:31.394437 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:31.394437 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:31.394437 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:31.394437 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:31.394437 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:31.394437 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:31.394437 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:31.394437 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:31.394437 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:31.394437 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:31.394437 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:31.396543 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:31.396543 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:31.396543 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 19:15:31.396543 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 19:15:31.396543 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 19:15:31.396543 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 19:15:31.396543 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 19:15:31.396543 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 19:15:31.396543 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 19:15:31.396543 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:31.396543 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 315/624] 10.222.0.60 () {56 vars in 1093 bytes} [Thu Jul 21 19:15:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:15:31.396543 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335114d0-b41b-44e4-9ab0-cc5c2a32910c None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:31.396543 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335114d0-b41b-44e4-9ab0-cc5c2a32910c None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:31.398778 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335114d0-b41b-44e4-9ab0-cc5c2a32910c None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:31.399533 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 316/625] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:31.402084 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-2f4437b0-ccbc-445a-8e41-ac86a6a789e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:15:31.402084 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:31.402084 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:31.402084 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:31.402084 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:31.402084 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:31.402084 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:31.402084 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:31.402084 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:31.402084 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:31.402084 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:31.402084 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:31.402084 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 19:15:31.402084 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 19:15:31.402084 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 19:15:31.404076 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 19:15:31.404076 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:31.404076 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:31.404076 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:31.404076 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:31.404076 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:31.404076 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:31.404076 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:31.404076 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:31.404076 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:31.404076 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:31.404076 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:31.404076 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:31.404076 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:31.404076 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:31.404076 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:31.404076 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:31.405909 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 19:15:31.405909 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 19:15:31.405909 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 19:15:31.405909 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 19:15:31.405909 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 19:15:31.405909 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 19:15:31.405909 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:15:31.405909 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:31.406465 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335114d0-b41b-44e4-9ab0-cc5c2a32910c None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:31.406551 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 310/626] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:15:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:15:31.411477 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d436dfa-472e-47f7-bf42-354179ab628d None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:31.411477 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d436dfa-472e-47f7-bf42-354179ab628d None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:31.411477 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d436dfa-472e-47f7-bf42-354179ab628d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:31.435515 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-2d436dfa-472e-47f7-bf42-354179ab628d None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:31.435515 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-2d436dfa-472e-47f7-bf42-354179ab628d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:31.482046 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:31.500300 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 311/627] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:15:31.501253 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d436dfa-472e-47f7-bf42-354179ab628d None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:31.519303 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:31.542033 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335114d0-b41b-44e4-9ab0-cc5c2a32910c None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:31.588925 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda958b-cf4f-4420-b487-20c9a547b94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:31.589522 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda958b-cf4f-4420-b487-20c9a547b94e None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:31.589805 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda958b-cf4f-4420-b487-20c9a547b94e None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:31.590082 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda958b-cf4f-4420-b487-20c9a547b94e None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:31.590925 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda958b-cf4f-4420-b487-20c9a547b94e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:31.591238 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda958b-cf4f-4420-b487-20c9a547b94e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:31.592715 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda958b-cf4f-4420-b487-20c9a547b94e None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:31.616574 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 317/628] 10.222.0.60 () {56 vars in 1133 bytes} [Thu Jul 21 19:15:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:31.616574 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda958b-cf4f-4420-b487-20c9a547b94e None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:31.644220 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d436dfa-472e-47f7-bf42-354179ab628d None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:31.682647 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0ba55-8631-4f99-823b-5ce6c399e380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:31.683497 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0ba55-8631-4f99-823b-5ce6c399e380 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:31.683791 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0ba55-8631-4f99-823b-5ce6c399e380 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:31.684088 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0ba55-8631-4f99-823b-5ce6c399e380 None admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:31.684864 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0ba55-8631-4f99-823b-5ce6c399e380 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:31.685282 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0ba55-8631-4f99-823b-5ce6c399e380 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:31.686598 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0ba55-8631-4f99-823b-5ce6c399e380 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:31.703532 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 312/629] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Jul 21 19:15:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:31.703532 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0ba55-8631-4f99-823b-5ce6c399e380 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:31.746353 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda958b-cf4f-4420-b487-20c9a547b94e None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:31.751663 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:31.787275 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca195c15-0d8b-40fa-90e4-823c15968e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:31.788622 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca195c15-0d8b-40fa-90e4-823c15968e3a None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:31.789155 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca195c15-0d8b-40fa-90e4-823c15968e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:31.789685 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca195c15-0d8b-40fa-90e4-823c15968e3a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:31.803781 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca195c15-0d8b-40fa-90e4-823c15968e3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:15:31.808634 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0ba55-8631-4f99-823b-5ce6c399e380 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:31.812787 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-ca195c15-0d8b-40fa-90e4-823c15968e3a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 19:15:31.812787 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:31.812787 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:31.812787 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:31.812787 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:31.812787 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:31.812787 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:31.812787 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:31.812787 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:31.812787 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:31.812787 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:31.812787 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:31.812787 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:15:31.812787 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:15:31.812787 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:15:31.812787 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:15:31.813735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:15:31.813735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:15:31.813735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:15:31.813735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:15:31.813735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:31.813735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:31.813735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:31.813735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:31.813735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:31.813735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:31.813735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:31.813735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:31.813735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:31.813735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:31.813735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:31.813735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:31.814571 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:31.814571 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:31.814571 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:31.814571 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:31.814571 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:15:31.814571 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:15:31.814571 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:15:31.814571 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:15:31.814571 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:15:31.814571 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:15:31.814571 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 19:15:31.814571 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:31.817463 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 318/630] 10.222.0.60 () {56 vars in 1102 bytes} [Thu Jul 21 19:15:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:31.819196 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca195c15-0d8b-40fa-90e4-823c15968e3a None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:31.823575 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:31.843868 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387ba5e-aadb-46df-8e88-70cddb3a25e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:31.844500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387ba5e-aadb-46df-8e88-70cddb3a25e0 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:31.844791 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387ba5e-aadb-46df-8e88-70cddb3a25e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:31.845070 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387ba5e-aadb-46df-8e88-70cddb3a25e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:31.914134 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6387ba5e-aadb-46df-8e88-70cddb3a25e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:31.915621 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6387ba5e-aadb-46df-8e88-70cddb3a25e0 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:31.940259 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca195c15-0d8b-40fa-90e4-823c15968e3a None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:31.964351 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:31.980666 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805dcba-47d5-4224-9c83-b32cfcaf1ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:31.981556 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805dcba-47d5-4224-9c83-b32cfcaf1ffe None admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:31.981842 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805dcba-47d5-4224-9c83-b32cfcaf1ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:31.982239 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805dcba-47d5-4224-9c83-b32cfcaf1ffe None admin] PATH_INFO: `/v3/projects/9847b5e8bc0b4483bbce060a48f405f4/users/0aa579af53a6441a9205cf82864a640e/roles/beeebaa4e16c40f387f05b67124a424d` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:31.998333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9805dcba-47d5-4224-9c83-b32cfcaf1ffe None admin] RBAC: Authorizing `identity:create_grant(project_id=9847b5e8bc0b4483bbce060a48f405f4, user_id=0aa579af53a6441a9205cf82864a640e, role_id=beeebaa4e16c40f387f05b67124a424d)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:31.999821 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9805dcba-47d5-4224-9c83-b32cfcaf1ffe None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:32.021465 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 313/631] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:15:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 19:15:32.022379 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387ba5e-aadb-46df-8e88-70cddb3a25e0 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:32.066209 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 319/632] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Jul 21 19:15:31 2022] PUT /identity/v3/projects/9847b5e8bc0b4483bbce060a48f405f4/users/0aa579af53a6441a9205cf82864a640e/roles/beeebaa4e16c40f387f05b67124a424d => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:15:32.067569 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ec688-1602-412f-aaee-4c696e6f7c31 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:32.067859 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ec688-1602-412f-aaee-4c696e6f7c31 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:32.068134 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ec688-1602-412f-aaee-4c696e6f7c31 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:32.070175 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 320/633] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:32.071222 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfede03-9805-4e94-86b7-14e09b7a0e50 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:32.071536 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfede03-9805-4e94-86b7-14e09b7a0e50 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:32.071817 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfede03-9805-4e94-86b7-14e09b7a0e50 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:32.073111 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 321/634] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:32.073735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfede03-9805-4e94-86b7-14e09b7a0e50 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:32.139664 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387ba5e-aadb-46df-8e88-70cddb3a25e0 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:32.145307 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:32.186434 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d4deb-4381-4011-83be-077de0644605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:32.187301 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d4deb-4381-4011-83be-077de0644605 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:32.187647 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d4deb-4381-4011-83be-077de0644605 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:32.187920 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d4deb-4381-4011-83be-077de0644605 None admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:32.188681 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d4deb-4381-4011-83be-077de0644605 None admin] RBAC: Adding query filter params (name=service) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:32.188998 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d4deb-4381-4011-83be-077de0644605 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:32.190411 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d4deb-4381-4011-83be-077de0644605 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:32.197349 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfede03-9805-4e94-86b7-14e09b7a0e50 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:32.200075 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 314/635] 10.222.0.60 () {56 vars in 1103 bytes} [Thu Jul 21 19:15:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:32.201304 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f42f90-0775-4e6c-aeb5-6eb011eed9ca None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:32.201617 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f42f90-0775-4e6c-aeb5-6eb011eed9ca None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:32.201902 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f42f90-0775-4e6c-aeb5-6eb011eed9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:32.215647 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:32.221858 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-26f42f90-0775-4e6c-aeb5-6eb011eed9ca None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:32.223079 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-26f42f90-0775-4e6c-aeb5-6eb011eed9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:32.245429 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea06df7-d6ca-467d-afc8-aff6e2b6d2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:32.246227 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea06df7-d6ca-467d-afc8-aff6e2b6d2c3 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:32.246514 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea06df7-d6ca-467d-afc8-aff6e2b6d2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:32.246790 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea06df7-d6ca-467d-afc8-aff6e2b6d2c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:32.258041 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea06df7-d6ca-467d-afc8-aff6e2b6d2c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:32.259638 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea06df7-d6ca-467d-afc8-aff6e2b6d2c3 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:32.277433 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-bea06df7-d6ca-467d-afc8-aff6e2b6d2c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:32.277433 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:32.277433 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:32.277433 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:32.277433 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:32.277433 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:32.277433 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:32.277433 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:32.277433 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:32.277433 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:32.277433 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:32.277433 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:32.277433 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:32.277433 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:32.277433 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:32.278391 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:32.278391 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:32.278391 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:32.278391 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:32.278391 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:32.278391 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:32.278391 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:32.278391 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:32.278391 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:32.278391 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:32.278391 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:32.278391 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:32.278391 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:32.278391 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:32.278391 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:32.278391 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:32.278391 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:32.279893 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:32.279893 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:32.279893 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:32.279893 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:32.279893 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 322/636] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:32.279893 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5d0c2-d46c-470b-9d1e-de0b285fe4bd None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:32.280267 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5d0c2-d46c-470b-9d1e-de0b285fe4bd None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:32.280458 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5d0c2-d46c-470b-9d1e-de0b285fe4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:32.299322 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-c5c5d0c2-d46c-470b-9d1e-de0b285fe4bd None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:32.300538 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-c5c5d0c2-d46c-470b-9d1e-de0b285fe4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:32.307164 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 315/637] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:15:32.308300 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f42f90-0775-4e6c-aeb5-6eb011eed9ca None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:32.376843 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 323/638] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:15:32.378258 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5d0c2-d46c-470b-9d1e-de0b285fe4bd None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:32.420176 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:32.441570 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f42f90-0775-4e6c-aeb5-6eb011eed9ca None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:32.481505 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7fd961-4eb6-4b42-9122-a3459de1f977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:32.483111 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fd961-4eb6-4b42-9122-a3459de1f977 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:32.483626 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fd961-4eb6-4b42-9122-a3459de1f977 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:32.484078 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fd961-4eb6-4b42-9122-a3459de1f977 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:32.487358 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:32.495265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7fd961-4eb6-4b42-9122-a3459de1f977 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:32.500446 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5d0c2-d46c-470b-9d1e-de0b285fe4bd None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:32.500722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7fd961-4eb6-4b42-9122-a3459de1f977 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:32.517108 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-da7fd961-4eb6-4b42-9122-a3459de1f977 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:32.517108 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:32.517108 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:32.517108 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:32.517108 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:32.517108 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:32.517108 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:32.517108 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:32.517108 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:32.517108 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:32.517108 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:32.517108 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:32.517108 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:32.517108 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:32.517108 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:32.518193 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:32.518193 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:32.518193 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:32.518193 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:32.518193 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:32.518193 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:32.518193 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:32.518193 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:32.518193 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:32.518193 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:32.518193 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:32.518193 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:32.518193 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:32.518193 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:32.518193 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:32.518193 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:32.518193 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:32.519303 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:32.519303 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:32.519303 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:32.519303 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:32.521025 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 316/639] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:32.522700 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7fd961-4eb6-4b42-9122-a3459de1f977 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:32.536298 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5acab5-8d39-40e4-8ed4-72309bdcbcc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:32.536971 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5acab5-8d39-40e4-8ed4-72309bdcbcc8 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:32.537985 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5acab5-8d39-40e4-8ed4-72309bdcbcc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:32.538238 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5acab5-8d39-40e4-8ed4-72309bdcbcc8 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:32.539317 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5acab5-8d39-40e4-8ed4-72309bdcbcc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:32.539681 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5acab5-8d39-40e4-8ed4-72309bdcbcc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:32.541069 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5acab5-8d39-40e4-8ed4-72309bdcbcc8 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:32.557153 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 324/640] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:32.557153 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5acab5-8d39-40e4-8ed4-72309bdcbcc8 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:32.639214 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7fd961-4eb6-4b42-9122-a3459de1f977 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:32.650966 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:32.657210 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5acab5-8d39-40e4-8ed4-72309bdcbcc8 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:32.675747 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d934af9-62ba-4754-94c6-175f5288db85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:32.676584 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d934af9-62ba-4754-94c6-175f5288db85 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:32.676931 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d934af9-62ba-4754-94c6-175f5288db85 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:32.677214 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d934af9-62ba-4754-94c6-175f5288db85 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:32.688155 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d934af9-62ba-4754-94c6-175f5288db85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:15:32.694469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcaa3ff-b281-46aa-9cdd-b4d22e6f320e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:32.695542 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcaa3ff-b281-46aa-9cdd-b4d22e6f320e None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:32.695995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-9d934af9-62ba-4754-94c6-175f5288db85 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 19:15:32.695995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:32.695995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:32.695995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:32.695995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:32.695995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:32.695995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:32.695995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:32.695995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:32.695995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:32.695995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:32.695995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:32.695995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:15:32.695995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:15:32.695995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:15:32.695995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:15:32.696898 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:15:32.696898 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:15:32.696898 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:15:32.696898 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:15:32.696898 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:32.696898 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:32.696898 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:32.696898 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:32.696898 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:32.696898 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:32.696898 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:32.696898 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:32.696898 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:32.696898 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:32.696898 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:32.696898 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:32.697740 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:32.697740 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:32.697740 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:32.697740 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:32.697740 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:15:32.697740 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:15:32.697740 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:15:32.697740 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:15:32.697740 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:15:32.697740 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:15:32.697740 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 19:15:32.697740 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:32.697740 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 317/641] 10.222.0.60 () {56 vars in 1102 bytes} [Thu Jul 21 19:15:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:32.698884 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d934af9-62ba-4754-94c6-175f5288db85 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:32.699047 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcaa3ff-b281-46aa-9cdd-b4d22e6f320e None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:32.699355 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcaa3ff-b281-46aa-9cdd-b4d22e6f320e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:32.715757 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcaa3ff-b281-46aa-9cdd-b4d22e6f320e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:15:32.726715 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-fdcaa3ff-b281-46aa-9cdd-b4d22e6f320e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 19:15:32.726715 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:32.726715 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:32.726715 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:32.726715 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:32.726715 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:32.726715 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:32.726715 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:32.726715 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:32.726715 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:32.726715 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:32.726715 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:32.726715 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:15:32.726715 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:15:32.726715 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:15:32.726715 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:15:32.727921 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:15:32.727921 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:15:32.727921 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:15:32.727921 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:15:32.727921 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:32.727921 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:32.727921 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:32.727921 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:32.727921 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:32.727921 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:32.727921 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:32.727921 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:32.727921 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:32.727921 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:32.727921 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:32.727921 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:32.728948 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:32.728948 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:32.728948 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:32.728948 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:32.728948 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:15:32.728948 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:15:32.728948 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:15:32.728948 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:15:32.728948 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:15:32.728948 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:15:32.728948 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 19:15:32.728948 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:32.730020 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 325/642] 10.222.0.60 () {56 vars in 1102 bytes} [Thu Jul 21 19:15:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:32.730903 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcaa3ff-b281-46aa-9cdd-b4d22e6f320e None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:32.757824 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:32.812292 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d934af9-62ba-4754-94c6-175f5288db85 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:32.846096 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcaa3ff-b281-46aa-9cdd-b4d22e6f320e None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:32.848098 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ecaa4-1213-49a1-82c0-204a97d2170e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:32.849542 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ecaa4-1213-49a1-82c0-204a97d2170e None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:32.849865 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ecaa4-1213-49a1-82c0-204a97d2170e None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:32.850138 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ecaa4-1213-49a1-82c0-204a97d2170e None admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:32.850856 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ecaa4-1213-49a1-82c0-204a97d2170e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:32.851164 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ecaa4-1213-49a1-82c0-204a97d2170e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:32.852554 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ecaa4-1213-49a1-82c0-204a97d2170e None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:32.865745 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 318/643] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:32.866541 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ecaa4-1213-49a1-82c0-204a97d2170e None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:32.885361 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf02a63-a054-4e70-96b8-5b9f4d49f400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:32.886149 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf02a63-a054-4e70-96b8-5b9f4d49f400 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:32.886437 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf02a63-a054-4e70-96b8-5b9f4d49f400 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:32.886717 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf02a63-a054-4e70-96b8-5b9f4d49f400 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:32.893843 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf02a63-a054-4e70-96b8-5b9f4d49f400 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:32.895269 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf02a63-a054-4e70-96b8-5b9f4d49f400 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:32.910808 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-5bf02a63-a054-4e70-96b8-5b9f4d49f400 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:15:32.910808 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:32.910808 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:32.910808 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:32.910808 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:32.910808 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:32.910808 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:32.910808 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:32.910808 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:32.910808 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:32.910808 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:32.910808 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:32.910808 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 19:15:32.910808 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 19:15:32.910808 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 19:15:32.911747 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 19:15:32.911747 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:32.911747 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:32.911747 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:32.911747 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:32.911747 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:32.911747 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:32.911747 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:32.911747 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:32.911747 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:32.911747 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:32.911747 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:32.911747 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:32.911747 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:32.911747 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:32.911747 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:32.911747 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:32.917880 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 19:15:32.917880 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 19:15:32.917880 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 19:15:32.917880 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 19:15:32.917880 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 19:15:32.917880 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 19:15:32.917880 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:15:32.917880 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:32.917880 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 326/644] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:15:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:32.917880 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf02a63-a054-4e70-96b8-5b9f4d49f400 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:32.934987 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:32.976793 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ecaa4-1213-49a1-82c0-204a97d2170e None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:32.986441 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:33.011305 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a45ca8-218a-4878-8888-8efc8c9ca712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:33.011998 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a45ca8-218a-4878-8888-8efc8c9ca712 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:33.012282 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a45ca8-218a-4878-8888-8efc8c9ca712 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:33.012558 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a45ca8-218a-4878-8888-8efc8c9ca712 None admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:33.013296 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a45ca8-218a-4878-8888-8efc8c9ca712 None admin] RBAC: Adding query filter params (name=service) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:33.013601 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a45ca8-218a-4878-8888-8efc8c9ca712 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:33.015027 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a45ca8-218a-4878-8888-8efc8c9ca712 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:33.020580 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf02a63-a054-4e70-96b8-5b9f4d49f400 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:33.024405 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 319/645] 10.222.0.60 () {56 vars in 1103 bytes} [Thu Jul 21 19:15:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:33.025331 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a45ca8-218a-4878-8888-8efc8c9ca712 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:33.060291 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc9755-59a2-46e7-b534-329341c03c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:33.060957 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc9755-59a2-46e7-b534-329341c03c68 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:33.061241 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc9755-59a2-46e7-b534-329341c03c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:33.061518 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc9755-59a2-46e7-b534-329341c03c68 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:33.062254 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffc9755-59a2-46e7-b534-329341c03c68 None admin] RBAC: Adding query filter params (name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:33.062563 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffc9755-59a2-46e7-b534-329341c03c68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:33.063977 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffc9755-59a2-46e7-b534-329341c03c68 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:33.073101 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 327/646] 10.222.0.60 () {56 vars in 1103 bytes} [Thu Jul 21 19:15:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:33.073726 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc9755-59a2-46e7-b534-329341c03c68 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:33.134249 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a45ca8-218a-4878-8888-8efc8c9ca712 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:33.155562 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:33.170535 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0fb03-7434-45c0-be2b-b18f2fcdef8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:33.171545 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0fb03-7434-45c0-be2b-b18f2fcdef8b None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:33.171857 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0fb03-7434-45c0-be2b-b18f2fcdef8b None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:33.172123 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0fb03-7434-45c0-be2b-b18f2fcdef8b None admin] PATH_INFO: `/v3/users/glance` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:33.180966 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc9755-59a2-46e7-b534-329341c03c68 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:33.181459 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e0fb03-7434-45c0-be2b-b18f2fcdef8b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:33.182936 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e0fb03-7434-45c0-be2b-b18f2fcdef8b None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:33.199182 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-30e0fb03-7434-45c0-be2b-b18f2fcdef8b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 21 19:15:33.199182 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:33.199182 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:33.199182 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:33.199182 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:33.199182 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:33.199182 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:33.199182 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:33.199182 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:33.199182 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:33.199182 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:33.199182 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:33.199182 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 19:15:33.199182 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 19:15:33.199182 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 19:15:33.199182 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 19:15:33.200363 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:33.200363 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:33.200363 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 19:15:33.200363 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:15:33.200363 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 19:15:33.200363 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:15:33.200363 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:33.200363 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:33.200363 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:33.200363 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:33.200363 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:33.200363 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:33.200363 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:33.200363 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:33.200363 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:33.200363 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:33.200363 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:33.200363 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:33.201369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:33.201369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:33.201369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 19:15:33.201369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 19:15:33.201369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 19:15:33.201369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 19:15:33.201369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 19:15:33.201369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 19:15:33.201369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 21 19:15:33.201369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:33.201369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 320/647] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:15:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:33.201369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0fb03-7434-45c0-be2b-b18f2fcdef8b None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:33.224838 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e763b-a16f-43f2-a9e0-a039b36f9e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:33.225854 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e763b-a16f-43f2-a9e0-a039b36f9e61 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:33.226293 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e763b-a16f-43f2-a9e0-a039b36f9e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:33.226746 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e763b-a16f-43f2-a9e0-a039b36f9e61 None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:33.228130 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e763b-a16f-43f2-a9e0-a039b36f9e61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:33.228840 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e763b-a16f-43f2-a9e0-a039b36f9e61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:33.230884 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e763b-a16f-43f2-a9e0-a039b36f9e61 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:33.235420 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:33.246417 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 328/648] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Jul 21 19:15:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:33.251981 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e763b-a16f-43f2-a9e0-a039b36f9e61 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:33.306798 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0fb03-7434-45c0-be2b-b18f2fcdef8b None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:33.339893 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12653feb-1750-420a-b872-a4f2dbe2e203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:33.340677 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12653feb-1750-420a-b872-a4f2dbe2e203 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:33.340959 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12653feb-1750-420a-b872-a4f2dbe2e203 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:33.341234 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12653feb-1750-420a-b872-a4f2dbe2e203 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:33.350864 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12653feb-1750-420a-b872-a4f2dbe2e203 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:33.352315 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12653feb-1750-420a-b872-a4f2dbe2e203 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:33.359616 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e763b-a16f-43f2-a9e0-a039b36f9e61 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:33.369810 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-12653feb-1750-420a-b872-a4f2dbe2e203 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:33.369810 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:33.369810 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:33.369810 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:33.369810 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:33.369810 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:33.369810 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:33.369810 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:33.369810 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:33.369810 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:33.369810 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:33.369810 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:33.369810 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:33.369810 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:33.369810 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:33.370913 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:33.370913 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:33.370913 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:33.370913 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:33.370913 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:33.370913 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:33.370913 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:33.370913 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:33.370913 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:33.370913 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:33.370913 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:33.370913 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:33.370913 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:33.370913 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:33.370913 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:33.370913 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:33.370913 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:33.372065 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:33.372065 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:33.372065 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:33.372065 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:33.375416 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 321/649] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:33.376206 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12653feb-1750-420a-b872-a4f2dbe2e203 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:33.399964 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b9e31c-015a-45f2-b42a-c9ec190bb972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:33.401382 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9e31c-015a-45f2-b42a-c9ec190bb972 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:33.401679 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9e31c-015a-45f2-b42a-c9ec190bb972 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:33.401961 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9e31c-015a-45f2-b42a-c9ec190bb972 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:33.409005 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:33.413541 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b9e31c-015a-45f2-b42a-c9ec190bb972 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:33.415077 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b9e31c-015a-45f2-b42a-c9ec190bb972 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:33.440823 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-b7b9e31c-015a-45f2-b42a-c9ec190bb972 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:33.440823 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:33.440823 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:33.440823 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:33.440823 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:33.440823 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:33.440823 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:33.440823 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:33.440823 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:33.440823 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:33.440823 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:33.440823 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:33.440823 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:33.440823 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:33.440823 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:33.441914 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:33.441914 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:33.441914 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:33.441914 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:33.441914 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:33.441914 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:33.441914 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:33.441914 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:33.441914 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:33.441914 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:33.441914 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:33.441914 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:33.441914 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:33.441914 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:33.441914 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:33.441914 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:33.441914 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:33.447900 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:33.447900 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:33.447900 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:33.447900 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:33.447900 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 329/650] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:33.447900 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b9e31c-015a-45f2-b42a-c9ec190bb972 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:33.469781 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:33.493276 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12653feb-1750-420a-b872-a4f2dbe2e203 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:33.529466 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85eddc9-6055-41a9-8cee-dd0b7d6e879f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:33.530487 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85eddc9-6055-41a9-8cee-dd0b7d6e879f None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:33.530769 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85eddc9-6055-41a9-8cee-dd0b7d6e879f None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:33.531046 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85eddc9-6055-41a9-8cee-dd0b7d6e879f None admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:33.531974 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85eddc9-6055-41a9-8cee-dd0b7d6e879f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:33.532285 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85eddc9-6055-41a9-8cee-dd0b7d6e879f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:33.533718 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85eddc9-6055-41a9-8cee-dd0b7d6e879f None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:33.553581 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b9e31c-015a-45f2-b42a-c9ec190bb972 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:33.555339 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 322/651] 10.222.0.60 () {56 vars in 1137 bytes} [Thu Jul 21 19:15:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:33.556226 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85eddc9-6055-41a9-8cee-dd0b7d6e879f None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:33.602265 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19f682-b1a3-4ab4-92f6-06ab1f94478f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:33.602916 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19f682-b1a3-4ab4-92f6-06ab1f94478f None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:33.603210 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19f682-b1a3-4ab4-92f6-06ab1f94478f None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:33.603496 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19f682-b1a3-4ab4-92f6-06ab1f94478f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:33.604409 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f19f682-b1a3-4ab4-92f6-06ab1f94478f None admin] RBAC: Adding query filter params (role.id=beeebaa4e16c40f387f05b67124a424d, scope.project.id=9847b5e8bc0b4483bbce060a48f405f4, user.id=6b4d98e967814e5f84f5f0d67ebb3c17) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:33.604724 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f19f682-b1a3-4ab4-92f6-06ab1f94478f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:33.606150 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f19f682-b1a3-4ab4-92f6-06ab1f94478f None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:33.623486 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 330/652] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:15:33 2022] GET /identity/v3/role_assignments?user.id=6b4d98e967814e5f84f5f0d67ebb3c17&scope.project.id=9847b5e8bc0b4483bbce060a48f405f4&role.id=beeebaa4e16c40f387f05b67124a424d => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:33.623486 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19f682-b1a3-4ab4-92f6-06ab1f94478f None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:33.674088 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85eddc9-6055-41a9-8cee-dd0b7d6e879f None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:33.701230 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:33.726896 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a64dd3-e3e5-4bec-8f3c-d5a1fb2eb3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:33.728001 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a64dd3-e3e5-4bec-8f3c-d5a1fb2eb3b3 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:33.728360 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a64dd3-e3e5-4bec-8f3c-d5a1fb2eb3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:33.728707 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a64dd3-e3e5-4bec-8f3c-d5a1fb2eb3b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:33.729837 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a64dd3-e3e5-4bec-8f3c-d5a1fb2eb3b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:33.730443 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a64dd3-e3e5-4bec-8f3c-d5a1fb2eb3b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:33.732075 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a64dd3-e3e5-4bec-8f3c-d5a1fb2eb3b3 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:33.742953 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:33.751761 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 323/653] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:33.753229 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a64dd3-e3e5-4bec-8f3c-d5a1fb2eb3b3 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:33.754225 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19f682-b1a3-4ab4-92f6-06ab1f94478f None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:33.796251 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f687e-5a18-4779-ac47-6887410be157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:33.796928 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f687e-5a18-4779-ac47-6887410be157 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:33.797221 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f687e-5a18-4779-ac47-6887410be157 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:33.797502 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f687e-5a18-4779-ac47-6887410be157 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:33.798266 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f687e-5a18-4779-ac47-6887410be157 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:33.798579 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f687e-5a18-4779-ac47-6887410be157 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:33.800032 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f687e-5a18-4779-ac47-6887410be157 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:33.814187 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 331/654] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:33.814894 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f687e-5a18-4779-ac47-6887410be157 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:33.880732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a64dd3-e3e5-4bec-8f3c-d5a1fb2eb3b3 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:33.921874 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56322eb-090a-4f7a-8f31-3c62be1f568c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:33.922535 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56322eb-090a-4f7a-8f31-3c62be1f568c None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:33.922822 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56322eb-090a-4f7a-8f31-3c62be1f568c None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:33.923128 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56322eb-090a-4f7a-8f31-3c62be1f568c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:33.941540 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f687e-5a18-4779-ac47-6887410be157 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:33.955954 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:33.978974 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cdbb63-a8b4-4e37-9552-4c9c4e9a210a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:33.979836 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdbb63-a8b4-4e37-9552-4c9c4e9a210a None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:33.980124 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdbb63-a8b4-4e37-9552-4c9c4e9a210a None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:33.980407 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdbb63-a8b4-4e37-9552-4c9c4e9a210a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:33.988442 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cdbb63-a8b4-4e37-9552-4c9c4e9a210a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:33.990019 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cdbb63-a8b4-4e37-9552-4c9c4e9a210a None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:34.002933 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:34.005225 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56322eb-090a-4f7a-8f31-3c62be1f568c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:34.006568 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-75cdbb63-a8b4-4e37-9552-4c9c4e9a210a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 19:15:34.006568 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:34.006568 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:34.006568 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:34.006568 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:34.006568 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:34.006568 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:34.006568 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:34.006568 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:34.006568 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:34.006568 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:34.006568 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:34.006568 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 19:15:34.006568 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 19:15:34.006568 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 19:15:34.006568 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 19:15:34.007659 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:34.007659 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:34.007659 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 19:15:34.007659 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:15:34.007659 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 19:15:34.007659 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:15:34.007659 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:34.007659 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:34.007659 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:34.007659 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:34.007659 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:34.007659 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:34.007659 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:34.007659 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:34.007659 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:34.007659 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:34.007659 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:34.007659 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:34.008599 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:34.008599 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:34.008599 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 19:15:34.008599 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 19:15:34.008599 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 19:15:34.008599 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 19:15:34.008599 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 19:15:34.008599 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 19:15:34.008599 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 19:15:34.008599 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:34.009132 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56322eb-090a-4f7a-8f31-3c62be1f568c None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:34.009213 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 332/655] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:15:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:34.009213 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cdbb63-a8b4-4e37-9552-4c9c4e9a210a None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:34.114871 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 324/656] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:15:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 19:15:34.115849 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56322eb-090a-4f7a-8f31-3c62be1f568c None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:34.116846 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cdbb63-a8b4-4e37-9552-4c9c4e9a210a None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:34.154284 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3878d67-9ebb-49be-9bda-0d9c717b4bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:34.155084 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3878d67-9ebb-49be-9bda-0d9c717b4bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:34.155370 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3878d67-9ebb-49be-9bda-0d9c717b4bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:34.155673 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3878d67-9ebb-49be-9bda-0d9c717b4bf7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:34.164003 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3878d67-9ebb-49be-9bda-0d9c717b4bf7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:34.165469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3878d67-9ebb-49be-9bda-0d9c717b4bf7 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:34.180378 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-d3878d67-9ebb-49be-9bda-0d9c717b4bf7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 19:15:34.180378 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:34.180378 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:34.180378 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:34.180378 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:34.180378 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:34.180378 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:34.180378 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:34.180378 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:34.180378 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:34.180378 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:34.180378 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:34.180378 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 19:15:34.180378 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 19:15:34.180378 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 19:15:34.180378 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 19:15:34.181355 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:34.181355 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:34.181355 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 19:15:34.181355 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:15:34.181355 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 19:15:34.181355 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:15:34.181355 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:34.181355 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:34.181355 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:34.181355 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:34.181355 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:34.181355 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:34.181355 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:34.181355 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:34.181355 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:34.181355 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:34.181355 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:34.181355 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:34.182324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:34.182324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:34.182324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 19:15:34.182324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 19:15:34.182324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 19:15:34.182324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 19:15:34.182324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 19:15:34.182324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 19:15:34.182324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 19:15:34.182324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:34.182324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 333/657] 10.222.0.60 () {56 vars in 1102 bytes} [Thu Jul 21 19:15:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:34.182324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3878d67-9ebb-49be-9bda-0d9c717b4bf7 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:34.221948 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:34.229340 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:34.233297 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56322eb-090a-4f7a-8f31-3c62be1f568c None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:34.273241 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66022d-576c-4624-8f3a-099e55436bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:34.273942 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66022d-576c-4624-8f3a-099e55436bee None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:34.274384 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66022d-576c-4624-8f3a-099e55436bee None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:34.274665 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66022d-576c-4624-8f3a-099e55436bee None admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:34.275814 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66022d-576c-4624-8f3a-099e55436bee None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:34.276126 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66022d-576c-4624-8f3a-099e55436bee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:34.277587 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66022d-576c-4624-8f3a-099e55436bee None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:34.291125 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3878d67-9ebb-49be-9bda-0d9c717b4bf7 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:34.300763 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 325/658] 10.222.0.60 () {56 vars in 1137 bytes} [Thu Jul 21 19:15:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:34.300763 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e23f92-ff47-4443-a8d2-e63fb040f8a1 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:34.300763 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e23f92-ff47-4443-a8d2-e63fb040f8a1 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:34.300763 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e23f92-ff47-4443-a8d2-e63fb040f8a1 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:34.304687 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 326/659] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:34.305359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e23f92-ff47-4443-a8d2-e63fb040f8a1 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:34.333474 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bfe990-1be7-4d51-a379-a7eaaf259bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:34.335040 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfe990-1be7-4d51-a379-a7eaaf259bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:34.335237 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfe990-1be7-4d51-a379-a7eaaf259bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:34.335540 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfe990-1be7-4d51-a379-a7eaaf259bf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:34.346199 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bfe990-1be7-4d51-a379-a7eaaf259bf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:34.347684 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bfe990-1be7-4d51-a379-a7eaaf259bf2 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:34.365052 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-68bfe990-1be7-4d51-a379-a7eaaf259bf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:34.365052 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:34.365052 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:34.365052 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:34.365052 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:34.365052 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:34.365052 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:34.365052 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:34.365052 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:34.365052 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:34.365052 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:34.365052 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:34.365052 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:34.365052 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:34.365052 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:34.366336 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:34.366336 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:34.366336 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:34.366336 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:34.366336 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:34.366336 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:34.366336 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:34.366336 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:34.366336 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:34.366336 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:34.366336 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:34.366336 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:34.366336 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:34.366336 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:34.366336 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:34.366336 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:34.366336 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:34.367223 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:34.367223 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:34.367223 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:34.367223 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:34.367223 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 334/660] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:34.367223 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bfe990-1be7-4d51-a379-a7eaaf259bf2 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:34.416468 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e23f92-ff47-4443-a8d2-e63fb040f8a1 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:34.455755 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4eb9d-010c-42db-b164-62203fa16739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:34.456434 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4eb9d-010c-42db-b164-62203fa16739 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:34.456727 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4eb9d-010c-42db-b164-62203fa16739 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:34.456995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4eb9d-010c-42db-b164-62203fa16739 None admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:34.457823 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4eb9d-010c-42db-b164-62203fa16739 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:34.458131 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4eb9d-010c-42db-b164-62203fa16739 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:34.460263 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4eb9d-010c-42db-b164-62203fa16739 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:34.463888 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:34.482685 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 327/661] 10.222.0.60 () {56 vars in 1139 bytes} [Thu Jul 21 19:15:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:34.482685 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2264a-fa49-49ec-b3d8-108b740275cf None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:34.482685 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2264a-fa49-49ec-b3d8-108b740275cf None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:34.482685 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2264a-fa49-49ec-b3d8-108b740275cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:34.487175 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bfe990-1be7-4d51-a379-a7eaaf259bf2 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:34.497206 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-94b2264a-fa49-49ec-b3d8-108b740275cf None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:34.498429 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-94b2264a-fa49-49ec-b3d8-108b740275cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:34.510228 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:34.528147 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8479a-d262-44ed-a0a2-4c6d24dd7503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:34.528795 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8479a-d262-44ed-a0a2-4c6d24dd7503 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:34.529078 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8479a-d262-44ed-a0a2-4c6d24dd7503 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:34.529577 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8479a-d262-44ed-a0a2-4c6d24dd7503 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:34.568017 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 328/662] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:15:34.568914 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2264a-fa49-49ec-b3d8-108b740275cf None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:34.617464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b8479a-d262-44ed-a0a2-4c6d24dd7503 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:34.618917 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b8479a-d262-44ed-a0a2-4c6d24dd7503 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:34.671985 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2264a-fa49-49ec-b3d8-108b740275cf None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:34.707458 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:34.707711 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2934cdb-76e8-4171-966d-d2f6e986376a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:34.708301 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2934cdb-76e8-4171-966d-d2f6e986376a None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:34.708585 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2934cdb-76e8-4171-966d-d2f6e986376a None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:34.708861 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2934cdb-76e8-4171-966d-d2f6e986376a None admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:34.710277 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2934cdb-76e8-4171-966d-d2f6e986376a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:34.710823 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2934cdb-76e8-4171-966d-d2f6e986376a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:34.711984 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2934cdb-76e8-4171-966d-d2f6e986376a None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:34.723539 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 329/663] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:34.728429 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2934cdb-76e8-4171-966d-d2f6e986376a None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:34.728576 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 335/664] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:15:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 19:15:34.728576 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8479a-d262-44ed-a0a2-4c6d24dd7503 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:34.738034 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:34.837627 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8479a-d262-44ed-a0a2-4c6d24dd7503 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:34.838221 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2934cdb-76e8-4171-966d-d2f6e986376a None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:34.873116 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ec95b-72f3-4612-9538-9e1f8fc0f519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:34.873921 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ec95b-72f3-4612-9538-9e1f8fc0f519 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:34.874208 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ec95b-72f3-4612-9538-9e1f8fc0f519 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:34.874492 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ec95b-72f3-4612-9538-9e1f8fc0f519 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:34.874919 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb433b9-03a2-4367-9616-3188c3ab7121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:34.875612 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb433b9-03a2-4367-9616-3188c3ab7121 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:34.875899 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb433b9-03a2-4367-9616-3188c3ab7121 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:34.876182 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb433b9-03a2-4367-9616-3188c3ab7121 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:34.886084 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ec95b-72f3-4612-9538-9e1f8fc0f519 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:15:34.894254 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-b29ec95b-72f3-4612-9538-9e1f8fc0f519 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 19:15:34.894254 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:34.894254 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:34.894254 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:34.894254 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:34.894254 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:34.894254 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:34.894254 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:34.894254 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:34.894254 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:34.894254 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:34.894254 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:34.894254 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:15:34.894254 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:15:34.894254 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:15:34.894254 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:15:34.895252 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:15:34.895252 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:15:34.895252 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:15:34.895252 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:15:34.895252 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:34.895252 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:34.895252 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:34.895252 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:34.895252 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:34.895252 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:34.895252 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:34.895252 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:34.895252 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:34.895252 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:34.895252 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:34.895252 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:34.896131 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:34.896131 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:34.896131 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:34.896131 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:34.896131 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:15:34.896131 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:15:34.896131 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:15:34.896131 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:15:34.896131 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:15:34.896131 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:15:34.896131 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 19:15:34.896131 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:34.896131 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 336/665] 10.222.0.60 () {56 vars in 1102 bytes} [Thu Jul 21 19:15:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:34.896814 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ec95b-72f3-4612-9538-9e1f8fc0f519 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:34.946659 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:34.955554 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb433b9-03a2-4367-9616-3188c3ab7121 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:34.958766 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb433b9-03a2-4367-9616-3188c3ab7121 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:34.966054 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:35.002691 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ec95b-72f3-4612-9538-9e1f8fc0f519 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:35.037680 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3bfc1-ea6c-4090-ae8e-81de4fa3f1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:35.038465 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3bfc1-ea6c-4090-ae8e-81de4fa3f1e3 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:35.038751 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3bfc1-ea6c-4090-ae8e-81de4fa3f1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:35.039042 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3bfc1-ea6c-4090-ae8e-81de4fa3f1e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:35.047158 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b3bfc1-ea6c-4090-ae8e-81de4fa3f1e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:35.048766 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b3bfc1-ea6c-4090-ae8e-81de4fa3f1e3 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:35.063494 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 330/666] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:15:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 19:15:35.064420 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-79b3bfc1-ea6c-4090-ae8e-81de4fa3f1e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:15:35.064420 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:35.064420 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:35.064420 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:35.064420 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:35.064420 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:35.064420 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:35.064420 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:35.064420 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:35.064420 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:35.064420 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:35.064420 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:35.064420 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 19:15:35.064420 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 19:15:35.064420 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 19:15:35.065277 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 19:15:35.065277 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:35.065277 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:35.065277 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:35.065277 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:35.065277 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:35.065277 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:35.065277 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:35.065277 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:35.065277 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:35.065277 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:35.065277 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:35.065277 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:35.065277 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:35.065277 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:35.065277 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:35.065277 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:35.066155 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 19:15:35.066155 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 19:15:35.066155 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 19:15:35.066155 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 19:15:35.066155 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 19:15:35.066155 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 19:15:35.066155 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:15:35.066155 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:35.066155 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 337/667] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:15:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:35.066630 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3bfc1-ea6c-4090-ae8e-81de4fa3f1e3 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:35.067053 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb433b9-03a2-4367-9616-3188c3ab7121 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:35.172774 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3bfc1-ea6c-4090-ae8e-81de4fa3f1e3 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:35.174192 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb433b9-03a2-4367-9616-3188c3ab7121 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:35.181048 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:35.184075 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:35.207340 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187dcd6b-52bc-4459-9a67-43047fb9eb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:35.207987 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187dcd6b-52bc-4459-9a67-43047fb9eb2f None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:35.208308 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187dcd6b-52bc-4459-9a67-43047fb9eb2f None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:35.208625 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187dcd6b-52bc-4459-9a67-43047fb9eb2f None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:35.209349 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187dcd6b-52bc-4459-9a67-43047fb9eb2f None admin] RBAC: Adding query filter params (name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:35.209656 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187dcd6b-52bc-4459-9a67-43047fb9eb2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:35.209756 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bccdd51-14f1-482f-9994-8aaf04138417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:35.210525 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccdd51-14f1-482f-9994-8aaf04138417 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:35.210810 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccdd51-14f1-482f-9994-8aaf04138417 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:35.211023 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187dcd6b-52bc-4459-9a67-43047fb9eb2f None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:35.211119 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccdd51-14f1-482f-9994-8aaf04138417 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:35.223596 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 338/668] 10.222.0.60 () {56 vars in 1103 bytes} [Thu Jul 21 19:15:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:35.223596 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187dcd6b-52bc-4459-9a67-43047fb9eb2f None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:35.226999 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bccdd51-14f1-482f-9994-8aaf04138417 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:35.228489 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bccdd51-14f1-482f-9994-8aaf04138417 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:35.246782 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-5bccdd51-14f1-482f-9994-8aaf04138417 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:35.246782 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:35.246782 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:35.246782 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:35.246782 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:35.246782 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:35.246782 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:35.246782 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:35.246782 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:35.246782 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:35.246782 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:35.246782 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:35.246782 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:35.246782 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:35.246782 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:35.253259 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:35.253259 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:35.253259 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:35.253259 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:35.253259 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:35.253259 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:35.253259 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:35.253259 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:35.253259 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:35.253259 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:35.253259 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:35.253259 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:35.253259 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:35.253259 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:35.253259 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:35.253259 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:35.253259 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:35.254191 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:35.254191 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:35.254191 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:35.254191 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:35.254191 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 331/669] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:35.254191 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bccdd51-14f1-482f-9994-8aaf04138417 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:35.336510 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187dcd6b-52bc-4459-9a67-43047fb9eb2f None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:35.358671 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bccdd51-14f1-482f-9994-8aaf04138417 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:35.373641 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a608f6-a5a8-450c-b5d3-ac6e4c02e836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:35.374480 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a608f6-a5a8-450c-b5d3-ac6e4c02e836 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:35.374765 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a608f6-a5a8-450c-b5d3-ac6e4c02e836 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:35.375038 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a608f6-a5a8-450c-b5d3-ac6e4c02e836 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:35.387338 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a608f6-a5a8-450c-b5d3-ac6e4c02e836 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:35.388816 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a608f6-a5a8-450c-b5d3-ac6e4c02e836 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:35.393934 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16937237-e0f5-48da-88b4-2ebf315d2dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:35.394600 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16937237-e0f5-48da-88b4-2ebf315d2dba None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:35.394887 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16937237-e0f5-48da-88b4-2ebf315d2dba None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:35.395166 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16937237-e0f5-48da-88b4-2ebf315d2dba None admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:35.395984 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16937237-e0f5-48da-88b4-2ebf315d2dba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:35.396294 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16937237-e0f5-48da-88b4-2ebf315d2dba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:35.398266 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16937237-e0f5-48da-88b4-2ebf315d2dba None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:35.407776 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-35a608f6-a5a8-450c-b5d3-ac6e4c02e836 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:35.407776 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:35.407776 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:35.407776 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:35.407776 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:35.407776 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:35.407776 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:35.407776 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:35.407776 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:35.407776 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:35.407776 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:35.407776 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:35.407776 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:35.407776 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:35.407776 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:35.408658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:35.408658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:35.408658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:35.408658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:35.408658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:35.408658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:35.408658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:35.408658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:35.408658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:35.408658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:35.408658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:35.408658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:35.408658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:35.408658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:35.408658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:35.408658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:35.408658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:35.409574 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:35.409574 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:35.409574 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:35.409574 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:35.414907 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 339/670] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:35.415058 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 332/671] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Jul 21 19:15:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:35.415058 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16937237-e0f5-48da-88b4-2ebf315d2dba None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:35.416068 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a608f6-a5a8-450c-b5d3-ac6e4c02e836 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:35.436272 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:35.442285 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:35.524774 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16937237-e0f5-48da-88b4-2ebf315d2dba None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:35.526123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a608f6-a5a8-450c-b5d3-ac6e4c02e836 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:35.562576 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41345e10-45ce-42c0-8ae3-b5a0a3c74329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:35.562786 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f17044-193a-47a6-bd33-0dd8ab5310e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:35.563380 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f17044-193a-47a6-bd33-0dd8ab5310e3 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:35.563587 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41345e10-45ce-42c0-8ae3-b5a0a3c74329 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:35.563695 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f17044-193a-47a6-bd33-0dd8ab5310e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:35.563774 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41345e10-45ce-42c0-8ae3-b5a0a3c74329 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:35.563940 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f17044-193a-47a6-bd33-0dd8ab5310e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:35.564045 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41345e10-45ce-42c0-8ae3-b5a0a3c74329 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:35.564827 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f17044-193a-47a6-bd33-0dd8ab5310e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:35.565137 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f17044-193a-47a6-bd33-0dd8ab5310e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:35.566489 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f17044-193a-47a6-bd33-0dd8ab5310e3 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:35.575829 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41345e10-45ce-42c0-8ae3-b5a0a3c74329 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:35.577266 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41345e10-45ce-42c0-8ae3-b5a0a3c74329 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:35.579660 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 333/672] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:35.580675 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f17044-193a-47a6-bd33-0dd8ab5310e3 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:35.599073 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-41345e10-45ce-42c0-8ae3-b5a0a3c74329 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:35.599073 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:35.599073 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:35.599073 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:35.599073 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:35.599073 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:35.599073 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:35.599073 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:35.599073 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:35.599073 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:35.599073 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:35.599073 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:35.599073 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:35.599073 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:35.599073 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:35.600222 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:35.600222 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:35.600222 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:35.600222 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:35.600222 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:35.600222 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:35.600222 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:35.600222 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:35.600222 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:35.600222 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:35.600222 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:35.600222 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:35.600222 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:35.600222 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:35.600222 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:35.600222 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:35.600222 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:35.605769 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:35.605769 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:35.605769 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:35.605769 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:35.605769 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 340/673] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:35.605769 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41345e10-45ce-42c0-8ae3-b5a0a3c74329 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:35.672965 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:35.676982 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:35.696017 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f17044-193a-47a6-bd33-0dd8ab5310e3 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:35.709192 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41345e10-45ce-42c0-8ae3-b5a0a3c74329 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:35.730758 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c6610-500b-4098-a6f4-08e05f129753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:35.731449 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c6610-500b-4098-a6f4-08e05f129753 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:35.731742 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c6610-500b-4098-a6f4-08e05f129753 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:35.732020 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c6610-500b-4098-a6f4-08e05f129753 None admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:35.732878 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c6610-500b-4098-a6f4-08e05f129753 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:35.733190 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c6610-500b-4098-a6f4-08e05f129753 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:35.734560 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c6610-500b-4098-a6f4-08e05f129753 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:35.745009 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578c93a-b1ba-471b-adff-4ecda73f3af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:35.745900 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578c93a-b1ba-471b-adff-4ecda73f3af4 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:35.746388 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578c93a-b1ba-471b-adff-4ecda73f3af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:35.746842 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578c93a-b1ba-471b-adff-4ecda73f3af4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:35.746946 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 334/674] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:35.747767 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c6610-500b-4098-a6f4-08e05f129753 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:35.748151 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2578c93a-b1ba-471b-adff-4ecda73f3af4 None admin] RBAC: Adding query filter params (role.id=beeebaa4e16c40f387f05b67124a424d, scope.project.id=9847b5e8bc0b4483bbce060a48f405f4, user.id=1a23a8e608f94d5d8153dcf7e79250f7) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:35.748471 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2578c93a-b1ba-471b-adff-4ecda73f3af4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:35.749906 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2578c93a-b1ba-471b-adff-4ecda73f3af4 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:35.757082 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 341/675] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:15:35 2022] GET /identity/v3/role_assignments?user.id=1a23a8e608f94d5d8153dcf7e79250f7&scope.project.id=9847b5e8bc0b4483bbce060a48f405f4&role.id=beeebaa4e16c40f387f05b67124a424d => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:35.758101 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578c93a-b1ba-471b-adff-4ecda73f3af4 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:35.889754 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c6610-500b-4098-a6f4-08e05f129753 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:35.893112 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578c93a-b1ba-471b-adff-4ecda73f3af4 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:35.930669 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd3cda-e3d1-4a4e-bb78-78d052839eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:35.931594 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd3cda-e3d1-4a4e-bb78-78d052839eff None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:35.931882 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd3cda-e3d1-4a4e-bb78-78d052839eff None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:35.932158 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd3cda-e3d1-4a4e-bb78-78d052839eff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:35.936684 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72bf65c-0ca6-4c11-8c8c-d443ce002699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:35.937358 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bf65c-0ca6-4c11-8c8c-d443ce002699 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:35.937647 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bf65c-0ca6-4c11-8c8c-d443ce002699 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:35.937931 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bf65c-0ca6-4c11-8c8c-d443ce002699 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:35.938665 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72bf65c-0ca6-4c11-8c8c-d443ce002699 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:35.938981 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72bf65c-0ca6-4c11-8c8c-d443ce002699 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:35.939080 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdd3cda-e3d1-4a4e-bb78-78d052839eff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:35.940404 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72bf65c-0ca6-4c11-8c8c-d443ce002699 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:35.940590 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdd3cda-e3d1-4a4e-bb78-78d052839eff None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:35.943035 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:35.944125 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:35.953827 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 342/676] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:35.954677 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72bf65c-0ca6-4c11-8c8c-d443ce002699 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:35.956968 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-5fdd3cda-e3d1-4a4e-bb78-78d052839eff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:15:35.956968 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:35.956968 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:35.956968 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:35.956968 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:35.956968 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:35.956968 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:35.956968 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:35.956968 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:35.956968 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:35.956968 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:35.956968 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:35.956968 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 19:15:35.956968 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 19:15:35.956968 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 19:15:35.957839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 19:15:35.957839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:35.957839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:35.957839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:35.957839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:35.957839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:35.957839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:35.957839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:35.957839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:35.957839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:35.957839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:35.957839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:35.957839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:35.957839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:35.957839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:35.957839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:35.957839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:35.958729 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 19:15:35.958729 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 19:15:35.958729 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 19:15:35.958729 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 19:15:35.958729 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 19:15:35.958729 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 19:15:35.958729 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:15:35.958729 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:35.958729 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 335/677] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:15:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:35.960008 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2190f54-1c6a-4f92-aa81-e0f884bd97f3 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:35.960128 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2190f54-1c6a-4f92-aa81-e0f884bd97f3 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:35.960342 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2190f54-1c6a-4f92-aa81-e0f884bd97f3 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:35.961611 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 336/678] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:35.962363 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2190f54-1c6a-4f92-aa81-e0f884bd97f3 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:36.072744 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72bf65c-0ca6-4c11-8c8c-d443ce002699 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:36.073520 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2190f54-1c6a-4f92-aa81-e0f884bd97f3 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:36.108380 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8681ec0a-090f-4354-9e7a-13b7520b066d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:36.109170 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681ec0a-090f-4354-9e7a-13b7520b066d None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:36.109455 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681ec0a-090f-4354-9e7a-13b7520b066d None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:36.109730 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681ec0a-090f-4354-9e7a-13b7520b066d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:36.110519 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639da9f-3ab7-4510-ad6f-957ccb0dcaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:36.111314 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639da9f-3ab7-4510-ad6f-957ccb0dcaa9 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:36.111739 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639da9f-3ab7-4510-ad6f-957ccb0dcaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:36.112016 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639da9f-3ab7-4510-ad6f-957ccb0dcaa9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:36.119023 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8681ec0a-090f-4354-9e7a-13b7520b066d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:36.119522 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2639da9f-3ab7-4510-ad6f-957ccb0dcaa9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:36.120588 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8681ec0a-090f-4354-9e7a-13b7520b066d None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:36.120997 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2639da9f-3ab7-4510-ad6f-957ccb0dcaa9 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:36.135012 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-2639da9f-3ab7-4510-ad6f-957ccb0dcaa9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:15:36.135012 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:36.135012 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:36.135012 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:36.135012 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:36.135012 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:36.135012 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:36.135012 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:36.135012 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:36.135012 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:36.135012 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:36.135012 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:36.135012 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 19:15:36.135012 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 19:15:36.135012 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 19:15:36.136157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 19:15:36.136157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:36.136157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:36.136157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:36.136157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:36.136157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:36.136157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:36.136157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:36.136157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:36.136157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:36.136157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:36.136157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:36.136157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:36.136157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:36.136157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:36.136157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:36.136157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:36.137051 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 19:15:36.137051 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 19:15:36.137051 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 19:15:36.137051 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 19:15:36.137051 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 19:15:36.137051 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 19:15:36.137051 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:15:36.137051 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:36.137500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-8681ec0a-090f-4354-9e7a-13b7520b066d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 19:15:36.137500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:36.137500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:36.137500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:36.137500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:36.137500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:36.137500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:36.137500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:36.137500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:36.137500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:36.137500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:36.137500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:36.137500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 19:15:36.137500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 19:15:36.137500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 19:15:36.137500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 19:15:36.138359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:36.138359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:36.138359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 19:15:36.138359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:15:36.138359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 19:15:36.138359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:15:36.138359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:36.138359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:36.138359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:36.138359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:36.138359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:36.138359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:36.138359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:36.138359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:36.138359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:36.138359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:36.138359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:36.138359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:36.139300 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:36.139300 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:36.139300 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 19:15:36.139300 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 19:15:36.139300 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 19:15:36.139300 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 19:15:36.139300 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 19:15:36.139300 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 19:15:36.139300 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 19:15:36.139300 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:36.142275 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 343/679] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:15:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:36.142398 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 337/680] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Jul 21 19:15:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:36.142492 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639da9f-3ab7-4510-ad6f-957ccb0dcaa9 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:36.142820 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a516d22-b4f4-46a8-acc6-f03ae2d84fa2 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:36.143118 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a516d22-b4f4-46a8-acc6-f03ae2d84fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:36.143400 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a516d22-b4f4-46a8-acc6-f03ae2d84fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:36.164021 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-8a516d22-b4f4-46a8-acc6-f03ae2d84fa2 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:36.165680 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-8a516d22-b4f4-46a8-acc6-f03ae2d84fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:36.206806 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:36.222679 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:36.241741 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 338/681] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:15:36.241741 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a516d22-b4f4-46a8-acc6-f03ae2d84fa2 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:36.273755 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639da9f-3ab7-4510-ad6f-957ccb0dcaa9 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:36.310172 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307aae43-1d7b-4e54-80b9-72b5c637e6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:36.310844 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307aae43-1d7b-4e54-80b9-72b5c637e6c6 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:36.311137 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307aae43-1d7b-4e54-80b9-72b5c637e6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:36.311423 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307aae43-1d7b-4e54-80b9-72b5c637e6c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:36.312243 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307aae43-1d7b-4e54-80b9-72b5c637e6c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:36.312563 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307aae43-1d7b-4e54-80b9-72b5c637e6c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:36.313999 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307aae43-1d7b-4e54-80b9-72b5c637e6c6 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:36.327775 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 344/682] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Jul 21 19:15:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:36.328612 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307aae43-1d7b-4e54-80b9-72b5c637e6c6 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:36.349958 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a516d22-b4f4-46a8-acc6-f03ae2d84fa2 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:36.385804 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76fa3d6-b1e9-43e2-a8e3-01bdb82829eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:36.386486 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76fa3d6-b1e9-43e2-a8e3-01bdb82829eb None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:36.386769 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76fa3d6-b1e9-43e2-a8e3-01bdb82829eb None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:36.387055 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76fa3d6-b1e9-43e2-a8e3-01bdb82829eb None admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:36.387925 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76fa3d6-b1e9-43e2-a8e3-01bdb82829eb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:36.388239 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76fa3d6-b1e9-43e2-a8e3-01bdb82829eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:36.389663 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76fa3d6-b1e9-43e2-a8e3-01bdb82829eb None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:36.412465 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 339/683] 10.222.0.60 () {56 vars in 1135 bytes} [Thu Jul 21 19:15:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:36.412465 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76fa3d6-b1e9-43e2-a8e3-01bdb82829eb None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:36.444071 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307aae43-1d7b-4e54-80b9-72b5c637e6c6 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:36.461600 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:36.466590 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:36.483197 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818bb943-b755-4892-b14e-c55e80658feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:36.483918 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bb943-b755-4892-b14e-c55e80658feb None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:36.484209 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bb943-b755-4892-b14e-c55e80658feb None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:36.484492 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bb943-b755-4892-b14e-c55e80658feb None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:36.485288 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818bb943-b755-4892-b14e-c55e80658feb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:36.485604 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818bb943-b755-4892-b14e-c55e80658feb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:36.487038 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818bb943-b755-4892-b14e-c55e80658feb None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:36.505313 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 345/684] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Jul 21 19:15:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:36.507025 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818bb943-b755-4892-b14e-c55e80658feb None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:36.520956 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76fa3d6-b1e9-43e2-a8e3-01bdb82829eb None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:36.557485 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068c81e-7697-4936-9cf2-564285a5d5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:36.558282 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068c81e-7697-4936-9cf2-564285a5d5dd None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:36.558565 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068c81e-7697-4936-9cf2-564285a5d5dd None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:36.558842 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068c81e-7697-4936-9cf2-564285a5d5dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:36.570731 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7068c81e-7697-4936-9cf2-564285a5d5dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:15:36.578449 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-7068c81e-7697-4936-9cf2-564285a5d5dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:15:36.578449 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:36.578449 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:36.578449 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:36.578449 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:36.578449 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:36.578449 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:36.578449 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:36.578449 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:36.578449 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:36.578449 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:36.578449 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:36.578449 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:15:36.578449 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:15:36.578449 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:15:36.578449 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:15:36.579593 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:15:36.579593 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:15:36.579593 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:15:36.579593 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:15:36.579593 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:36.579593 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:36.579593 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:36.579593 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:36.579593 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:36.579593 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:36.579593 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:36.579593 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:36.579593 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:36.579593 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:36.579593 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:36.579593 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:36.580518 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:36.580518 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:36.580518 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:36.580518 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:36.580518 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:15:36.580518 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:15:36.580518 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:15:36.580518 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:15:36.580518 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:15:36.580518 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:15:36.580518 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:15:36.580518 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:36.580518 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 340/685] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Jul 21 19:15:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:36.580518 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068c81e-7697-4936-9cf2-564285a5d5dd None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:36.622109 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818bb943-b755-4892-b14e-c55e80658feb None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:36.657565 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b518a-0780-47f3-a923-d05eba1fe42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:36.658218 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b518a-0780-47f3-a923-d05eba1fe42e None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:36.658501 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b518a-0780-47f3-a923-d05eba1fe42e None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:36.658777 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b518a-0780-47f3-a923-d05eba1fe42e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:36.659625 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b518a-0780-47f3-a923-d05eba1fe42e None admin] RBAC: Adding query filter params (role.id=beeebaa4e16c40f387f05b67124a424d, scope.project.id=9847b5e8bc0b4483bbce060a48f405f4, user.id=591016b95ab24d3a8de83089a141d914) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:36.659941 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b518a-0780-47f3-a923-d05eba1fe42e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:36.661366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b518a-0780-47f3-a923-d05eba1fe42e None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:36.667975 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 346/686] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:15:36 2022] GET /identity/v3/role_assignments?user.id=591016b95ab24d3a8de83089a141d914&scope.project.id=9847b5e8bc0b4483bbce060a48f405f4&role.id=beeebaa4e16c40f387f05b67124a424d => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:36.668694 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b518a-0780-47f3-a923-d05eba1fe42e None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:36.701235 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068c81e-7697-4936-9cf2-564285a5d5dd None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:36.712457 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:36.733872 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:36.741355 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05257dea-b396-4d81-ac48-4540b3ca321f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:36.745440 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05257dea-b396-4d81-ac48-4540b3ca321f None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:36.745440 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05257dea-b396-4d81-ac48-4540b3ca321f None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:36.745440 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05257dea-b396-4d81-ac48-4540b3ca321f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:36.809187 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b518a-0780-47f3-a923-d05eba1fe42e None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:36.825052 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05257dea-b396-4d81-ac48-4540b3ca321f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:36.826645 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05257dea-b396-4d81-ac48-4540b3ca321f None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:36.856554 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c87618-f310-4aec-969b-226d701fe682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:36.857550 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c87618-f310-4aec-969b-226d701fe682 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:36.857891 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c87618-f310-4aec-969b-226d701fe682 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:36.858178 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c87618-f310-4aec-969b-226d701fe682 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:36.859294 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c87618-f310-4aec-969b-226d701fe682 None admin] RBAC: Adding query filter params (role.id=beeebaa4e16c40f387f05b67124a424d, scope.project.id=9847b5e8bc0b4483bbce060a48f405f4, user.id=b1908b2f87d5442da8ba826489cb2018) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:36.859723 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c87618-f310-4aec-969b-226d701fe682 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:36.861059 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c87618-f310-4aec-969b-226d701fe682 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:36.868655 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 347/687] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:15:36 2022] GET /identity/v3/role_assignments?user.id=b1908b2f87d5442da8ba826489cb2018&scope.project.id=9847b5e8bc0b4483bbce060a48f405f4&role.id=beeebaa4e16c40f387f05b67124a424d => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:36.869171 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c87618-f310-4aec-969b-226d701fe682 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:36.958327 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 341/688] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:15:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 19:15:36.964791 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05257dea-b396-4d81-ac48-4540b3ca321f None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:36.979749 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:37.005080 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c87618-f310-4aec-969b-226d701fe682 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:37.011810 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:37.058036 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8203a64d-3861-44d1-a6f6-b12021709636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:37.058898 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203a64d-3861-44d1-a6f6-b12021709636 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:37.059283 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203a64d-3861-44d1-a6f6-b12021709636 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:37.059971 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203a64d-3861-44d1-a6f6-b12021709636 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:37.061501 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8203a64d-3861-44d1-a6f6-b12021709636 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:37.061829 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8203a64d-3861-44d1-a6f6-b12021709636 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:37.063359 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8203a64d-3861-44d1-a6f6-b12021709636 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:37.075537 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 348/689] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:15:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:37.081025 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8203a64d-3861-44d1-a6f6-b12021709636 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:37.118774 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05257dea-b396-4d81-ac48-4540b3ca321f None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:37.161458 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a8cd7-cf5d-432e-84cc-a31aaa1be474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:37.162304 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a8cd7-cf5d-432e-84cc-a31aaa1be474 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:37.162593 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a8cd7-cf5d-432e-84cc-a31aaa1be474 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:37.162869 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a8cd7-cf5d-432e-84cc-a31aaa1be474 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:37.174336 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a8cd7-cf5d-432e-84cc-a31aaa1be474 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:37.175828 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a8cd7-cf5d-432e-84cc-a31aaa1be474 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:37.196831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-bc3a8cd7-cf5d-432e-84cc-a31aaa1be474 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:37.196831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:37.196831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:37.196831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:37.196831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:37.196831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:37.196831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:37.196831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:37.196831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:37.196831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:37.196831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:37.196831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:37.196831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:37.196831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:37.196831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:37.197784 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:37.197784 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:37.197784 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:37.197784 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:37.197784 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:37.197784 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:37.197784 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:37.197784 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:37.197784 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:37.197784 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:37.197784 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:37.197784 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:37.197784 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:37.197784 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:37.197784 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:37.197784 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:37.197784 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:37.199484 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:37.199484 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:37.199484 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:37.199484 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:37.199484 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 342/690] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:37.203775 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a8cd7-cf5d-432e-84cc-a31aaa1be474 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:37.224957 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8203a64d-3861-44d1-a6f6-b12021709636 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:37.288951 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:37.289826 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c5dc0-3946-4d26-84c9-c51a5da2ba5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:37.290682 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c5dc0-3946-4d26-84c9-c51a5da2ba5c None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:37.290972 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c5dc0-3946-4d26-84c9-c51a5da2ba5c None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:37.291254 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c5dc0-3946-4d26-84c9-c51a5da2ba5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:37.313975 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c5dc0-3946-4d26-84c9-c51a5da2ba5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:37.317930 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c5dc0-3946-4d26-84c9-c51a5da2ba5c None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:37.352314 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-c70c5dc0-3946-4d26-84c9-c51a5da2ba5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:37.352314 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:37.352314 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:37.352314 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:37.352314 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:37.352314 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:37.352314 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:37.352314 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:37.352314 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:37.352314 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:37.352314 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:37.352314 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:37.352314 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:37.352314 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:37.352314 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:37.353265 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:37.353265 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:37.353265 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:37.353265 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:37.353265 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:37.353265 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:37.353265 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:37.353265 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:37.353265 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:37.353265 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:37.353265 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:37.353265 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:37.353265 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:37.353265 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:37.353265 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:37.353265 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:37.353265 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:37.354158 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:37.354158 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:37.354158 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:37.354158 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:37.354805 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 349/691] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:37.359517 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c5dc0-3946-4d26-84c9-c51a5da2ba5c None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:37.377062 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a8cd7-cf5d-432e-84cc-a31aaa1be474 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:37.402081 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:37.442494 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e5786-cd66-454a-9a2a-4eb8897f7656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:37.443171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e5786-cd66-454a-9a2a-4eb8897f7656 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:37.443502 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e5786-cd66-454a-9a2a-4eb8897f7656 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:37.443784 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e5786-cd66-454a-9a2a-4eb8897f7656 None admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:37.444516 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e5786-cd66-454a-9a2a-4eb8897f7656 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:37.444821 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e5786-cd66-454a-9a2a-4eb8897f7656 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:37.446198 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e5786-cd66-454a-9a2a-4eb8897f7656 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:37.459446 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 343/692] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:15:37.463854 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e5786-cd66-454a-9a2a-4eb8897f7656 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:37.573058 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e5786-cd66-454a-9a2a-4eb8897f7656 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:37.591958 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:37.609676 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f689bd-ca91-4729-bd47-fcbc25afc0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:37.613456 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f689bd-ca91-4729-bd47-fcbc25afc0ea None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:37.613456 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f689bd-ca91-4729-bd47-fcbc25afc0ea None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:37.613456 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f689bd-ca91-4729-bd47-fcbc25afc0ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:37.619266 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f689bd-ca91-4729-bd47-fcbc25afc0ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:37.620907 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f689bd-ca91-4729-bd47-fcbc25afc0ea None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:37.630257 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c5dc0-3946-4d26-84c9-c51a5da2ba5c None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:37.635701 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-a8f689bd-ca91-4729-bd47-fcbc25afc0ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:15:37.635701 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:37.635701 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:37.635701 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:37.635701 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:37.635701 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:37.635701 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:37.635701 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:37.635701 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:37.635701 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:37.635701 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:37.635701 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:37.635701 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 19:15:37.635701 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 19:15:37.635701 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 19:15:37.636761 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 19:15:37.636761 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:37.636761 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:37.636761 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:37.636761 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:37.636761 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:37.636761 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:37.636761 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:37.636761 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:37.636761 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:37.636761 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:37.636761 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:37.636761 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:37.636761 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:37.636761 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:37.636761 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:37.636761 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:37.637667 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 19:15:37.637667 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 19:15:37.637667 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 19:15:37.637667 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 19:15:37.637667 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 19:15:37.637667 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 19:15:37.637667 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:15:37.637667 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:37.638276 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 344/693] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:15:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:37.644274 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f689bd-ca91-4729-bd47-fcbc25afc0ea None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:37.689046 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050e873-12b3-46df-b026-0674e0bd6ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:37.689961 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050e873-12b3-46df-b026-0674e0bd6ded None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:37.690246 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050e873-12b3-46df-b026-0674e0bd6ded None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:37.690522 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050e873-12b3-46df-b026-0674e0bd6ded None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:37.691245 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0050e873-12b3-46df-b026-0674e0bd6ded None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:37.691575 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0050e873-12b3-46df-b026-0674e0bd6ded None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:37.692952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0050e873-12b3-46df-b026-0674e0bd6ded None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:37.707906 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 350/694] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:37.714290 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050e873-12b3-46df-b026-0674e0bd6ded None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:37.807485 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:37.831859 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050e873-12b3-46df-b026-0674e0bd6ded None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:37.873702 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc2dff-4e20-45d1-82e5-dedde1ec67a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:37.874542 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc2dff-4e20-45d1-82e5-dedde1ec67a6 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:37.874828 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc2dff-4e20-45d1-82e5-dedde1ec67a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:37.875102 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc2dff-4e20-45d1-82e5-dedde1ec67a6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:37.883643 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc2dff-4e20-45d1-82e5-dedde1ec67a6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:37.885406 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc2dff-4e20-45d1-82e5-dedde1ec67a6 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:37.902173 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-00bc2dff-4e20-45d1-82e5-dedde1ec67a6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 19:15:37.902173 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:37.902173 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:37.902173 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:37.902173 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:37.902173 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:37.902173 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:37.902173 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:37.902173 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:37.902173 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:37.902173 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:37.902173 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:37.902173 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 19:15:37.902173 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 19:15:37.902173 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 19:15:37.902173 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 19:15:37.903154 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:37.903154 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:37.903154 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 19:15:37.903154 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:15:37.903154 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 19:15:37.903154 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:15:37.903154 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:37.903154 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:37.903154 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:37.903154 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:37.903154 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:37.903154 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:37.903154 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:37.903154 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:37.903154 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:37.903154 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:37.903154 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:37.903154 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:37.904143 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:37.904143 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:37.904143 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 19:15:37.904143 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 19:15:37.904143 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 19:15:37.904143 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 19:15:37.904143 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 19:15:37.904143 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 19:15:37.904143 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 19:15:37.904143 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:37.907959 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 351/695] 10.222.0.60 () {56 vars in 1093 bytes} [Thu Jul 21 19:15:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:37.909262 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc2dff-4e20-45d1-82e5-dedde1ec67a6 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:37.933397 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f689bd-ca91-4729-bd47-fcbc25afc0ea None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:37.979989 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dce09b-bff4-44c8-8594-2eed89321dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:37.980655 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dce09b-bff4-44c8-8594-2eed89321dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:37.980944 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dce09b-bff4-44c8-8594-2eed89321dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:37.981226 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dce09b-bff4-44c8-8594-2eed89321dd6 None admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:37.982024 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dce09b-bff4-44c8-8594-2eed89321dd6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:37.982335 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dce09b-bff4-44c8-8594-2eed89321dd6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:37.983781 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dce09b-bff4-44c8-8594-2eed89321dd6 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:37.995931 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 345/696] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Jul 21 19:15:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:38.002010 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dce09b-bff4-44c8-8594-2eed89321dd6 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:38.019378 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc2dff-4e20-45d1-82e5-dedde1ec67a6 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:38.043359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:38.058313 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e29d6-2649-46e5-9865-f371fa3936b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:38.058981 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e29d6-2649-46e5-9865-f371fa3936b3 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:38.059267 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e29d6-2649-46e5-9865-f371fa3936b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:38.059569 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e29d6-2649-46e5-9865-f371fa3936b3 None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:38.060404 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e29d6-2649-46e5-9865-f371fa3936b3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:38.060713 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e29d6-2649-46e5-9865-f371fa3936b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:38.062199 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e29d6-2649-46e5-9865-f371fa3936b3 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:38.071345 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:38.081228 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 352/697] 10.222.0.60 () {56 vars in 1133 bytes} [Thu Jul 21 19:15:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:38.085030 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2dc5a2-25e7-40b8-a8a8-7dd0e7515b68 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:38.085030 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2dc5a2-25e7-40b8-a8a8-7dd0e7515b68 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:38.088052 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2dc5a2-25e7-40b8-a8a8-7dd0e7515b68 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:38.089641 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 353/698] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:38.090377 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2dc5a2-25e7-40b8-a8a8-7dd0e7515b68 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:38.106415 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dce09b-bff4-44c8-8594-2eed89321dd6 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:38.142684 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb263091-d0c0-420c-9022-62185703fa42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:38.143348 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb263091-d0c0-420c-9022-62185703fa42 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:38.143665 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb263091-d0c0-420c-9022-62185703fa42 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:38.143948 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb263091-d0c0-420c-9022-62185703fa42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:38.144787 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb263091-d0c0-420c-9022-62185703fa42 None admin] RBAC: Adding query filter params (role.id=beeebaa4e16c40f387f05b67124a424d, scope.project.id=9847b5e8bc0b4483bbce060a48f405f4, user.id=0aa579af53a6441a9205cf82864a640e) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:38.145102 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb263091-d0c0-420c-9022-62185703fa42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:38.147088 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb263091-d0c0-420c-9022-62185703fa42 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:38.154684 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 346/699] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:15:38 2022] GET /identity/v3/role_assignments?user.id=0aa579af53a6441a9205cf82864a640e&scope.project.id=9847b5e8bc0b4483bbce060a48f405f4&role.id=beeebaa4e16c40f387f05b67124a424d => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:15:38.154933 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740ca7d-1e6a-4c4e-aa07-f34e6cf73af6 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:38.155096 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740ca7d-1e6a-4c4e-aa07-f34e6cf73af6 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:38.155345 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740ca7d-1e6a-4c4e-aa07-f34e6cf73af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:38.196667 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-a740ca7d-1e6a-4c4e-aa07-f34e6cf73af6 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:38.197921 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-a740ca7d-1e6a-4c4e-aa07-f34e6cf73af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:38.213995 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2dc5a2-25e7-40b8-a8a8-7dd0e7515b68 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:38.259172 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe508eb-fa74-4298-972d-feadb396187b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:38.260409 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe508eb-fa74-4298-972d-feadb396187b None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:38.260935 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe508eb-fa74-4298-972d-feadb396187b None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:38.261419 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe508eb-fa74-4298-972d-feadb396187b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:38.335988 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:38.339501 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 347/700] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:15:38.348615 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe508eb-fa74-4298-972d-feadb396187b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:38.354356 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe508eb-fa74-4298-972d-feadb396187b None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:38.380387 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740ca7d-1e6a-4c4e-aa07-f34e6cf73af6 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:38.444980 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:38.486940 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 354/701] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:15:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 19:15:38.493212 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe508eb-fa74-4298-972d-feadb396187b None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:38.535969 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740ca7d-1e6a-4c4e-aa07-f34e6cf73af6 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:38.578389 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66d6d9-277a-491b-9598-4a8d9dc08196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:38.580057 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66d6d9-277a-491b-9598-4a8d9dc08196 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:38.580549 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66d6d9-277a-491b-9598-4a8d9dc08196 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:38.581074 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66d6d9-277a-491b-9598-4a8d9dc08196 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:38.592803 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d66d6d9-277a-491b-9598-4a8d9dc08196 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:38.594524 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d66d6d9-277a-491b-9598-4a8d9dc08196 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:38.611935 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:38.613831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-9d66d6d9-277a-491b-9598-4a8d9dc08196 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:38.613831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:38.613831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:38.613831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:38.613831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:38.613831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:38.613831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:38.613831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:38.613831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:38.613831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:38.613831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:38.613831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:38.613831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:38.613831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:38.613831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:38.614733 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:38.614733 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:38.614733 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:38.614733 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:38.614733 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:38.614733 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:38.614733 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:38.614733 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:38.614733 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:38.614733 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:38.614733 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:38.614733 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:38.614733 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:38.614733 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:38.614733 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:38.614733 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:38.614733 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:38.616536 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:38.616536 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:38.616536 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:38.616536 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:38.618928 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 348/702] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:15:38.619383 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe508eb-fa74-4298-972d-feadb396187b None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:38.624319 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66d6d9-277a-491b-9598-4a8d9dc08196 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:38.656469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c074f6a-ce94-4e34-8a33-fdff346da11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:38.657277 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c074f6a-ce94-4e34-8a33-fdff346da11f None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:38.657569 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c074f6a-ce94-4e34-8a33-fdff346da11f None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:38.657899 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c074f6a-ce94-4e34-8a33-fdff346da11f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:38.668576 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c074f6a-ce94-4e34-8a33-fdff346da11f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:38.670087 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c074f6a-ce94-4e34-8a33-fdff346da11f None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:38.690988 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-0c074f6a-ce94-4e34-8a33-fdff346da11f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:38.690988 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:38.690988 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:38.690988 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:38.690988 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:38.690988 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:38.690988 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:38.690988 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:38.690988 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:38.690988 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:38.690988 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:38.690988 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:38.690988 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:38.690988 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:38.690988 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:38.691971 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:38.691971 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:38.691971 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:38.691971 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:38.691971 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:38.691971 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:38.691971 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:38.691971 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:38.691971 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:38.691971 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:38.691971 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:38.691971 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:38.691971 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:38.691971 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:38.691971 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:38.691971 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:38.691971 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:38.693295 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:38.693295 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:38.693295 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:38.693295 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:38.693295 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 355/703] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:15:38.698621 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c074f6a-ce94-4e34-8a33-fdff346da11f None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:38.721188 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:38.745766 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66d6d9-277a-491b-9598-4a8d9dc08196 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:38.830503 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d95920-58b3-4446-a440-cf24b85c0d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:38.831448 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d95920-58b3-4446-a440-cf24b85c0d6f None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:38.831911 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d95920-58b3-4446-a440-cf24b85c0d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:38.832340 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d95920-58b3-4446-a440-cf24b85c0d6f None admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:38.833209 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d95920-58b3-4446-a440-cf24b85c0d6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:38.833664 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d95920-58b3-4446-a440-cf24b85c0d6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:38.835879 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d95920-58b3-4446-a440-cf24b85c0d6f None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:38.859684 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 349/704] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:15:38.868561 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d95920-58b3-4446-a440-cf24b85c0d6f None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:38.901118 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c074f6a-ce94-4e34-8a33-fdff346da11f None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:38.986179 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33fd74-075c-49ae-a6d1-40d29a23ce34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:38.986853 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33fd74-075c-49ae-a6d1-40d29a23ce34 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:38.987136 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33fd74-075c-49ae-a6d1-40d29a23ce34 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:38.987415 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33fd74-075c-49ae-a6d1-40d29a23ce34 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:38.988168 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33fd74-075c-49ae-a6d1-40d29a23ce34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:38.988471 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33fd74-075c-49ae-a6d1-40d29a23ce34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:38.989851 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33fd74-075c-49ae-a6d1-40d29a23ce34 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:39.004063 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 356/705] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:15:39.012698 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33fd74-075c-49ae-a6d1-40d29a23ce34 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:39.035799 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:39.041772 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d95920-58b3-4446-a440-cf24b85c0d6f None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:39.117841 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab126a0-b7d9-4012-b3d3-d66eaa956eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:39.119034 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab126a0-b7d9-4012-b3d3-d66eaa956eec None admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:39.120335 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab126a0-b7d9-4012-b3d3-d66eaa956eec None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:39.121389 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab126a0-b7d9-4012-b3d3-d66eaa956eec None admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:39.122308 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab126a0-b7d9-4012-b3d3-d66eaa956eec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:39.124158 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab126a0-b7d9-4012-b3d3-d66eaa956eec None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:39.174752 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33fd74-075c-49ae-a6d1-40d29a23ce34 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:39.212566 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f4907b-b3d3-4d42-9e05-b6dd35619eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:39.213703 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4907b-b3d3-4d42-9e05-b6dd35619eca None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:39.214198 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4907b-b3d3-4d42-9e05-b6dd35619eca None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:39.214724 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4907b-b3d3-4d42-9e05-b6dd35619eca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:39.222051 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:39.227199 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 350/706] 10.222.0.60 () {60 vars in 1132 bytes} [Thu Jul 21 19:15:38 2022] POST /identity/v3/users => generated 254 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:15:39.229830 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f4907b-b3d3-4d42-9e05-b6dd35619eca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:39.231570 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f4907b-b3d3-4d42-9e05-b6dd35619eca None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:39.249106 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-95f4907b-b3d3-4d42-9e05-b6dd35619eca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:15:39.249106 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:39.249106 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:39.249106 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:39.249106 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:39.249106 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:39.249106 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:39.249106 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:39.249106 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:39.249106 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:39.249106 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:39.249106 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:39.249106 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 19:15:39.249106 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 19:15:39.249106 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 19:15:39.250105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 19:15:39.250105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:39.250105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:39.250105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:39.250105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:39.250105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:39.250105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:39.250105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:39.250105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:39.250105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:39.250105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:39.250105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:39.250105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:39.250105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:39.250105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:39.250105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:39.250105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:39.251038 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 19:15:39.251038 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 19:15:39.251038 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 19:15:39.251038 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 19:15:39.251038 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 19:15:39.251038 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 19:15:39.251038 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:15:39.251038 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:39.253823 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 357/707] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:15:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:39.259936 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab126a0-b7d9-4012-b3d3-d66eaa956eec None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:39.268463 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a68f3-6e11-4619-9c2e-55747f8d70fb None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:39.269458 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a68f3-6e11-4619-9c2e-55747f8d70fb None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:39.269458 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a68f3-6e11-4619-9c2e-55747f8d70fb None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:39.270692 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 358/708] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:39.276400 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ca66c-d9a1-4793-ae96-7f46f22379c3 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:39.276740 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ca66c-d9a1-4793-ae96-7f46f22379c3 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:39.276967 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ca66c-d9a1-4793-ae96-7f46f22379c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:39.302278 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-7c4ca66c-d9a1-4793-ae96-7f46f22379c3 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:39.308306 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-7c4ca66c-d9a1-4793-ae96-7f46f22379c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:39.431909 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:39.437626 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 359/709] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 19:15:39.440767 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2f5ae-63c2-4849-81cb-5340f4969525 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:39.440767 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2f5ae-63c2-4849-81cb-5340f4969525 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:39.440767 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2f5ae-63c2-4849-81cb-5340f4969525 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:39.441001 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 360/710] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:39.446811 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d0c2b-b0c1-4896-a364-1fd3b7975597 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:39.447157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d0c2b-b0c1-4896-a364-1fd3b7975597 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:39.447463 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d0c2b-b0c1-4896-a364-1fd3b7975597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:39.460892 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab126a0-b7d9-4012-b3d3-d66eaa956eec None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:39.468697 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-dc6d0c2b-b0c1-4896-a364-1fd3b7975597 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:39.470373 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-dc6d0c2b-b0c1-4896-a364-1fd3b7975597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:39.503266 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9f220-1999-494f-b7da-15138804b7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:39.504268 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9f220-1999-494f-b7da-15138804b7b1 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:39.504695 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9f220-1999-494f-b7da-15138804b7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:39.505115 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9f220-1999-494f-b7da-15138804b7b1 None admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:39.506920 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9f220-1999-494f-b7da-15138804b7b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:39.507282 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9f220-1999-494f-b7da-15138804b7b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:39.508835 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9f220-1999-494f-b7da-15138804b7b1 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:39.521447 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 351/711] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Jul 21 19:15:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:39.522284 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9f220-1999-494f-b7da-15138804b7b1 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:39.553646 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 361/712] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 19:15:39.554605 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d0c2b-b0c1-4896-a364-1fd3b7975597 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:39.594034 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:39.650950 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9f220-1999-494f-b7da-15138804b7b1 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:39.664146 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d0c2b-b0c1-4896-a364-1fd3b7975597 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:39.693088 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:39.700108 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9065d8-7ccf-4c9c-aa59-51b16bd16b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:39.701200 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc129da-95f2-4c16-a22c-627db38e2a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:39.701534 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9065d8-7ccf-4c9c-aa59-51b16bd16b7b None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:39.702042 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc129da-95f2-4c16-a22c-627db38e2a7a None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:39.702304 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9065d8-7ccf-4c9c-aa59-51b16bd16b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:39.710058 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc129da-95f2-4c16-a22c-627db38e2a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:39.710058 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc129da-95f2-4c16-a22c-627db38e2a7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:39.710249 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9065d8-7ccf-4c9c-aa59-51b16bd16b7b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:39.710249 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9065d8-7ccf-4c9c-aa59-51b16bd16b7b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:39.710377 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc129da-95f2-4c16-a22c-627db38e2a7a None admin] RBAC: Adding query filter params (role.id=685e18230e1744c581baaf842d0fd4ca, scope.project.id=9847b5e8bc0b4483bbce060a48f405f4, user.id=6b4d98e967814e5f84f5f0d67ebb3c17) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:39.710377 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc129da-95f2-4c16-a22c-627db38e2a7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:39.710513 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9065d8-7ccf-4c9c-aa59-51b16bd16b7b None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:39.710581 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc129da-95f2-4c16-a22c-627db38e2a7a None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:39.719463 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 362/713] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:15:39 2022] GET /identity/v3/role_assignments?user.id=6b4d98e967814e5f84f5f0d67ebb3c17&scope.project.id=9847b5e8bc0b4483bbce060a48f405f4&role.id=685e18230e1744c581baaf842d0fd4ca => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:39.719463 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc129da-95f2-4c16-a22c-627db38e2a7a None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:39.740032 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-1f9065d8-7ccf-4c9c-aa59-51b16bd16b7b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 19:15:39.740032 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:39.740032 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 19:15:39.740032 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 19:15:39.740032 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 19:15:39.740032 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 19:15:39.740032 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 19:15:39.740032 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:15:39.740032 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 19:15:39.740032 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:39.740032 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 19:15:39.740032 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:39.740032 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:39.740032 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:39.740032 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:39.740032 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:39.741590 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:39.741590 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:39.741590 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:39.741590 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:39.741590 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:39.741590 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:39.741590 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:39.741590 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 19:15:39.741590 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 19:15:39.741590 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 19:15:39.741590 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 19:15:39.741590 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:39.741590 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:39.741590 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:39.741590 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:39.741590 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:39.742418 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:39.742418 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:39.742418 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:39.742418 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:39.742418 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:39.742418 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:39.742418 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:39.742418 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:39.742418 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:39.742418 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:39.742418 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:39.742418 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 19:15:39.742418 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:15:39.742418 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 19:15:39.742418 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:39.745919 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 352/714] 10.222.0.60 () {56 vars in 1129 bytes} [Thu Jul 21 19:15:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:39.749186 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9065d8-7ccf-4c9c-aa59-51b16bd16b7b None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:39.929361 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc129da-95f2-4c16-a22c-627db38e2a7a None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:39.952300 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9065d8-7ccf-4c9c-aa59-51b16bd16b7b None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:39.991530 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:39.994964 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad481cdb-014a-46fc-a83a-bc17dfbe0907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:39.995806 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad481cdb-014a-46fc-a83a-bc17dfbe0907 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:39.996087 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad481cdb-014a-46fc-a83a-bc17dfbe0907 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:39.996359 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad481cdb-014a-46fc-a83a-bc17dfbe0907 None admin] PATH_INFO: `/v3/services/network` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:39.997014 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad481cdb-014a-46fc-a83a-bc17dfbe0907 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:39.998397 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad481cdb-014a-46fc-a83a-bc17dfbe0907 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:40.017169 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259fbc0-49e6-46c8-8a1b-ec14630437e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:40.017830 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259fbc0-49e6-46c8-8a1b-ec14630437e3 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:40.018113 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259fbc0-49e6-46c8-8a1b-ec14630437e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:40.018390 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259fbc0-49e6-46c8-8a1b-ec14630437e3 None admin] PATH_INFO: `/v3/services` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:40.019095 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259fbc0-49e6-46c8-8a1b-ec14630437e3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:40.019403 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259fbc0-49e6-46c8-8a1b-ec14630437e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:40.024086 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-ad481cdb-014a-46fc-a83a-bc17dfbe0907 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 19:15:40.024086 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:40.024086 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 19:15:40.024086 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 19:15:40.024086 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 19:15:40.024086 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 19:15:40.024086 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 19:15:40.024086 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:15:40.024086 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 19:15:40.024086 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:40.024086 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 19:15:40.024086 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:40.024086 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:40.024086 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:40.024086 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:40.024086 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:40.024086 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:40.025081 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:40.025081 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:40.025081 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:40.025081 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:40.025081 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:40.025081 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:40.025081 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 19:15:40.025081 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 19:15:40.025081 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 19:15:40.025081 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 19:15:40.025081 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:40.025081 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:40.025081 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:40.025081 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:40.025081 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:40.025081 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:40.025967 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:40.025967 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:40.025967 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:40.025967 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:40.025967 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:40.025967 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:40.025967 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:40.025967 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:40.025967 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:40.025967 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:40.025967 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 19:15:40.025967 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:15:40.025967 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 19:15:40.025967 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:40.026726 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259fbc0-49e6-46c8-8a1b-ec14630437e3 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:40.027707 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 363/715] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:15:39 2022] GET /identity/v3/services/network => generated 88 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:40.031469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad481cdb-014a-46fc-a83a-bc17dfbe0907 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:40.034227 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 353/716] 10.222.0.60 () {56 vars in 1124 bytes} [Thu Jul 21 19:15:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:15:40.039862 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259fbc0-49e6-46c8-8a1b-ec14630437e3 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:40.136182 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:40.203311 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad481cdb-014a-46fc-a83a-bc17dfbe0907 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:40.229032 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259fbc0-49e6-46c8-8a1b-ec14630437e3 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:40.298383 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9960d-fa7e-491c-bbc1-494f2b761777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:40.300389 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9960d-fa7e-491c-bbc1-494f2b761777 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:40.300876 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9960d-fa7e-491c-bbc1-494f2b761777 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:40.301561 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9960d-fa7e-491c-bbc1-494f2b761777 None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:40.303997 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f9960d-fa7e-491c-bbc1-494f2b761777 None admin] RBAC: Adding query filter params (name=network) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:40.304520 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f9960d-fa7e-491c-bbc1-494f2b761777 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:40.306123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f9960d-fa7e-491c-bbc1-494f2b761777 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:40.314597 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 364/717] 10.222.0.60 () {56 vars in 1112 bytes} [Thu Jul 21 19:15:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:40.320980 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9960d-fa7e-491c-bbc1-494f2b761777 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:40.337072 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc611b4-bc62-4cd6-95df-b9ca3c22591c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:40.337754 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc611b4-bc62-4cd6-95df-b9ca3c22591c None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:40.338033 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc611b4-bc62-4cd6-95df-b9ca3c22591c None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:40.338310 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc611b4-bc62-4cd6-95df-b9ca3c22591c None admin] PATH_INFO: `/v3/services` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:40.339030 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc611b4-bc62-4cd6-95df-b9ca3c22591c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:40.339338 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc611b4-bc62-4cd6-95df-b9ca3c22591c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:40.340757 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc611b4-bc62-4cd6-95df-b9ca3c22591c None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:40.349341 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 354/718] 10.222.0.60 () {56 vars in 1124 bytes} [Thu Jul 21 19:15:40 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:40.478229 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9960d-fa7e-491c-bbc1-494f2b761777 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:40.517695 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:40.527087 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08400f9b-cef1-4153-b498-3a8339f0ddae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:40.527794 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08400f9b-cef1-4153-b498-3a8339f0ddae None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:40.528078 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08400f9b-cef1-4153-b498-3a8339f0ddae None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:40.528355 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08400f9b-cef1-4153-b498-3a8339f0ddae None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:40.529074 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08400f9b-cef1-4153-b498-3a8339f0ddae None admin] RBAC: Adding query filter params (type=network) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:40.529383 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08400f9b-cef1-4153-b498-3a8339f0ddae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:40.530796 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08400f9b-cef1-4153-b498-3a8339f0ddae None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:40.540237 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 365/719] 10.222.0.60 () {56 vars in 1112 bytes} [Thu Jul 21 19:15:40 2022] GET /identity/v3/services?type=network => generated 124 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:15:40.915895 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa9a08-9342-467c-851f-018f19389eaa None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:40.916441 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa9a08-9342-467c-851f-018f19389eaa None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:40.916441 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa9a08-9342-467c-851f-018f19389eaa None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:40.918158 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 355/720] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:40.923608 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05740af-ebee-4e9b-9f51-978327777458 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:40.924007 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05740af-ebee-4e9b-9f51-978327777458 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:40.924173 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05740af-ebee-4e9b-9f51-978327777458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:40.948489 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-f05740af-ebee-4e9b-9f51-978327777458 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:40.949694 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f05740af-ebee-4e9b-9f51-978327777458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:41.034861 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 366/721] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:15:41.072971 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa9a08-9342-467c-851f-018f19389eaa None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:41.159346 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:41.223952 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa9a08-9342-467c-851f-018f19389eaa None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:41.270310 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62645dda-3863-49bf-b142-5fa9ba25ba68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:41.271117 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62645dda-3863-49bf-b142-5fa9ba25ba68 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:41.271622 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62645dda-3863-49bf-b142-5fa9ba25ba68 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:41.271999 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62645dda-3863-49bf-b142-5fa9ba25ba68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:41.290415 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62645dda-3863-49bf-b142-5fa9ba25ba68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:15:41.298264 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-62645dda-3863-49bf-b142-5fa9ba25ba68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:15:41.298264 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:41.298264 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:41.298264 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:41.298264 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:41.298264 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:41.298264 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:41.298264 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:41.298264 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:41.298264 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:41.298264 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:41.298264 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:41.298264 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:15:41.298264 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:15:41.298264 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:15:41.298264 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:15:41.299171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:15:41.299171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:15:41.299171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:15:41.299171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:15:41.299171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:41.299171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:41.299171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:41.299171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:41.299171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:41.299171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:41.299171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:41.299171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:41.299171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:41.299171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:41.299171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:41.299171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:41.300048 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:41.300048 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:41.300048 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:41.300048 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:41.300048 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:15:41.300048 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:15:41.300048 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:15:41.300048 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:15:41.300048 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:15:41.300048 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:15:41.300048 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:15:41.300048 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:41.303540 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 356/722] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Jul 21 19:15:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:41.308512 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05740af-ebee-4e9b-9f51-978327777458 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:41.436021 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05740af-ebee-4e9b-9f51-978327777458 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:41.470190 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:41.471686 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1eb6c-a694-4a05-bfee-347144f22f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:41.472277 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1eb6c-a694-4a05-bfee-347144f22f5e None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:41.472626 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1eb6c-a694-4a05-bfee-347144f22f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:41.473164 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1eb6c-a694-4a05-bfee-347144f22f5e None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:41.473906 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff1eb6c-a694-4a05-bfee-347144f22f5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:41.474262 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff1eb6c-a694-4a05-bfee-347144f22f5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:41.475647 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff1eb6c-a694-4a05-bfee-347144f22f5e None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:41.484357 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 367/723] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:15:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:41.492504 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62645dda-3863-49bf-b142-5fa9ba25ba68 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:41.614336 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62645dda-3863-49bf-b142-5fa9ba25ba68 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:41.628243 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:41.649840 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b3c5f-6b7b-478f-a91a-86278ecd02da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:41.650644 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b3c5f-6b7b-478f-a91a-86278ecd02da None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:41.650930 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b3c5f-6b7b-478f-a91a-86278ecd02da None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:41.651206 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b3c5f-6b7b-478f-a91a-86278ecd02da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:41.662651 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b3c5f-6b7b-478f-a91a-86278ecd02da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:41.664093 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b3c5f-6b7b-478f-a91a-86278ecd02da None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:41.682408 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-da3b3c5f-6b7b-478f-a91a-86278ecd02da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:41.682408 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:41.682408 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:41.682408 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:41.682408 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:41.682408 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:41.682408 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:41.682408 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:41.682408 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:41.682408 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:41.682408 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:41.682408 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:41.682408 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:41.682408 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:41.682408 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:41.683373 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:41.683373 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:41.683373 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:41.683373 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:41.683373 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:41.683373 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:41.683373 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:41.683373 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:41.683373 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:41.683373 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:41.683373 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:41.683373 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:41.683373 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:41.683373 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:41.683373 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:41.683373 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:41.683373 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:41.684506 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:41.684506 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:41.684506 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:41.684506 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:41.684506 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 357/724] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:41.690813 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1eb6c-a694-4a05-bfee-347144f22f5e None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:41.725056 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be71a0b-6848-4bec-b043-6c0bab15ae74 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:41.725447 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be71a0b-6848-4bec-b043-6c0bab15ae74 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:41.725733 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be71a0b-6848-4bec-b043-6c0bab15ae74 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:41.727099 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 358/725] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:41.733989 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b131d2-a741-450f-89b5-68afb7e8bda4 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:41.734499 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b131d2-a741-450f-89b5-68afb7e8bda4 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:41.734929 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b131d2-a741-450f-89b5-68afb7e8bda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:41.752783 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-f9b131d2-a741-450f-89b5-68afb7e8bda4 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:41.754197 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-f9b131d2-a741-450f-89b5-68afb7e8bda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:41.830073 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 359/726] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 19:15:41.838446 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1eb6c-a694-4a05-bfee-347144f22f5e None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:41.868983 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b131d2-a741-450f-89b5-68afb7e8bda4 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:41.882859 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244037db-68eb-4b5f-a215-47f755b5b41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:41.883553 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244037db-68eb-4b5f-a215-47f755b5b41a None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:41.883840 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244037db-68eb-4b5f-a215-47f755b5b41a None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:41.884118 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244037db-68eb-4b5f-a215-47f755b5b41a None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:41.884843 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244037db-68eb-4b5f-a215-47f755b5b41a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:41.885143 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244037db-68eb-4b5f-a215-47f755b5b41a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:41.886747 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244037db-68eb-4b5f-a215-47f755b5b41a None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:41.904782 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 368/727] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:15:41.910542 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244037db-68eb-4b5f-a215-47f755b5b41a None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:41.960886 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:41.973486 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:41.988038 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b131d2-a741-450f-89b5-68afb7e8bda4 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:42.018216 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240a055-3758-4198-9fed-9db80892ae5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:42.019246 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240a055-3758-4198-9fed-9db80892ae5b None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:42.019705 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240a055-3758-4198-9fed-9db80892ae5b None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:42.020131 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240a055-3758-4198-9fed-9db80892ae5b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:42.031404 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8240a055-3758-4198-9fed-9db80892ae5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:15:42.041538 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-8240a055-3758-4198-9fed-9db80892ae5b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 19:15:42.041538 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:42.041538 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:42.041538 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:42.041538 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:42.041538 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:42.041538 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:42.041538 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:42.041538 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:42.041538 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:42.041538 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:42.041538 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:42.041538 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:15:42.041538 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:15:42.041538 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:15:42.041538 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:15:42.042716 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:15:42.042716 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:15:42.042716 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:15:42.042716 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:15:42.042716 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:42.042716 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:42.042716 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:42.042716 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:42.042716 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:42.042716 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:42.042716 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:42.042716 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:42.042716 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:42.042716 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:42.042716 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:42.042716 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:42.043734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:42.043734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:42.043734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:42.043734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:42.043734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:15:42.043734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:15:42.043734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:15:42.043734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:15:42.043734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:15:42.043734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:15:42.043734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 19:15:42.043734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:42.045939 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 360/728] 10.222.0.60 () {56 vars in 1102 bytes} [Thu Jul 21 19:15:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:15:42.051712 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240a055-3758-4198-9fed-9db80892ae5b None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:42.065292 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244037db-68eb-4b5f-a215-47f755b5b41a None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:42.157344 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240a055-3758-4198-9fed-9db80892ae5b None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:42.174507 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b92151-54b8-412c-816e-9451dfe2987c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:42.175337 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b92151-54b8-412c-816e-9451dfe2987c None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:42.175620 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b92151-54b8-412c-816e-9451dfe2987c None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:42.175906 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b92151-54b8-412c-816e-9451dfe2987c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:42.192557 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b92151-54b8-412c-816e-9451dfe2987c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:42.194698 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b92151-54b8-412c-816e-9451dfe2987c None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:42.197203 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f8380-c300-4b85-81a0-b5fb01362298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:42.198132 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f8380-c300-4b85-81a0-b5fb01362298 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:42.198620 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f8380-c300-4b85-81a0-b5fb01362298 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:42.199095 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f8380-c300-4b85-81a0-b5fb01362298 None admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:42.200070 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f8380-c300-4b85-81a0-b5fb01362298 None admin] RBAC: Adding query filter params (name=service) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:42.200580 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f8380-c300-4b85-81a0-b5fb01362298 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:42.202149 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f8380-c300-4b85-81a0-b5fb01362298 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:42.212161 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 361/729] 10.222.0.60 () {56 vars in 1103 bytes} [Thu Jul 21 19:15:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:15:42.217834 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f8380-c300-4b85-81a0-b5fb01362298 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:42.228439 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-e9b92151-54b8-412c-816e-9451dfe2987c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 19:15:42.228439 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:42.228439 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:42.228439 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:42.228439 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:42.228439 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:42.228439 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:42.228439 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:42.228439 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:42.228439 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:42.228439 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:42.228439 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:42.228439 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 19:15:42.228439 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 19:15:42.228439 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 19:15:42.228439 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 19:15:42.229408 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:42.229408 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:42.229408 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 19:15:42.229408 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:15:42.229408 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 19:15:42.229408 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:15:42.229408 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:42.229408 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:42.229408 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:42.229408 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:42.229408 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:42.229408 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:42.229408 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:42.229408 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:42.229408 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:42.229408 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:42.229408 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:42.229408 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:42.230385 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:42.230385 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:42.230385 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 19:15:42.230385 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 19:15:42.230385 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 19:15:42.230385 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 19:15:42.230385 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 19:15:42.230385 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 19:15:42.230385 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 19:15:42.230385 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:42.235916 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 369/730] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Jul 21 19:15:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:42.241454 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:42.241583 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b92151-54b8-412c-816e-9451dfe2987c None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:42.338565 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f8380-c300-4b85-81a0-b5fb01362298 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:42.370214 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:42.378035 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b92151-54b8-412c-816e-9451dfe2987c None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:42.432668 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce04b04e-7881-4dae-934a-ddb0105d55e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:42.433695 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04b04e-7881-4dae-934a-ddb0105d55e5 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:42.434196 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04b04e-7881-4dae-934a-ddb0105d55e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:42.434675 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04b04e-7881-4dae-934a-ddb0105d55e5 None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:42.435783 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce04b04e-7881-4dae-934a-ddb0105d55e5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:42.436360 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce04b04e-7881-4dae-934a-ddb0105d55e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:42.438053 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce04b04e-7881-4dae-934a-ddb0105d55e5 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:42.460555 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 370/731] 10.222.0.60 () {56 vars in 1135 bytes} [Thu Jul 21 19:15:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:15:42.462271 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032e590-c759-4292-8c86-8c4c65cfcfb3 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:42.462765 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032e590-c759-4292-8c86-8c4c65cfcfb3 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:42.463269 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032e590-c759-4292-8c86-8c4c65cfcfb3 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:42.464973 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 371/732] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:42.472376 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032e590-c759-4292-8c86-8c4c65cfcfb3 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:42.493565 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15805f-71be-4601-8db9-533e45ea5c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:42.494291 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15805f-71be-4601-8db9-533e45ea5c39 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:42.494572 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15805f-71be-4601-8db9-533e45ea5c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:42.494846 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15805f-71be-4601-8db9-533e45ea5c39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:42.506323 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15805f-71be-4601-8db9-533e45ea5c39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:42.508158 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15805f-71be-4601-8db9-533e45ea5c39 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:42.527407 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-5a15805f-71be-4601-8db9-533e45ea5c39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:42.527407 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:42.527407 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:42.527407 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:42.527407 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:42.527407 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:42.527407 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:42.527407 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:42.527407 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:42.527407 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:42.527407 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:42.527407 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:42.527407 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:42.527407 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:42.527407 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:42.528359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:42.528359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:42.528359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:42.528359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:42.528359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:42.528359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:42.528359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:42.528359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:42.528359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:42.528359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:42.528359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:42.528359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:42.528359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:42.528359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:42.528359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:42.528359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:42.528359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:42.529249 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:42.529249 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:42.529249 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:42.529249 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:42.533204 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 362/733] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:15:42.534656 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8848aef-8376-4730-a613-0ed269efcbdf None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:42.534953 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8848aef-8376-4730-a613-0ed269efcbdf None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:42.535234 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8848aef-8376-4730-a613-0ed269efcbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:42.555170 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-e8848aef-8376-4730-a613-0ed269efcbdf None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:42.556497 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-e8848aef-8376-4730-a613-0ed269efcbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:42.598893 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032e590-c759-4292-8c86-8c4c65cfcfb3 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:42.637398 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58aa3c0-7eab-4779-b12a-19a8e641ac69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:42.638372 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58aa3c0-7eab-4779-b12a-19a8e641ac69 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:42.638668 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58aa3c0-7eab-4779-b12a-19a8e641ac69 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:42.639000 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58aa3c0-7eab-4779-b12a-19a8e641ac69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:42.640166 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:42.652107 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 363/734] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:15:42.653201 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8848aef-8376-4730-a613-0ed269efcbdf None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:42.687861 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:42.735970 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58aa3c0-7eab-4779-b12a-19a8e641ac69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:42.739026 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58aa3c0-7eab-4779-b12a-19a8e641ac69 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:42.769694 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8848aef-8376-4730-a613-0ed269efcbdf None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:42.805011 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf52b6-287e-44e4-98b8-b4a5285024d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:42.805683 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf52b6-287e-44e4-98b8-b4a5285024d8 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:42.805966 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf52b6-287e-44e4-98b8-b4a5285024d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:42.806241 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf52b6-287e-44e4-98b8-b4a5285024d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:42.806966 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bf52b6-287e-44e4-98b8-b4a5285024d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:42.807405 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bf52b6-287e-44e4-98b8-b4a5285024d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:42.808727 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bf52b6-287e-44e4-98b8-b4a5285024d8 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:42.820856 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 364/735] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:42.825783 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf52b6-287e-44e4-98b8-b4a5285024d8 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:42.855190 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 372/736] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:15:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 19:15:42.856617 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8fada-4fac-4559-b215-5744555b2b1f None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:42.856913 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8fada-4fac-4559-b215-5744555b2b1f None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:42.857192 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8fada-4fac-4559-b215-5744555b2b1f None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:42.858580 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 373/737] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:42.859188 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8fada-4fac-4559-b215-5744555b2b1f None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:42.891831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:42.921849 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:42.934101 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf52b6-287e-44e4-98b8-b4a5285024d8 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:42.975517 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8fada-4fac-4559-b215-5744555b2b1f None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:42.977293 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f883e9-7c3c-4c86-80b5-2ebb4f8d75f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:42.978097 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f883e9-7c3c-4c86-80b5-2ebb4f8d75f4 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:42.978378 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f883e9-7c3c-4c86-80b5-2ebb4f8d75f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:42.978656 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f883e9-7c3c-4c86-80b5-2ebb4f8d75f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:42.988900 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f883e9-7c3c-4c86-80b5-2ebb4f8d75f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:15:42.997110 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-a4f883e9-7c3c-4c86-80b5-2ebb4f8d75f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:15:42.997110 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:42.997110 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:42.997110 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:42.997110 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:42.997110 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:42.997110 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:42.997110 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:42.997110 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:42.997110 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:42.997110 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:42.997110 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:42.997110 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:15:42.997110 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:15:42.997110 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:15:42.997110 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:15:42.998059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:15:42.998059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:15:42.998059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:15:42.998059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:15:42.998059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:42.998059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:42.998059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:42.998059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:42.998059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:42.998059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:42.998059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:42.998059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:42.998059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:42.998059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:42.998059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:42.998059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:42.998892 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:42.998892 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:42.998892 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:42.998892 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:42.998892 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:15:42.998892 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:15:42.998892 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:15:42.998892 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:15:42.998892 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:15:42.998892 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:15:42.998892 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:15:42.998892 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:42.998892 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 365/738] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Jul 21 19:15:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:42.999638 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f883e9-7c3c-4c86-80b5-2ebb4f8d75f4 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:43.018614 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f87ea-b0fa-4513-ab78-0775c24fd9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:43.019546 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f87ea-b0fa-4513-ab78-0775c24fd9d9 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:43.019892 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f87ea-b0fa-4513-ab78-0775c24fd9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:43.020114 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f87ea-b0fa-4513-ab78-0775c24fd9d9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:43.027565 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2f87ea-b0fa-4513-ab78-0775c24fd9d9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:43.029022 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2f87ea-b0fa-4513-ab78-0775c24fd9d9 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:43.044694 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-bc2f87ea-b0fa-4513-ab78-0775c24fd9d9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 19:15:43.044694 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:43.044694 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:43.044694 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:43.044694 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:43.044694 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:43.044694 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:43.044694 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:43.044694 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:43.044694 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:43.044694 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:43.044694 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:43.044694 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 19:15:43.044694 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 19:15:43.044694 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 19:15:43.044694 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 19:15:43.045860 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:43.045860 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:43.045860 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 19:15:43.045860 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:15:43.045860 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 19:15:43.045860 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:15:43.045860 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:43.045860 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:43.045860 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:43.045860 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:43.045860 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:43.045860 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:43.045860 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:43.045860 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:43.045860 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:43.045860 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:43.045860 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:43.045860 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:43.046806 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:43.046806 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:43.046806 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 19:15:43.046806 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 19:15:43.046806 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 19:15:43.046806 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 19:15:43.046806 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 19:15:43.046806 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 19:15:43.046806 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 19:15:43.046806 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:43.046806 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 374/739] 10.222.0.60 () {56 vars in 1117 bytes} [Thu Jul 21 19:15:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:43.047396 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e68c06-887c-4a60-9c7f-691dddbd38fe None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:43.047396 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e68c06-887c-4a60-9c7f-691dddbd38fe None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:43.048019 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e68c06-887c-4a60-9c7f-691dddbd38fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:43.064571 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-81e68c06-887c-4a60-9c7f-691dddbd38fe None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:43.065751 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-81e68c06-887c-4a60-9c7f-691dddbd38fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:43.106828 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f883e9-7c3c-4c86-80b5-2ebb4f8d75f4 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:43.127540 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:43.137445 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 375/740] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:15:43.143759 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e68c06-887c-4a60-9c7f-691dddbd38fe None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:43.150586 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9656d-86a6-43f1-82c1-57b20ec08dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:43.151539 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9656d-86a6-43f1-82c1-57b20ec08dee None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:43.151920 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9656d-86a6-43f1-82c1-57b20ec08dee None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:43.152289 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9656d-86a6-43f1-82c1-57b20ec08dee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:43.164911 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a9656d-86a6-43f1-82c1-57b20ec08dee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:43.166443 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a9656d-86a6-43f1-82c1-57b20ec08dee None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:43.185445 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-e0a9656d-86a6-43f1-82c1-57b20ec08dee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:43.185445 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:43.185445 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:43.185445 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:43.185445 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:43.185445 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:43.185445 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:43.185445 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:43.185445 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:43.185445 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:43.185445 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:43.185445 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:43.185445 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:43.185445 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:43.185445 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:43.186389 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:43.186389 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:43.186389 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:43.186389 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:43.186389 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:43.186389 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:43.186389 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:43.186389 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:43.186389 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:43.186389 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:43.186389 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:43.186389 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:43.186389 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:43.186389 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:43.186389 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:43.186389 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:43.186389 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:43.187308 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:43.187308 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:43.187308 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:43.187308 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:43.187308 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 366/741] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:43.188048 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9656d-86a6-43f1-82c1-57b20ec08dee None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:43.212450 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:43.268721 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e68c06-887c-4a60-9c7f-691dddbd38fe None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:43.300320 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9656d-86a6-43f1-82c1-57b20ec08dee None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:43.303634 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826a29a-a00b-4fca-a1a9-9665b69f825d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:43.304304 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826a29a-a00b-4fca-a1a9-9665b69f825d None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:43.304586 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826a29a-a00b-4fca-a1a9-9665b69f825d None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:43.304859 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826a29a-a00b-4fca-a1a9-9665b69f825d None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:43.305600 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a826a29a-a00b-4fca-a1a9-9665b69f825d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:43.305907 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a826a29a-a00b-4fca-a1a9-9665b69f825d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:43.307285 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a826a29a-a00b-4fca-a1a9-9665b69f825d None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:43.315288 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 376/742] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:15:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:43.316079 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826a29a-a00b-4fca-a1a9-9665b69f825d None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:43.338619 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd495e84-0bf0-46ea-9031-d988a10ae763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:43.339286 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd495e84-0bf0-46ea-9031-d988a10ae763 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:43.339595 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd495e84-0bf0-46ea-9031-d988a10ae763 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:43.339871 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd495e84-0bf0-46ea-9031-d988a10ae763 None admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:43.340701 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd495e84-0bf0-46ea-9031-d988a10ae763 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:43.341008 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd495e84-0bf0-46ea-9031-d988a10ae763 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:43.342523 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd495e84-0bf0-46ea-9031-d988a10ae763 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:43.359197 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 367/743] 10.222.0.60 () {56 vars in 1149 bytes} [Thu Jul 21 19:15:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:43.360002 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd495e84-0bf0-46ea-9031-d988a10ae763 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:43.388384 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:43.416758 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826a29a-a00b-4fca-a1a9-9665b69f825d None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:43.425310 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:43.452398 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861076a4-9130-4c46-bb24-04285ce61abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:43.453060 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861076a4-9130-4c46-bb24-04285ce61abb None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:43.453347 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861076a4-9130-4c46-bb24-04285ce61abb None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:43.453621 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861076a4-9130-4c46-bb24-04285ce61abb None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:43.454330 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861076a4-9130-4c46-bb24-04285ce61abb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:43.455735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861076a4-9130-4c46-bb24-04285ce61abb None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:43.462603 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd495e84-0bf0-46ea-9031-d988a10ae763 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:43.495990 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a5d18-ace9-4dc9-a477-966adaf3becd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:43.496655 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a5d18-ace9-4dc9-a477-966adaf3becd None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:43.496939 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a5d18-ace9-4dc9-a477-966adaf3becd None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:43.497215 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a5d18-ace9-4dc9-a477-966adaf3becd None admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:43.497924 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a5d18-ace9-4dc9-a477-966adaf3becd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:43.498228 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a5d18-ace9-4dc9-a477-966adaf3becd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:43.499619 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a5d18-ace9-4dc9-a477-966adaf3becd None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:43.510530 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 368/744] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:43.511821 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c71d4-576c-4fc0-8451-826bd28fc56a None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:43.512111 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c71d4-576c-4fc0-8451-826bd28fc56a None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:43.512404 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c71d4-576c-4fc0-8451-826bd28fc56a None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:43.513596 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 369/745] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:43.514285 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c71d4-576c-4fc0-8451-826bd28fc56a None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:43.540960 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 377/746] 10.222.0.60 () {60 vars in 1141 bytes} [Thu Jul 21 19:15:43 2022] POST /identity/v3/services => generated 251 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:15:43.541852 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861076a4-9130-4c46-bb24-04285ce61abb None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:43.626497 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:43.652976 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c71d4-576c-4fc0-8451-826bd28fc56a None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:43.665713 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861076a4-9130-4c46-bb24-04285ce61abb None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:43.692352 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76229e-378a-4e4f-9c7a-115e668adc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:43.692679 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76229e-378a-4e4f-9c7a-115e668adc89 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:43.693011 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76229e-378a-4e4f-9c7a-115e668adc89 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:43.693282 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76229e-378a-4e4f-9c7a-115e668adc89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:43.705801 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a76229e-378a-4e4f-9c7a-115e668adc89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:43.707261 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a76229e-378a-4e4f-9c7a-115e668adc89 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:43.710222 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a3eb4-b759-4366-a3ac-03aa77f328bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:43.711219 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a3eb4-b759-4366-a3ac-03aa77f328bb None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:43.711559 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a3eb4-b759-4366-a3ac-03aa77f328bb None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:43.711850 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a3eb4-b759-4366-a3ac-03aa77f328bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:43.726884 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-6a76229e-378a-4e4f-9c7a-115e668adc89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:43.726884 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:43.726884 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:43.726884 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:43.726884 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:43.726884 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:43.726884 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:43.726884 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:43.726884 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:43.726884 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:43.726884 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:43.726884 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:43.726884 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:43.726884 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:43.726884 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:43.727876 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:43.727876 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:43.727876 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:43.727876 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:43.727876 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:43.727876 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:43.727876 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:43.727876 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:43.727876 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:43.727876 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:43.727876 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:43.727876 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:43.727876 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:43.727876 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:43.727876 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:43.727876 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:43.727876 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:43.728752 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:43.728752 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:43.728752 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:43.728752 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:43.729391 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 370/747] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:43.730056 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76229e-378a-4e4f-9c7a-115e668adc89 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:43.754178 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:43.792564 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a3eb4-b759-4366-a3ac-03aa77f328bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:43.794022 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a3eb4-b759-4366-a3ac-03aa77f328bb None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:43.832602 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76229e-378a-4e4f-9c7a-115e668adc89 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:43.867056 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee6949-9515-428b-9d2b-4b73cafe2031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:43.867876 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee6949-9515-428b-9d2b-4b73cafe2031 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:43.868157 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee6949-9515-428b-9d2b-4b73cafe2031 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:43.868435 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee6949-9515-428b-9d2b-4b73cafe2031 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:43.871113 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:43.875487 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee6949-9515-428b-9d2b-4b73cafe2031 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:43.881919 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee6949-9515-428b-9d2b-4b73cafe2031 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:43.890668 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-b0ee6949-9515-428b-9d2b-4b73cafe2031 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:15:43.890668 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:43.890668 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:43.890668 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:43.890668 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:43.890668 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:43.890668 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:43.890668 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:43.890668 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:43.890668 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:43.890668 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:43.890668 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:43.890668 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 19:15:43.890668 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 19:15:43.890668 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 19:15:43.891607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 19:15:43.891607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:43.891607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:43.891607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:43.891607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:43.891607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:43.891607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:43.891607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:43.891607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:43.891607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:43.891607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:43.891607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:43.891607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:43.891607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:43.891607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:43.891607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:43.891607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:43.892543 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 19:15:43.892543 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 19:15:43.892543 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 19:15:43.892543 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 19:15:43.892543 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 19:15:43.892543 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 19:15:43.892543 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:15:43.892543 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:43.892543 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 371/748] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:15:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:43.893365 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a26f38-1839-4665-88eb-224a1f1104cb None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:43.893650 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a26f38-1839-4665-88eb-224a1f1104cb None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:43.893930 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a26f38-1839-4665-88eb-224a1f1104cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:43.911394 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-e9a26f38-1839-4665-88eb-224a1f1104cb None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:43.914364 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 378/749] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:15:43 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 19:15:43.914512 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-e9a26f38-1839-4665-88eb-224a1f1104cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:43.914624 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a3eb4-b759-4366-a3ac-03aa77f328bb None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:43.983619 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 372/750] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:43 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 19:15:43.984462 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a26f38-1839-4665-88eb-224a1f1104cb None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:43.986359 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:44.036316 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a3eb4-b759-4366-a3ac-03aa77f328bb None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:44.077656 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f40a8-f523-4598-ac4c-412b41e4b076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:44.078331 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f40a8-f523-4598-ac4c-412b41e4b076 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:44.078616 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f40a8-f523-4598-ac4c-412b41e4b076 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:44.078892 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f40a8-f523-4598-ac4c-412b41e4b076 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:44.080012 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f40a8-f523-4598-ac4c-412b41e4b076 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:44.080321 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f40a8-f523-4598-ac4c-412b41e4b076 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:44.082011 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f40a8-f523-4598-ac4c-412b41e4b076 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:44.098988 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 379/751] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:44.098988 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f40a8-f523-4598-ac4c-412b41e4b076 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:44.108286 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a26f38-1839-4665-88eb-224a1f1104cb None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:44.134568 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:44.142650 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0db6d8-98ae-4d94-b1b7-f2fcf6212004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:44.145004 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0db6d8-98ae-4d94-b1b7-f2fcf6212004 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:44.145004 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0db6d8-98ae-4d94-b1b7-f2fcf6212004 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:44.145004 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0db6d8-98ae-4d94-b1b7-f2fcf6212004 None admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:44.145004 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0db6d8-98ae-4d94-b1b7-f2fcf6212004 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:44.145004 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0db6d8-98ae-4d94-b1b7-f2fcf6212004 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:44.146987 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0db6d8-98ae-4d94-b1b7-f2fcf6212004 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:44.158477 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 373/752] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Jul 21 19:15:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:44.159259 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0db6d8-98ae-4d94-b1b7-f2fcf6212004 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:44.213076 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f40a8-f523-4598-ac4c-412b41e4b076 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:44.244413 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:44.253342 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bfa879-37e1-48d3-b55f-dc5ea9fa3da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:44.254555 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfa879-37e1-48d3-b55f-dc5ea9fa3da5 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:44.254841 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfa879-37e1-48d3-b55f-dc5ea9fa3da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:44.255264 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfa879-37e1-48d3-b55f-dc5ea9fa3da5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:44.266421 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0db6d8-98ae-4d94-b1b7-f2fcf6212004 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:44.266688 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bfa879-37e1-48d3-b55f-dc5ea9fa3da5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:44.268286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bfa879-37e1-48d3-b55f-dc5ea9fa3da5 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:44.285981 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-69bfa879-37e1-48d3-b55f-dc5ea9fa3da5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:44.285981 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:44.285981 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:44.285981 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:44.285981 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:44.285981 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:44.285981 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:44.285981 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:44.285981 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:44.285981 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:44.285981 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:44.285981 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:44.285981 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:44.285981 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:44.285981 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:44.287157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:44.287157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:44.287157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:44.287157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:44.287157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:44.287157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:44.287157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:44.287157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:44.287157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:44.287157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:44.287157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:44.287157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:44.287157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:44.287157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:44.287157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:44.287157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:44.287157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:44.288132 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:44.288132 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:44.288132 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:44.288132 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:44.295735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 380/753] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:44.296387 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bfa879-37e1-48d3-b55f-dc5ea9fa3da5 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:44.309151 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664dbae-58e8-4297-af00-cf3bb6c063fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:44.310139 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664dbae-58e8-4297-af00-cf3bb6c063fb None admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:44.310438 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664dbae-58e8-4297-af00-cf3bb6c063fb None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:44.310731 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664dbae-58e8-4297-af00-cf3bb6c063fb None admin] PATH_INFO: `/v3/services` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:44.311482 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7664dbae-58e8-4297-af00-cf3bb6c063fb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:44.312855 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7664dbae-58e8-4297-af00-cf3bb6c063fb None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:44.396680 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bfa879-37e1-48d3-b55f-dc5ea9fa3da5 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:44.411475 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 374/754] 10.222.0.60 () {60 vars in 1141 bytes} [Thu Jul 21 19:15:44 2022] POST /identity/v3/services => generated 240 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:15:44.412445 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664dbae-58e8-4297-af00-cf3bb6c063fb None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:44.467149 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08505f-3a9f-48e4-9abf-25e4a9ce6ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:44.468767 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08505f-3a9f-48e4-9abf-25e4a9ce6ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:44.469520 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08505f-3a9f-48e4-9abf-25e4a9ce6ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:44.470024 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08505f-3a9f-48e4-9abf-25e4a9ce6ef3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:44.472614 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:44.483761 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08505f-3a9f-48e4-9abf-25e4a9ce6ef3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:44.485276 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08505f-3a9f-48e4-9abf-25e4a9ce6ef3 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:44.508274 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-ed08505f-3a9f-48e4-9abf-25e4a9ce6ef3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 19:15:44.508274 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:44.508274 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:44.508274 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:44.508274 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:44.508274 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:44.508274 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:44.508274 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:44.508274 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:44.508274 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:44.508274 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:44.508274 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:44.508274 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 19:15:44.508274 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 19:15:44.508274 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 19:15:44.508274 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 19:15:44.509301 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:44.509301 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:44.509301 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 19:15:44.509301 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:15:44.509301 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 19:15:44.509301 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:15:44.509301 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:44.509301 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:44.509301 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:44.509301 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:44.509301 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:44.509301 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:44.509301 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:44.509301 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:44.509301 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:44.509301 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:44.509301 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:44.509301 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:44.510239 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:44.510239 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:44.510239 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 19:15:44.510239 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 19:15:44.510239 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 19:15:44.510239 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 19:15:44.510239 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 19:15:44.510239 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 19:15:44.510239 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 19:15:44.510239 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:44.518137 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 381/755] 10.222.0.60 () {56 vars in 1093 bytes} [Thu Jul 21 19:15:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:44.518137 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08505f-3a9f-48e4-9abf-25e4a9ce6ef3 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:44.554562 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664dbae-58e8-4297-af00-cf3bb6c063fb None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:44.559479 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:44.595025 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a8c5d-e44f-443a-8783-049915b53ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:44.596091 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a8c5d-e44f-443a-8783-049915b53ead None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:44.596589 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a8c5d-e44f-443a-8783-049915b53ead None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:44.596867 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a8c5d-e44f-443a-8783-049915b53ead None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:44.597691 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a8c5d-e44f-443a-8783-049915b53ead None admin] RBAC: Adding query filter params (role.id=685e18230e1744c581baaf842d0fd4ca, scope.project.id=9847b5e8bc0b4483bbce060a48f405f4, user.id=0aa579af53a6441a9205cf82864a640e) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:44.598005 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a8c5d-e44f-443a-8783-049915b53ead None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:44.600917 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a8c5d-e44f-443a-8783-049915b53ead None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:44.611464 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 375/756] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:15:44 2022] GET /identity/v3/role_assignments?user.id=0aa579af53a6441a9205cf82864a640e&scope.project.id=9847b5e8bc0b4483bbce060a48f405f4&role.id=685e18230e1744c581baaf842d0fd4ca => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:44.611464 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a8c5d-e44f-443a-8783-049915b53ead None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:44.639100 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08505f-3a9f-48e4-9abf-25e4a9ce6ef3 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:44.680698 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88cdbc2-8c0b-47a9-9da3-89da3919d5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:44.681427 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cdbc2-8c0b-47a9-9da3-89da3919d5b1 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:44.681788 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cdbc2-8c0b-47a9-9da3-89da3919d5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:44.682137 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cdbc2-8c0b-47a9-9da3-89da3919d5b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:44.682953 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88cdbc2-8c0b-47a9-9da3-89da3919d5b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:44.683333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88cdbc2-8c0b-47a9-9da3-89da3919d5b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:44.684782 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88cdbc2-8c0b-47a9-9da3-89da3919d5b1 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:44.706748 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 382/757] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:44.714203 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88cdbc2-8c0b-47a9-9da3-89da3919d5b1 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:44.737678 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a8c5d-e44f-443a-8783-049915b53ead None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:44.751354 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:44.775242 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8898a8-5d88-4bcc-a877-cc9fd03a125e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:44.776003 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8898a8-5d88-4bcc-a877-cc9fd03a125e None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:44.776294 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8898a8-5d88-4bcc-a877-cc9fd03a125e None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:44.776571 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8898a8-5d88-4bcc-a877-cc9fd03a125e None admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:44.777427 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8898a8-5d88-4bcc-a877-cc9fd03a125e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:44.777737 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8898a8-5d88-4bcc-a877-cc9fd03a125e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:44.779204 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8898a8-5d88-4bcc-a877-cc9fd03a125e None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:44.800429 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 376/758] 10.222.0.60 () {56 vars in 1133 bytes} [Thu Jul 21 19:15:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:44.806621 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8898a8-5d88-4bcc-a877-cc9fd03a125e None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:44.836228 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:44.848995 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88cdbc2-8c0b-47a9-9da3-89da3919d5b1 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:44.894702 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93bc1e4-1498-4c8b-a97f-7810ca3581ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:44.895572 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93bc1e4-1498-4c8b-a97f-7810ca3581ef None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:44.895860 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93bc1e4-1498-4c8b-a97f-7810ca3581ef None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:44.896673 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93bc1e4-1498-4c8b-a97f-7810ca3581ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:44.905089 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93bc1e4-1498-4c8b-a97f-7810ca3581ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:44.908015 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93bc1e4-1498-4c8b-a97f-7810ca3581ef None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:44.923156 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-d93bc1e4-1498-4c8b-a97f-7810ca3581ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:15:44.923156 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:44.923156 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:44.923156 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:44.923156 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:44.923156 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:44.923156 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:44.923156 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:44.923156 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:44.923156 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:44.923156 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:44.923156 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:44.923156 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 19:15:44.923156 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 19:15:44.923156 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 19:15:44.924132 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 19:15:44.924132 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:44.924132 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:44.924132 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:44.924132 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:44.924132 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:44.924132 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:44.924132 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:44.924132 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:44.924132 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:44.924132 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:44.924132 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:44.924132 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:44.924132 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:44.924132 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:44.924132 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:44.924132 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:44.925031 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 19:15:44.925031 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 19:15:44.925031 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 19:15:44.925031 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 19:15:44.925031 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 19:15:44.925031 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 19:15:44.925031 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:15:44.925031 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:44.927883 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 383/759] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:15:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:44.933491 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93bc1e4-1498-4c8b-a97f-7810ca3581ef None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:44.957873 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8898a8-5d88-4bcc-a877-cc9fd03a125e None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:45.025005 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb056d6-7b2b-4e4d-afc6-332c9ffb969d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:45.026584 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb056d6-7b2b-4e4d-afc6-332c9ffb969d None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:45.027073 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb056d6-7b2b-4e4d-afc6-332c9ffb969d None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:45.027657 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb056d6-7b2b-4e4d-afc6-332c9ffb969d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:45.045829 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb056d6-7b2b-4e4d-afc6-332c9ffb969d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:45.048438 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb056d6-7b2b-4e4d-afc6-332c9ffb969d None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:45.067875 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-cbb056d6-7b2b-4e4d-afc6-332c9ffb969d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:45.067875 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:45.067875 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:45.067875 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:45.067875 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:45.067875 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:45.067875 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:45.067875 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:45.067875 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:45.067875 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:45.067875 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:45.067875 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:45.067875 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:45.067875 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:45.067875 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:45.069712 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:45.069712 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:45.069712 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:45.069712 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:45.069712 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:45.069712 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:45.069712 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:45.069712 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:45.069712 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:45.069712 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:45.069712 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:45.069712 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:45.069712 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:45.069712 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:45.069712 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:45.069712 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:45.069712 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:45.070613 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:45.070613 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:45.070613 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:45.070613 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:45.072932 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 377/760] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:45.080504 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb056d6-7b2b-4e4d-afc6-332c9ffb969d None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:45.122077 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:45.131473 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93bc1e4-1498-4c8b-a97f-7810ca3581ef None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:45.199335 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f1e37-70ac-4738-9b1f-90ebedec9c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:45.200033 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f1e37-70ac-4738-9b1f-90ebedec9c28 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:45.200275 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f1e37-70ac-4738-9b1f-90ebedec9c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:45.200555 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f1e37-70ac-4738-9b1f-90ebedec9c28 None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:45.201352 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0f1e37-70ac-4738-9b1f-90ebedec9c28 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:45.201668 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0f1e37-70ac-4738-9b1f-90ebedec9c28 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:45.203107 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0f1e37-70ac-4738-9b1f-90ebedec9c28 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:45.223627 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 384/761] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Jul 21 19:15:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:15:45.229849 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f1e37-70ac-4738-9b1f-90ebedec9c28 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:45.257413 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:45.278037 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb056d6-7b2b-4e4d-afc6-332c9ffb969d None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:45.339562 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739efec-4f56-45a5-8b44-60b706d3e013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:45.340250 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739efec-4f56-45a5-8b44-60b706d3e013 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:45.340539 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739efec-4f56-45a5-8b44-60b706d3e013 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:45.340822 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739efec-4f56-45a5-8b44-60b706d3e013 None admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:45.341559 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739efec-4f56-45a5-8b44-60b706d3e013 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:45.341871 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739efec-4f56-45a5-8b44-60b706d3e013 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:45.343259 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739efec-4f56-45a5-8b44-60b706d3e013 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:45.374957 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 378/762] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:45.382029 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739efec-4f56-45a5-8b44-60b706d3e013 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:45.413729 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f1e37-70ac-4738-9b1f-90ebedec9c28 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:45.528276 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a9b19-6a06-4bf3-b6fe-6b18126dbc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:45.529206 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a9b19-6a06-4bf3-b6fe-6b18126dbc8b None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:45.529671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a9b19-6a06-4bf3-b6fe-6b18126dbc8b None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:45.530106 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a9b19-6a06-4bf3-b6fe-6b18126dbc8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:45.531139 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a9b19-6a06-4bf3-b6fe-6b18126dbc8b None admin] RBAC: Adding query filter params (role.id=beeebaa4e16c40f387f05b67124a424d, scope.project.id=9847b5e8bc0b4483bbce060a48f405f4, user.id=22d11b8e390e4b9db3b84c419266c4b2) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:45.531628 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a9b19-6a06-4bf3-b6fe-6b18126dbc8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:45.533245 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a9b19-6a06-4bf3-b6fe-6b18126dbc8b None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:45.541718 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 385/763] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:15:45 2022] GET /identity/v3/role_assignments?user.id=22d11b8e390e4b9db3b84c419266c4b2&scope.project.id=9847b5e8bc0b4483bbce060a48f405f4&role.id=beeebaa4e16c40f387f05b67124a424d => generated 259 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:45.563815 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:45.579616 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739efec-4f56-45a5-8b44-60b706d3e013 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:45.646272 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2fa0d2-31e1-4295-b96b-5d7c8b460752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:45.647528 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2fa0d2-31e1-4295-b96b-5d7c8b460752 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:45.647970 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2fa0d2-31e1-4295-b96b-5d7c8b460752 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:45.648400 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2fa0d2-31e1-4295-b96b-5d7c8b460752 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:45.664955 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2fa0d2-31e1-4295-b96b-5d7c8b460752 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:45.666690 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2fa0d2-31e1-4295-b96b-5d7c8b460752 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:45.689759 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-4c2fa0d2-31e1-4295-b96b-5d7c8b460752 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:15:45.689759 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:45.689759 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:45.689759 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:45.689759 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:45.689759 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:45.689759 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:45.689759 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:45.689759 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:45.689759 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:45.689759 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:45.689759 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:45.689759 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 19:15:45.689759 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 19:15:45.689759 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 19:15:45.690732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 19:15:45.690732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:45.690732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:45.690732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:45.690732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:45.690732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:45.690732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:45.690732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:45.690732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:45.690732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:45.690732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:45.690732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:45.690732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:45.690732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:45.690732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:45.690732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:45.690732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:45.691724 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 19:15:45.691724 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 19:15:45.691724 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 19:15:45.691724 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 19:15:45.691724 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 19:15:45.691724 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 19:15:45.691724 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:15:45.691724 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:45.694415 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 379/764] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:15:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:45.704904 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a9b19-6a06-4bf3-b6fe-6b18126dbc8b None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:45.823547 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:45.856456 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a9b19-6a06-4bf3-b6fe-6b18126dbc8b None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:45.875948 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ece9c0-3a3b-4fcd-83ca-c2d141d003bd None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:45.876594 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ece9c0-3a3b-4fcd-83ca-c2d141d003bd None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:45.878020 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ece9c0-3a3b-4fcd-83ca-c2d141d003bd None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:45.880928 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 380/765] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:45.888897 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d00e28-1f42-40cb-a83e-232983e1afb2 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:45.890027 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d00e28-1f42-40cb-a83e-232983e1afb2 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:45.890519 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d00e28-1f42-40cb-a83e-232983e1afb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:45.924321 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-97d00e28-1f42-40cb-a83e-232983e1afb2 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:45.926937 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-97d00e28-1f42-40cb-a83e-232983e1afb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:45.946436 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fca89b-f0a3-4a96-8c3f-9d5c9c109781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:45.947471 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fca89b-f0a3-4a96-8c3f-9d5c9c109781 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:45.947996 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fca89b-f0a3-4a96-8c3f-9d5c9c109781 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:45.948480 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fca89b-f0a3-4a96-8c3f-9d5c9c109781 None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:45.949485 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fca89b-f0a3-4a96-8c3f-9d5c9c109781 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:45.950002 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fca89b-f0a3-4a96-8c3f-9d5c9c109781 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:45.951687 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fca89b-f0a3-4a96-8c3f-9d5c9c109781 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:45.982683 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 386/766] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Jul 21 19:15:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:45.986714 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fca89b-f0a3-4a96-8c3f-9d5c9c109781 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:46.074399 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 381/767] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:15:46.107446 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d00e28-1f42-40cb-a83e-232983e1afb2 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:46.226505 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fca89b-f0a3-4a96-8c3f-9d5c9c109781 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:46.267409 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:46.287119 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4908e00-93c6-461e-a84f-b5c0aa5aedc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:46.288329 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4908e00-93c6-461e-a84f-b5c0aa5aedc3 None admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:46.288624 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4908e00-93c6-461e-a84f-b5c0aa5aedc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:46.288936 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4908e00-93c6-461e-a84f-b5c0aa5aedc3 None admin] PATH_INFO: `/v3/projects/9847b5e8bc0b4483bbce060a48f405f4/users/6b4d98e967814e5f84f5f0d67ebb3c17/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:46.296189 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4908e00-93c6-461e-a84f-b5c0aa5aedc3 None admin] RBAC: Authorizing `identity:create_grant(project_id=9847b5e8bc0b4483bbce060a48f405f4, user_id=6b4d98e967814e5f84f5f0d67ebb3c17, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:46.297643 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4908e00-93c6-461e-a84f-b5c0aa5aedc3 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:46.300348 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d00e28-1f42-40cb-a83e-232983e1afb2 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:46.338110 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca3af4-7b48-49a3-80e2-61f7048665f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:46.339254 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca3af4-7b48-49a3-80e2-61f7048665f9 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:46.339914 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca3af4-7b48-49a3-80e2-61f7048665f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:46.340405 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca3af4-7b48-49a3-80e2-61f7048665f9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:46.341249 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca3af4-7b48-49a3-80e2-61f7048665f9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:46.342910 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca3af4-7b48-49a3-80e2-61f7048665f9 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:46.356293 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-e8ca3af4-7b48-49a3-80e2-61f7048665f9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 19:15:46.356293 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:46.356293 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 19:15:46.356293 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 19:15:46.356293 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 19:15:46.356293 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 19:15:46.356293 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 19:15:46.356293 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:15:46.356293 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 19:15:46.356293 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:46.356293 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 19:15:46.356293 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:46.356293 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:46.356293 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:46.356293 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:46.356293 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:46.357275 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:46.357275 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:46.357275 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:46.357275 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:46.357275 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:46.357275 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:46.357275 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:46.357275 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 19:15:46.357275 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 19:15:46.357275 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 19:15:46.357275 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 19:15:46.357275 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:46.357275 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:46.357275 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:46.357275 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:46.357275 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:46.358132 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:46.358132 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:46.358132 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:46.358132 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:46.358132 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:46.358132 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:46.358132 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:46.358132 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:46.358132 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:46.358132 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:46.358132 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:46.358132 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 19:15:46.358132 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:15:46.358132 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 19:15:46.358132 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:46.361137 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 382/768] 10.222.0.60 () {56 vars in 1129 bytes} [Thu Jul 21 19:15:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:46.368032 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca3af4-7b48-49a3-80e2-61f7048665f9 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:46.378202 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:46.378202 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 387/769] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Jul 21 19:15:45 2022] PUT /identity/v3/projects/9847b5e8bc0b4483bbce060a48f405f4/users/6b4d98e967814e5f84f5f0d67ebb3c17/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:15:46.523880 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca3af4-7b48-49a3-80e2-61f7048665f9 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:46.584668 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728bc21f-cf5b-435f-8b75-c781f38986a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:46.585768 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728bc21f-cf5b-435f-8b75-c781f38986a8 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:46.587080 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728bc21f-cf5b-435f-8b75-c781f38986a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:46.587623 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728bc21f-cf5b-435f-8b75-c781f38986a8 None admin] PATH_INFO: `/v3/services` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:46.588628 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728bc21f-cf5b-435f-8b75-c781f38986a8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:46.589553 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728bc21f-cf5b-435f-8b75-c781f38986a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:46.591611 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728bc21f-cf5b-435f-8b75-c781f38986a8 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:46.593887 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:46.600193 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 383/770] 10.222.0.60 () {56 vars in 1124 bytes} [Thu Jul 21 19:15:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:46.607613 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4908e00-93c6-461e-a84f-b5c0aa5aedc3 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:46.729846 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4908e00-93c6-461e-a84f-b5c0aa5aedc3 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:46.778152 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5739be-6ecf-4fcb-9144-685ea4c884eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:46.778828 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5739be-6ecf-4fcb-9144-685ea4c884eb None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:46.779119 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5739be-6ecf-4fcb-9144-685ea4c884eb None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:46.779400 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5739be-6ecf-4fcb-9144-685ea4c884eb None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:46.780145 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5739be-6ecf-4fcb-9144-685ea4c884eb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:46.780458 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5739be-6ecf-4fcb-9144-685ea4c884eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:46.781839 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5739be-6ecf-4fcb-9144-685ea4c884eb None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:46.791031 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 388/771] 10.222.0.60 () {56 vars in 1124 bytes} [Thu Jul 21 19:15:46 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:46.796629 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728bc21f-cf5b-435f-8b75-c781f38986a8 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:46.867918 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c167c7b-cb89-413b-817f-8e2c3056683b None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:46.868219 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c167c7b-cb89-413b-817f-8e2c3056683b None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:46.868416 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c167c7b-cb89-413b-817f-8e2c3056683b None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:46.870055 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 389/772] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:46.874726 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b09c51-5545-4f56-8617-4dd329581162 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:46.875019 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b09c51-5545-4f56-8617-4dd329581162 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:46.875329 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b09c51-5545-4f56-8617-4dd329581162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:46.892153 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-b7b09c51-5545-4f56-8617-4dd329581162 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:46.893344 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-b7b09c51-5545-4f56-8617-4dd329581162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:46.963814 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:46.979240 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 390/773] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 19:15:46.988470 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728bc21f-cf5b-435f-8b75-c781f38986a8 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:47.019570 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b09c51-5545-4f56-8617-4dd329581162 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:47.047553 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00e6c7-c4ec-461c-baa6-f9b3626c0f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:47.048225 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00e6c7-c4ec-461c-baa6-f9b3626c0f76 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:47.050904 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00e6c7-c4ec-461c-baa6-f9b3626c0f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:47.051201 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00e6c7-c4ec-461c-baa6-f9b3626c0f76 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:47.052033 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e00e6c7-c4ec-461c-baa6-f9b3626c0f76 None admin] RBAC: Adding query filter params (interface=public, service_id=5298cf748b92459eb65475e15ded85e5, region_id=RegionOne) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:47.052382 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e00e6c7-c4ec-461c-baa6-f9b3626c0f76 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:47.055202 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e00e6c7-c4ec-461c-baa6-f9b3626c0f76 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:47.070708 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 384/774] 10.222.0.60 () {56 vars in 1251 bytes} [Thu Jul 21 19:15:46 2022] GET /identity/v3/endpoints?service_id=5298cf748b92459eb65475e15ded85e5&interface=public®ion_id=RegionOne => generated 194 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:47.080606 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00e6c7-c4ec-461c-baa6-f9b3626c0f76 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:47.184321 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b09c51-5545-4f56-8617-4dd329581162 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:47.201166 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:47.256503 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e9b08-b2e4-4c53-9215-b2698372d4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:47.257383 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e9b08-b2e4-4c53-9215-b2698372d4f2 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:47.257670 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e9b08-b2e4-4c53-9215-b2698372d4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:47.257948 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e9b08-b2e4-4c53-9215-b2698372d4f2 None admin] PATH_INFO: `/v3/services/network` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:47.258607 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e9b08-b2e4-4c53-9215-b2698372d4f2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:47.260023 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e9b08-b2e4-4c53-9215-b2698372d4f2 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:47.272154 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00e6c7-c4ec-461c-baa6-f9b3626c0f76 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:47.273213 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-068e9b08-b2e4-4c53-9215-b2698372d4f2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 19:15:47.273213 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:47.273213 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 19:15:47.273213 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 19:15:47.273213 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 19:15:47.273213 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 19:15:47.273213 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 19:15:47.273213 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:15:47.273213 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 19:15:47.273213 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:47.273213 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 19:15:47.273213 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:47.273213 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:47.273213 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:47.273213 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:47.273213 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:47.273213 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:47.274187 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:47.274187 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:47.274187 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:47.274187 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:47.274187 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:47.274187 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:47.274187 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 19:15:47.274187 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 19:15:47.274187 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 19:15:47.274187 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 19:15:47.274187 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:47.274187 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:47.274187 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:47.274187 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:47.274187 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:47.274187 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:47.275035 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:47.275035 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:47.275035 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:47.275035 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:47.275035 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:47.275035 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:47.275035 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:47.275035 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:47.275035 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:47.275035 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:47.275035 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 19:15:47.275035 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:15:47.275035 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 19:15:47.275035 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:47.275035 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 391/775] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:15:47 2022] GET /identity/v3/services/network => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:15:47.282305 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e9b08-b2e4-4c53-9215-b2698372d4f2 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:47.348143 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c775ba-e936-411e-bee3-50eeb06227c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:47.348833 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c775ba-e936-411e-bee3-50eeb06227c4 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:47.349191 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c775ba-e936-411e-bee3-50eeb06227c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:47.349669 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c775ba-e936-411e-bee3-50eeb06227c4 None admin] PATH_INFO: `/v3/services` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:47.350660 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c775ba-e936-411e-bee3-50eeb06227c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:47.352083 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c775ba-e936-411e-bee3-50eeb06227c4 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:47.366531 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:47.370078 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 385/776] 10.222.0.60 () {56 vars in 1087 bytes} [Thu Jul 21 19:15:47 2022] GET /identity/v3/services => generated 772 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:47.433775 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e9b08-b2e4-4c53-9215-b2698372d4f2 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:47.502962 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f487fa18-d081-4fac-bfe6-299ad589dbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:47.503687 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487fa18-d081-4fac-bfe6-299ad589dbe9 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:47.503987 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487fa18-d081-4fac-bfe6-299ad589dbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:47.504273 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487fa18-d081-4fac-bfe6-299ad589dbe9 None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:47.505002 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f487fa18-d081-4fac-bfe6-299ad589dbe9 None admin] RBAC: Adding query filter params (name=network) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:47.505346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f487fa18-d081-4fac-bfe6-299ad589dbe9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:47.507817 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f487fa18-d081-4fac-bfe6-299ad589dbe9 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:47.513390 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 392/777] 10.222.0.60 () {56 vars in 1112 bytes} [Thu Jul 21 19:15:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:47.519254 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c775ba-e936-411e-bee3-50eeb06227c4 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:47.538713 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9238e-c1d6-4c2c-a11e-8ca256bedc7c None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:47.539053 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9238e-c1d6-4c2c-a11e-8ca256bedc7c None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:47.539527 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9238e-c1d6-4c2c-a11e-8ca256bedc7c None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:47.541266 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 393/778] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 19:15:47.547147 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50213966-0029-4022-a94c-bbced27e8c35 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:47.547331 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50213966-0029-4022-a94c-bbced27e8c35 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:47.547546 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50213966-0029-4022-a94c-bbced27e8c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:47.565494 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-50213966-0029-4022-a94c-bbced27e8c35 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:47.566792 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-50213966-0029-4022-a94c-bbced27e8c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:47.650647 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c775ba-e936-411e-bee3-50eeb06227c4 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:47.657892 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 394/779] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 19:15:47.683700 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:47.688353 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50213966-0029-4022-a94c-bbced27e8c35 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:47.697887 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5099d2-308f-4f87-a10f-95c42d17ae60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:47.707502 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5099d2-308f-4f87-a10f-95c42d17ae60 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:47.707502 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5099d2-308f-4f87-a10f-95c42d17ae60 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:47.707502 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5099d2-308f-4f87-a10f-95c42d17ae60 None admin] PATH_INFO: `/v3/services` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:47.707502 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5099d2-308f-4f87-a10f-95c42d17ae60 None admin] RBAC: Adding query filter params (type=network) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:47.707502 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5099d2-308f-4f87-a10f-95c42d17ae60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:47.707502 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5099d2-308f-4f87-a10f-95c42d17ae60 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:47.709039 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 386/780] 10.222.0.60 () {56 vars in 1112 bytes} [Thu Jul 21 19:15:47 2022] GET /identity/v3/services?type=network => generated 350 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:47.714408 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5099d2-308f-4f87-a10f-95c42d17ae60 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:47.750052 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:47.812826 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50213966-0029-4022-a94c-bbced27e8c35 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:47.851043 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7215f-246f-425f-ad06-9584cc35b307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:47.851904 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7215f-246f-425f-ad06-9584cc35b307 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:47.852197 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7215f-246f-425f-ad06-9584cc35b307 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:47.852476 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7215f-246f-425f-ad06-9584cc35b307 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:47.864117 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe7215f-246f-425f-ad06-9584cc35b307 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:15:47.873338 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-1fe7215f-246f-425f-ad06-9584cc35b307 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:15:47.873338 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:47.873338 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:47.873338 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:47.873338 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:47.873338 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:47.873338 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:47.873338 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:47.873338 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:47.873338 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:47.873338 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:47.873338 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:47.873338 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:15:47.873338 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:15:47.873338 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:15:47.873338 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:15:47.874345 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:15:47.874345 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:15:47.874345 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:15:47.874345 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:15:47.874345 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:47.874345 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:47.874345 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:47.874345 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:47.874345 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:47.874345 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:47.874345 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:47.874345 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:47.874345 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:47.874345 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:47.874345 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:47.874345 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:47.875676 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:47.875676 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:47.875676 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:47.875676 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:47.875676 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:15:47.875676 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:15:47.875676 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:15:47.875676 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:15:47.875676 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:15:47.875676 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:15:47.875676 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:15:47.875676 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:47.875676 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 395/781] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Jul 21 19:15:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:15:47.881589 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7215f-246f-425f-ad06-9584cc35b307 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:47.889628 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5099d2-308f-4f87-a10f-95c42d17ae60 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:47.937523 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4b2e5-ab71-46a0-bb0d-61984ec4187f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:47.938197 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4b2e5-ab71-46a0-bb0d-61984ec4187f None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:47.938486 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4b2e5-ab71-46a0-bb0d-61984ec4187f None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:47.938769 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4b2e5-ab71-46a0-bb0d-61984ec4187f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:47.939591 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b4b2e5-ab71-46a0-bb0d-61984ec4187f None admin] RBAC: Adding query filter params (interface=public, service_id=83a8ddfab3ec4afcb4d609f30c91a304, region_id=RegionOne) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:47.939909 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b4b2e5-ab71-46a0-bb0d-61984ec4187f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:47.941285 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b4b2e5-ab71-46a0-bb0d-61984ec4187f None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:47.953790 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 387/782] 10.222.0.60 () {56 vars in 1251 bytes} [Thu Jul 21 19:15:47 2022] GET /identity/v3/endpoints?service_id=83a8ddfab3ec4afcb4d609f30c91a304&interface=public®ion_id=RegionOne => generated 194 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:47.958797 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4b2e5-ab71-46a0-bb0d-61984ec4187f None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:47.994662 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7215f-246f-425f-ad06-9584cc35b307 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:48.011899 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:48.033186 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a1fae-58a7-4390-85fb-623b7ff1fb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:48.033876 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a1fae-58a7-4390-85fb-623b7ff1fb38 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:48.034242 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a1fae-58a7-4390-85fb-623b7ff1fb38 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:48.034592 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a1fae-58a7-4390-85fb-623b7ff1fb38 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:48.035363 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a1fae-58a7-4390-85fb-623b7ff1fb38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:48.035842 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a1fae-58a7-4390-85fb-623b7ff1fb38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:48.038327 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a1fae-58a7-4390-85fb-623b7ff1fb38 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:48.042676 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:48.049454 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 396/783] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:15:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:48.056620 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a1fae-58a7-4390-85fb-623b7ff1fb38 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:48.134582 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4b2e5-ab71-46a0-bb0d-61984ec4187f None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:48.172851 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a1fae-58a7-4390-85fb-623b7ff1fb38 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:48.196108 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8c1fe-900d-49c6-b989-e39c3754d8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:48.196779 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8c1fe-900d-49c6-b989-e39c3754d8f5 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:48.197063 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8c1fe-900d-49c6-b989-e39c3754d8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:48.197335 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8c1fe-900d-49c6-b989-e39c3754d8f5 None admin] PATH_INFO: `/v3/services` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:48.198032 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f8c1fe-900d-49c6-b989-e39c3754d8f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:48.200524 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f8c1fe-900d-49c6-b989-e39c3754d8f5 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:48.208096 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 388/784] 10.222.0.60 () {56 vars in 1087 bytes} [Thu Jul 21 19:15:47 2022] GET /identity/v3/services => generated 772 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:15:48.210212 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffaec9-6d35-4555-bf7e-7f5fd1ec106d None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:48.210505 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffaec9-6d35-4555-bf7e-7f5fd1ec106d None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:48.210794 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffaec9-6d35-4555-bf7e-7f5fd1ec106d None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:48.212334 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 389/785] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:48.218558 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc6a09-5230-4a8a-be91-99629a7d8536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:48.218760 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae7eef-7dea-42a8-8bf3-9c53d84e46cf None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:48.219152 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae7eef-7dea-42a8-8bf3-9c53d84e46cf None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:48.219366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc6a09-5230-4a8a-be91-99629a7d8536 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:48.219654 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae7eef-7dea-42a8-8bf3-9c53d84e46cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:48.219763 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc6a09-5230-4a8a-be91-99629a7d8536 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:48.219974 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc6a09-5230-4a8a-be91-99629a7d8536 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:48.232473 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc6a09-5230-4a8a-be91-99629a7d8536 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:48.233965 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc6a09-5230-4a8a-be91-99629a7d8536 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:48.241673 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-87ae7eef-7dea-42a8-8bf3-9c53d84e46cf None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:48.243374 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-87ae7eef-7dea-42a8-8bf3-9c53d84e46cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:48.252562 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-54dc6a09-5230-4a8a-be91-99629a7d8536 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:48.252562 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:48.252562 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:48.252562 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:48.252562 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:48.252562 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:48.252562 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:48.252562 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:48.252562 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:48.252562 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:48.252562 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:48.252562 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:48.252562 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:48.252562 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:48.252562 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:48.253552 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:48.253552 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:48.253552 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:48.253552 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:48.253552 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:48.253552 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:48.253552 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:48.253552 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:48.253552 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:48.253552 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:48.253552 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:48.253552 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:48.253552 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:48.253552 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:48.253552 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:48.253552 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:48.253552 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:48.255489 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:48.255489 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:48.255489 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:48.255489 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:48.255489 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 397/786] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:48.260536 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc6a09-5230-4a8a-be91-99629a7d8536 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:48.322068 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 390/787] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 19:15:48.322634 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:48.349745 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae7eef-7dea-42a8-8bf3-9c53d84e46cf None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:48.426452 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc6a09-5230-4a8a-be91-99629a7d8536 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:48.452533 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:48.482932 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0bc7e-bda5-42f0-a317-18444a05e4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:48.483661 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0bc7e-bda5-42f0-a317-18444a05e4ef None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:48.483950 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0bc7e-bda5-42f0-a317-18444a05e4ef None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:48.484221 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0bc7e-bda5-42f0-a317-18444a05e4ef None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:48.485827 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0bc7e-bda5-42f0-a317-18444a05e4ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:48.486139 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0bc7e-bda5-42f0-a317-18444a05e4ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:48.487549 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0bc7e-bda5-42f0-a317-18444a05e4ef None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:48.506095 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 398/788] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:48.512111 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0bc7e-bda5-42f0-a317-18444a05e4ef None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:48.527230 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae7eef-7dea-42a8-8bf3-9c53d84e46cf None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:48.565624 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a828b-6dd4-498f-b013-16fc8c0ae28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:48.566547 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a828b-6dd4-498f-b013-16fc8c0ae28e None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:48.566817 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a828b-6dd4-498f-b013-16fc8c0ae28e None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:48.567177 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a828b-6dd4-498f-b013-16fc8c0ae28e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:48.578866 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7a828b-6dd4-498f-b013-16fc8c0ae28e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:15:48.587118 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-1c7a828b-6dd4-498f-b013-16fc8c0ae28e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 19:15:48.587118 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:48.587118 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:48.587118 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:48.587118 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:48.587118 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:48.587118 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:48.587118 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:48.587118 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:48.587118 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:48.587118 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:48.587118 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:48.587118 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:15:48.587118 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:15:48.587118 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:15:48.587118 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:15:48.588111 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:15:48.588111 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:15:48.588111 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:15:48.588111 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:15:48.588111 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:48.588111 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:48.588111 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:48.588111 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:48.588111 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:48.588111 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:48.588111 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:48.588111 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:48.588111 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:48.588111 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:48.588111 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:48.588111 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:48.588949 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:48.588949 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:48.588949 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:48.588949 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:48.588949 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:15:48.588949 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:15:48.588949 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:15:48.588949 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:15:48.588949 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:15:48.588949 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:15:48.588949 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 19:15:48.588949 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:48.588949 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 391/789] 10.222.0.60 () {56 vars in 1102 bytes} [Thu Jul 21 19:15:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:15:48.598478 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a828b-6dd4-498f-b013-16fc8c0ae28e None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:48.623351 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:48.640701 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0bc7e-bda5-42f0-a317-18444a05e4ef None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:48.679300 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395fb714-fdc2-4272-8b75-163b4e1e01b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:48.680494 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395fb714-fdc2-4272-8b75-163b4e1e01b9 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:48.681057 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395fb714-fdc2-4272-8b75-163b4e1e01b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:48.681641 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395fb714-fdc2-4272-8b75-163b4e1e01b9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:48.690053 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395fb714-fdc2-4272-8b75-163b4e1e01b9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:48.691869 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395fb714-fdc2-4272-8b75-163b4e1e01b9 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:48.707166 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-395fb714-fdc2-4272-8b75-163b4e1e01b9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 19:15:48.707166 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:48.707166 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:48.707166 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:48.707166 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:48.707166 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:48.707166 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:48.707166 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:48.707166 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:48.707166 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:48.707166 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:48.707166 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:48.707166 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 19:15:48.707166 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 19:15:48.707166 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 19:15:48.707166 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 19:15:48.708225 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:48.708225 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:48.708225 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 19:15:48.708225 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:15:48.708225 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 19:15:48.708225 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:15:48.708225 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:48.708225 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:48.708225 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:48.708225 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:48.708225 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:48.708225 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:48.708225 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:48.708225 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:48.708225 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:48.708225 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:48.708225 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:48.708225 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:48.709298 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:48.709298 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:48.709298 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 19:15:48.709298 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 19:15:48.709298 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 19:15:48.709298 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 19:15:48.709298 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 19:15:48.709298 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 19:15:48.709298 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 19:15:48.709298 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:48.712025 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 399/790] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Jul 21 19:15:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:15:48.717920 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395fb714-fdc2-4272-8b75-163b4e1e01b9 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:48.761838 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a828b-6dd4-498f-b013-16fc8c0ae28e None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:48.782147 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:48.850055 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed4757e-89a5-4606-8290-19e0733d2dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:48.850735 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4757e-89a5-4606-8290-19e0733d2dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:48.851021 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4757e-89a5-4606-8290-19e0733d2dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:48.851299 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4757e-89a5-4606-8290-19e0733d2dd5 None admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:48.852169 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed4757e-89a5-4606-8290-19e0733d2dd5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:48.852398 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed4757e-89a5-4606-8290-19e0733d2dd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:48.853781 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed4757e-89a5-4606-8290-19e0733d2dd5 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:48.856648 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395fb714-fdc2-4272-8b75-163b4e1e01b9 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:48.877979 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 392/791] 10.222.0.60 () {56 vars in 1103 bytes} [Thu Jul 21 19:15:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:48.896570 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed4757e-89a5-4606-8290-19e0733d2dd5 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:48.904858 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2afb364-fd75-4559-a1cb-0bdb71aefa22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:48.905800 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afb364-fd75-4559-a1cb-0bdb71aefa22 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:48.906493 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afb364-fd75-4559-a1cb-0bdb71aefa22 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:48.907020 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afb364-fd75-4559-a1cb-0bdb71aefa22 None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:48.910520 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2afb364-fd75-4559-a1cb-0bdb71aefa22 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:48.911115 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2afb364-fd75-4559-a1cb-0bdb71aefa22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:48.913405 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2afb364-fd75-4559-a1cb-0bdb71aefa22 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:48.934612 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 400/792] 10.222.0.60 () {56 vars in 1135 bytes} [Thu Jul 21 19:15:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:48.940379 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2afb364-fd75-4559-a1cb-0bdb71aefa22 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:48.943620 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:49.071772 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed4757e-89a5-4606-8290-19e0733d2dd5 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:49.090181 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2afb364-fd75-4559-a1cb-0bdb71aefa22 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:49.110540 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcef1c5-fe4f-4244-96db-ed7f3547b15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:49.111788 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcef1c5-fe4f-4244-96db-ed7f3547b15e None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:49.112328 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcef1c5-fe4f-4244-96db-ed7f3547b15e None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:49.112826 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcef1c5-fe4f-4244-96db-ed7f3547b15e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:49.124412 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcef1c5-fe4f-4244-96db-ed7f3547b15e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:49.126245 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcef1c5-fe4f-4244-96db-ed7f3547b15e None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:49.130962 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef358ce0-19d2-46c7-92f8-191d5b830d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:49.131779 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef358ce0-19d2-46c7-92f8-191d5b830d6b None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:49.132066 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef358ce0-19d2-46c7-92f8-191d5b830d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:49.132387 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef358ce0-19d2-46c7-92f8-191d5b830d6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:49.142909 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef358ce0-19d2-46c7-92f8-191d5b830d6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:49.144604 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef358ce0-19d2-46c7-92f8-191d5b830d6b None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:49.150161 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-fdcef1c5-fe4f-4244-96db-ed7f3547b15e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:49.150161 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:49.150161 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:49.150161 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:49.150161 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:49.150161 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:49.150161 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:49.150161 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:49.150161 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:49.150161 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:49.150161 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:49.150161 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:49.150161 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:49.150161 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:49.150161 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:49.151371 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:49.151371 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:49.151371 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:49.151371 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:49.151371 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:49.151371 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:49.151371 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:49.151371 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:49.151371 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:49.151371 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:49.151371 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:49.151371 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:49.151371 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:49.151371 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:49.151371 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:49.151371 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:49.151371 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:49.152305 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:49.152305 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:49.152305 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:49.152305 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:49.152305 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 393/793] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:49.157606 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236d3b0-12f4-456f-b4aa-5cb64bad2433 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:49.157606 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236d3b0-12f4-456f-b4aa-5cb64bad2433 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:49.157606 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236d3b0-12f4-456f-b4aa-5cb64bad2433 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:49.158914 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 394/794] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:49.159756 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236d3b0-12f4-456f-b4aa-5cb64bad2433 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:49.173857 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-ef358ce0-19d2-46c7-92f8-191d5b830d6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:49.173857 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:49.173857 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:49.173857 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:49.173857 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:49.173857 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:49.173857 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:49.173857 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:49.173857 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:49.173857 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:49.173857 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:49.173857 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:49.173857 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:49.173857 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:49.173857 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:49.182123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:49.182123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:49.182123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:49.182123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:49.182123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:49.182123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:49.182123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:49.182123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:49.182123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:49.182123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:49.182123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:49.182123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:49.182123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:49.182123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:49.182123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:49.182123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:49.182123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:49.183018 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:49.183018 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:49.183018 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:49.183018 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:49.183018 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 401/795] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:15:49.184258 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb051674-3d4b-4eca-89ec-1f7415b808c4 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:49.184889 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb051674-3d4b-4eca-89ec-1f7415b808c4 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:49.185373 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb051674-3d4b-4eca-89ec-1f7415b808c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:49.187723 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:49.204317 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-bb051674-3d4b-4eca-89ec-1f7415b808c4 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:49.205936 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-bb051674-3d4b-4eca-89ec-1f7415b808c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:49.261489 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:49.282576 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 402/796] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:15:49.283859 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb051674-3d4b-4eca-89ec-1f7415b808c4 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:49.287110 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236d3b0-12f4-456f-b4aa-5cb64bad2433 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:49.343930 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a3172-125c-452f-8275-eccb2844d995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:49.344596 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a3172-125c-452f-8275-eccb2844d995 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:49.344876 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a3172-125c-452f-8275-eccb2844d995 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:49.345207 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a3172-125c-452f-8275-eccb2844d995 None admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:49.345982 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a3172-125c-452f-8275-eccb2844d995 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:49.346291 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a3172-125c-452f-8275-eccb2844d995 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:49.348165 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a3172-125c-452f-8275-eccb2844d995 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:49.367224 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 395/797] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:49.367224 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a3172-125c-452f-8275-eccb2844d995 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:49.421117 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb051674-3d4b-4eca-89ec-1f7415b808c4 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:49.460215 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517a752-e2e2-4cd4-a59e-f7dfd80b2c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:49.461200 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517a752-e2e2-4cd4-a59e-f7dfd80b2c50 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:49.461687 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517a752-e2e2-4cd4-a59e-f7dfd80b2c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:49.462197 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517a752-e2e2-4cd4-a59e-f7dfd80b2c50 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:49.463121 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f517a752-e2e2-4cd4-a59e-f7dfd80b2c50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:49.463674 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f517a752-e2e2-4cd4-a59e-f7dfd80b2c50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:49.464536 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:49.465824 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f517a752-e2e2-4cd4-a59e-f7dfd80b2c50 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:49.483471 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 403/798] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:49.492759 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517a752-e2e2-4cd4-a59e-f7dfd80b2c50 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:49.492890 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a3172-125c-452f-8275-eccb2844d995 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:49.525386 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab578621-6759-4139-b960-3221d82ea6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:49.526389 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab578621-6759-4139-b960-3221d82ea6ea None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:49.526712 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab578621-6759-4139-b960-3221d82ea6ea None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:49.527087 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab578621-6759-4139-b960-3221d82ea6ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:49.538749 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab578621-6759-4139-b960-3221d82ea6ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:15:49.543853 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:49.547986 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-ab578621-6759-4139-b960-3221d82ea6ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:15:49.547986 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:49.547986 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:49.547986 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:49.547986 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:49.547986 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:49.547986 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:49.547986 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:49.547986 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:49.547986 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:49.547986 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:49.547986 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:49.547986 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:15:49.547986 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:15:49.547986 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:15:49.547986 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:15:49.549135 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:15:49.549135 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:15:49.549135 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:15:49.549135 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:15:49.549135 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:49.549135 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:49.549135 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:49.549135 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:49.549135 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:49.549135 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:49.549135 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:49.549135 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:49.549135 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:49.549135 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:49.549135 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:49.549135 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:49.550175 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:49.550175 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:49.550175 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:49.550175 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:49.550175 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:15:49.550175 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:15:49.550175 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:15:49.550175 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:15:49.550175 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:15:49.550175 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:15:49.550175 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:15:49.550175 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:49.557062 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 396/799] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Jul 21 19:15:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:49.557062 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab578621-6759-4139-b960-3221d82ea6ea None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:49.624297 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517a752-e2e2-4cd4-a59e-f7dfd80b2c50 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:49.662268 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6537e-ec19-4068-910a-dc1797dadba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:49.663231 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6537e-ec19-4068-910a-dc1797dadba9 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:49.663664 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6537e-ec19-4068-910a-dc1797dadba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:49.664040 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6537e-ec19-4068-910a-dc1797dadba9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:49.672148 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f6537e-ec19-4068-910a-dc1797dadba9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:49.673821 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f6537e-ec19-4068-910a-dc1797dadba9 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:49.675081 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab578621-6759-4139-b960-3221d82ea6ea None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:49.690510 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-d9f6537e-ec19-4068-910a-dc1797dadba9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 19:15:49.690510 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:49.690510 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:49.690510 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:49.690510 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:49.690510 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:49.690510 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:49.690510 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:49.690510 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:49.690510 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:49.690510 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:49.690510 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:49.690510 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 19:15:49.690510 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 19:15:49.690510 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 19:15:49.690510 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 19:15:49.691836 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:49.691836 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:49.691836 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 19:15:49.691836 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:15:49.691836 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 19:15:49.691836 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:15:49.691836 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:49.691836 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:49.691836 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:49.691836 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:49.691836 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:49.691836 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:49.691836 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:49.691836 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:49.691836 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:49.691836 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:49.691836 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:49.691836 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:49.693544 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:49.693544 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:49.693544 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 19:15:49.693544 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 19:15:49.693544 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 19:15:49.693544 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 19:15:49.693544 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 19:15:49.693544 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 19:15:49.693544 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 19:15:49.693544 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:49.699852 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 404/800] 10.222.0.60 () {56 vars in 1117 bytes} [Thu Jul 21 19:15:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:49.700872 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6537e-ec19-4068-910a-dc1797dadba9 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:49.723134 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed20b33-c6a7-4b62-bba4-67dc8ceb0be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:49.723999 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed20b33-c6a7-4b62-bba4-67dc8ceb0be4 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:49.724289 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed20b33-c6a7-4b62-bba4-67dc8ceb0be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:49.724566 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed20b33-c6a7-4b62-bba4-67dc8ceb0be4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:49.732236 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed20b33-c6a7-4b62-bba4-67dc8ceb0be4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:49.734031 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed20b33-c6a7-4b62-bba4-67dc8ceb0be4 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:49.750373 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-1ed20b33-c6a7-4b62-bba4-67dc8ceb0be4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:15:49.750373 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:49.750373 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:49.750373 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:49.750373 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:49.750373 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:49.750373 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:49.750373 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:49.750373 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:49.750373 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:49.750373 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:49.750373 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:49.750373 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 19:15:49.750373 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 19:15:49.750373 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 19:15:49.751307 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 19:15:49.751307 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:49.751307 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:49.751307 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:49.751307 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:49.751307 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:49.751307 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:49.751307 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:49.751307 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:49.751307 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:49.751307 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:49.751307 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:49.751307 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:49.751307 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:49.751307 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:49.751307 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:49.751307 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:49.752225 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 19:15:49.752225 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 19:15:49.752225 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 19:15:49.752225 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 19:15:49.752225 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 19:15:49.752225 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 19:15:49.752225 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:15:49.752225 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:49.756657 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 397/801] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:15:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:49.757516 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed20b33-c6a7-4b62-bba4-67dc8ceb0be4 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:49.761500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:49.832995 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6537e-ec19-4068-910a-dc1797dadba9 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:49.836148 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:49.868386 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed20b33-c6a7-4b62-bba4-67dc8ceb0be4 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:49.875566 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa02fd4f-bdf7-4df7-a464-73609e898df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:49.876264 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02fd4f-bdf7-4df7-a464-73609e898df6 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:49.876553 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02fd4f-bdf7-4df7-a464-73609e898df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:49.876835 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02fd4f-bdf7-4df7-a464-73609e898df6 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:49.877945 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa02fd4f-bdf7-4df7-a464-73609e898df6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:49.878257 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa02fd4f-bdf7-4df7-a464-73609e898df6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:49.879975 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa02fd4f-bdf7-4df7-a464-73609e898df6 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:49.888864 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 405/802] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:15:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:49.893404 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa02fd4f-bdf7-4df7-a464-73609e898df6 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:49.902700 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293c0c9-1c11-4075-812a-e0948ab6ff5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:49.903363 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293c0c9-1c11-4075-812a-e0948ab6ff5a None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:49.903682 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293c0c9-1c11-4075-812a-e0948ab6ff5a None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:49.903956 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293c0c9-1c11-4075-812a-e0948ab6ff5a None admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:49.904782 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f293c0c9-1c11-4075-812a-e0948ab6ff5a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:49.905086 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f293c0c9-1c11-4075-812a-e0948ab6ff5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:49.906490 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f293c0c9-1c11-4075-812a-e0948ab6ff5a None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:49.923871 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 398/803] 10.222.0.60 () {56 vars in 1149 bytes} [Thu Jul 21 19:15:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:49.925344 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7916e-868f-429a-b9e7-a88efaf90806 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:49.925833 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7916e-868f-429a-b9e7-a88efaf90806 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:49.926304 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7916e-868f-429a-b9e7-a88efaf90806 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:49.928541 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 399/804] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:49.929422 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7916e-868f-429a-b9e7-a88efaf90806 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:49.992363 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:50.008688 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa02fd4f-bdf7-4df7-a464-73609e898df6 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:50.038561 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7916e-868f-429a-b9e7-a88efaf90806 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:50.044403 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c26e7a-725e-4821-9e39-a43e12b46c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:50.045068 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c26e7a-725e-4821-9e39-a43e12b46c85 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:50.045353 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c26e7a-725e-4821-9e39-a43e12b46c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:50.045633 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c26e7a-725e-4821-9e39-a43e12b46c85 None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:50.046830 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c26e7a-725e-4821-9e39-a43e12b46c85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:50.047144 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c26e7a-725e-4821-9e39-a43e12b46c85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:50.048976 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c26e7a-725e-4821-9e39-a43e12b46c85 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:50.068019 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 406/805] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Jul 21 19:15:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:50.068019 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c26e7a-725e-4821-9e39-a43e12b46c85 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:50.081012 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7010ad-8be0-4e04-95d3-6a53c65ecf9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:50.081948 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7010ad-8be0-4e04-95d3-6a53c65ecf9f None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:50.082230 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7010ad-8be0-4e04-95d3-6a53c65ecf9f None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:50.082502 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7010ad-8be0-4e04-95d3-6a53c65ecf9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:50.092641 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:50.093435 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7010ad-8be0-4e04-95d3-6a53c65ecf9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:50.094938 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7010ad-8be0-4e04-95d3-6a53c65ecf9f None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:50.112307 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-eb7010ad-8be0-4e04-95d3-6a53c65ecf9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:50.112307 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:50.112307 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:50.112307 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:50.112307 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:50.112307 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:50.112307 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:50.112307 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:50.112307 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:50.112307 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:50.112307 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:50.112307 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:50.112307 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:50.112307 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:50.112307 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:50.113221 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:50.113221 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:50.113221 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:50.113221 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:50.113221 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:50.113221 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:50.113221 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:50.113221 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:50.113221 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:50.113221 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:50.113221 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:50.113221 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:50.113221 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:50.113221 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:50.113221 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:50.113221 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:50.113221 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:50.114111 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:50.114111 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:50.114111 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:50.114111 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:50.114111 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 400/806] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:50.115515 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe59e0-e2e9-4e7b-9584-383b1ac2f8a5 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:50.115636 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe59e0-e2e9-4e7b-9584-383b1ac2f8a5 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:50.115925 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe59e0-e2e9-4e7b-9584-383b1ac2f8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:50.133400 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-79fe59e0-e2e9-4e7b-9584-383b1ac2f8a5 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:50.134595 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-79fe59e0-e2e9-4e7b-9584-383b1ac2f8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:50.178506 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c26e7a-725e-4821-9e39-a43e12b46c85 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:50.211476 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 401/807] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:15:50.212306 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe59e0-e2e9-4e7b-9584-383b1ac2f8a5 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:50.221649 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a91379-d0ff-4c6e-8b28-dc6ad04a7a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:50.223188 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a91379-d0ff-4c6e-8b28-dc6ad04a7a84 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:50.224620 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a91379-d0ff-4c6e-8b28-dc6ad04a7a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:50.225282 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a91379-d0ff-4c6e-8b28-dc6ad04a7a84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:50.241637 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a91379-d0ff-4c6e-8b28-dc6ad04a7a84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:50.243898 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a91379-d0ff-4c6e-8b28-dc6ad04a7a84 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:50.259649 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:50.264464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-69a91379-d0ff-4c6e-8b28-dc6ad04a7a84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:50.264464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:50.264464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:50.264464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:50.264464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:50.264464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:50.264464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:50.264464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:50.264464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:50.264464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:50.264464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:50.264464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:50.264464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:50.264464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:50.264464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:50.265658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:50.265658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:50.265658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:50.265658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:50.265658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:50.265658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:50.265658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:50.265658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:50.265658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:50.265658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:50.265658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:50.265658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:50.265658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:50.265658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:50.265658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:50.265658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:50.265658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:50.266528 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:50.266528 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:50.266528 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:50.266528 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:50.270572 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 407/808] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:50.271477 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a91379-d0ff-4c6e-8b28-dc6ad04a7a84 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:50.321485 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe59e0-e2e9-4e7b-9584-383b1ac2f8a5 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:50.352703 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:50.356356 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9b27d-1336-461d-b97d-506277995685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:50.357255 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9b27d-1336-461d-b97d-506277995685 None admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:50.357536 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9b27d-1336-461d-b97d-506277995685 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:50.357808 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9b27d-1336-461d-b97d-506277995685 None admin] PATH_INFO: `/v3/projects/9847b5e8bc0b4483bbce060a48f405f4/users/0aa579af53a6441a9205cf82864a640e/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:50.359789 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9b27d-1336-461d-b97d-506277995685 None admin] RBAC: Authorizing `identity:create_grant(project_id=9847b5e8bc0b4483bbce060a48f405f4, user_id=0aa579af53a6441a9205cf82864a640e, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:50.361224 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9b27d-1336-461d-b97d-506277995685 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:50.374993 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a91379-d0ff-4c6e-8b28-dc6ad04a7a84 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:50.408753 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed66a021-f3db-45c9-9f70-a0c5575f85dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:50.409418 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66a021-f3db-45c9-9f70-a0c5575f85dd None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:50.409702 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66a021-f3db-45c9-9f70-a0c5575f85dd None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:50.409979 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66a021-f3db-45c9-9f70-a0c5575f85dd None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:50.410702 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed66a021-f3db-45c9-9f70-a0c5575f85dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:50.411013 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed66a021-f3db-45c9-9f70-a0c5575f85dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:50.412939 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed66a021-f3db-45c9-9f70-a0c5575f85dd None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:50.428235 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 408/809] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:50.429164 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed66a021-f3db-45c9-9f70-a0c5575f85dd None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:50.465056 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 402/810] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Jul 21 19:15:50 2022] PUT /identity/v3/projects/9847b5e8bc0b4483bbce060a48f405f4/users/0aa579af53a6441a9205cf82864a640e/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:15:50.476492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9b27d-1336-461d-b97d-506277995685 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:50.546566 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed66a021-f3db-45c9-9f70-a0c5575f85dd None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:50.587633 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41a39f-654a-4bd6-ad2c-252ad36cdebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:50.588640 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41a39f-654a-4bd6-ad2c-252ad36cdebe None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:50.589104 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41a39f-654a-4bd6-ad2c-252ad36cdebe None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:50.590082 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41a39f-654a-4bd6-ad2c-252ad36cdebe None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:50.590410 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f41a39f-654a-4bd6-ad2c-252ad36cdebe None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:50.591987 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f41a39f-654a-4bd6-ad2c-252ad36cdebe None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:50.608236 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-8f41a39f-654a-4bd6-ad2c-252ad36cdebe None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 19:15:50.608236 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:50.608236 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 19:15:50.608236 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 19:15:50.608236 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 19:15:50.608236 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 19:15:50.608236 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 19:15:50.608236 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:15:50.608236 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 19:15:50.608236 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:50.608236 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 19:15:50.608236 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:50.608236 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:50.608236 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:50.608236 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:50.608236 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:50.609442 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:50.609442 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:50.609442 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:50.609442 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:50.609442 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:50.609442 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:50.609442 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:50.609442 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 19:15:50.609442 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 19:15:50.609442 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 19:15:50.609442 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 19:15:50.609442 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:50.609442 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:50.609442 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:50.609442 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:50.609442 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:50.610515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:50.610515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:50.610515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:50.610515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:50.610515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:50.610515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:50.610515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:50.610515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:50.610515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:50.610515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:50.610515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:50.610515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 19:15:50.610515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:15:50.610515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 19:15:50.610515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:50.617768 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 409/811] 10.222.0.60 () {56 vars in 1129 bytes} [Thu Jul 21 19:15:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:50.617768 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41a39f-654a-4bd6-ad2c-252ad36cdebe None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:50.621483 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:50.633716 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9b27d-1336-461d-b97d-506277995685 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:50.635372 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:50.672980 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651457d2-17e2-4fc1-81f8-6560173e86ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:50.673653 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651457d2-17e2-4fc1-81f8-6560173e86ee None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:50.673942 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651457d2-17e2-4fc1-81f8-6560173e86ee None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:50.674223 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651457d2-17e2-4fc1-81f8-6560173e86ee None admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:50.675007 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651457d2-17e2-4fc1-81f8-6560173e86ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:50.675265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651457d2-17e2-4fc1-81f8-6560173e86ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:50.676693 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651457d2-17e2-4fc1-81f8-6560173e86ee None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:50.689393 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 403/812] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:50.690209 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651457d2-17e2-4fc1-81f8-6560173e86ee None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:50.743202 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41a39f-654a-4bd6-ad2c-252ad36cdebe None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:50.779755 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d7c2ba-9c34-49a0-aa4c-78348825db25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:50.780554 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7c2ba-9c34-49a0-aa4c-78348825db25 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:50.780844 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7c2ba-9c34-49a0-aa4c-78348825db25 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:50.781122 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7c2ba-9c34-49a0-aa4c-78348825db25 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:50.789805 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d7c2ba-9c34-49a0-aa4c-78348825db25 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:50.791387 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d7c2ba-9c34-49a0-aa4c-78348825db25 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:50.797593 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651457d2-17e2-4fc1-81f8-6560173e86ee None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:50.806359 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-f5d7c2ba-9c34-49a0-aa4c-78348825db25 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 19:15:50.806359 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:50.806359 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:50.806359 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:50.806359 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:50.806359 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:50.806359 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:50.806359 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:50.806359 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:50.806359 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:50.806359 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:50.806359 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:50.806359 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 19:15:50.806359 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 19:15:50.806359 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 19:15:50.806359 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 19:15:50.807333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:50.807333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:50.807333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 19:15:50.807333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:15:50.807333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 19:15:50.807333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:15:50.807333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:50.807333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:50.807333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:50.807333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:50.807333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:50.807333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:50.807333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:50.807333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:50.807333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:50.807333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:50.807333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:50.807333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:50.808310 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:50.808310 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:50.808310 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 19:15:50.808310 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 19:15:50.808310 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 19:15:50.808310 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 19:15:50.808310 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 19:15:50.808310 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 19:15:50.808310 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 19:15:50.808310 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:50.808310 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 410/813] 10.222.0.60 () {56 vars in 1093 bytes} [Thu Jul 21 19:15:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:50.809537 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be956288-fbd4-40bb-a805-373b49be5467 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:50.810088 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be956288-fbd4-40bb-a805-373b49be5467 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:50.810441 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be956288-fbd4-40bb-a805-373b49be5467 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:50.815774 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 411/814] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:50.816554 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be956288-fbd4-40bb-a805-373b49be5467 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:50.837810 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9ffa7-63cb-480e-825c-767998114650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:50.838872 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9ffa7-63cb-480e-825c-767998114650 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:50.839302 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9ffa7-63cb-480e-825c-767998114650 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:50.839752 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9ffa7-63cb-480e-825c-767998114650 None admin] PATH_INFO: `/v3/services` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:50.840725 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9ffa7-63cb-480e-825c-767998114650 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:50.841226 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9ffa7-63cb-480e-825c-767998114650 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:50.842801 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9ffa7-63cb-480e-825c-767998114650 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:50.853520 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 404/815] 10.222.0.60 () {56 vars in 1124 bytes} [Thu Jul 21 19:15:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:50.854349 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9ffa7-63cb-480e-825c-767998114650 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:50.883912 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:50.886754 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:50.929246 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be956288-fbd4-40bb-a805-373b49be5467 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:50.960616 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9ffa7-63cb-480e-825c-767998114650 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:50.966084 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5df4df-d9a6-4b04-9e58-41dae64a29d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:50.966877 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5df4df-d9a6-4b04-9e58-41dae64a29d5 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:50.967162 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5df4df-d9a6-4b04-9e58-41dae64a29d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:50.967453 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5df4df-d9a6-4b04-9e58-41dae64a29d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:50.974383 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5df4df-d9a6-4b04-9e58-41dae64a29d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:50.975896 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5df4df-d9a6-4b04-9e58-41dae64a29d5 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:50.991838 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-5b5df4df-d9a6-4b04-9e58-41dae64a29d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:15:50.991838 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:50.991838 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:50.991838 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:50.991838 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:50.991838 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:50.991838 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:50.991838 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:50.991838 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:50.991838 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:50.991838 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:50.991838 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:50.991838 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 19:15:50.991838 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 19:15:50.991838 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 19:15:50.992752 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 19:15:50.992752 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:50.992752 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:50.992752 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:50.992752 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:50.992752 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:50.992752 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:50.992752 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:50.992752 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:50.992752 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:50.992752 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:50.992752 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:50.992752 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:50.992752 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:50.992752 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:50.992752 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:50.992752 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:50.993640 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 19:15:50.993640 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 19:15:50.993640 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 19:15:50.993640 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 19:15:50.993640 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 19:15:50.993640 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 19:15:50.993640 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:15:50.993640 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:50.995818 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab70992-cb96-492f-8fd0-8f56e4537c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:50.996490 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab70992-cb96-492f-8fd0-8f56e4537c8e None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:50.996771 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab70992-cb96-492f-8fd0-8f56e4537c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:50.997044 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab70992-cb96-492f-8fd0-8f56e4537c8e None admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:50.998013 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab70992-cb96-492f-8fd0-8f56e4537c8e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:50.998127 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 412/816] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:15:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:50.998217 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab70992-cb96-492f-8fd0-8f56e4537c8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:50.999384 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0dd5f-2fce-4693-b7df-842890c1a260 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:50.999613 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab70992-cb96-492f-8fd0-8f56e4537c8e None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:50.999708 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0dd5f-2fce-4693-b7df-842890c1a260 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:50.999966 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0dd5f-2fce-4693-b7df-842890c1a260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:51.017748 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-6bf0dd5f-2fce-4693-b7df-842890c1a260 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:51.018931 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-6bf0dd5f-2fce-4693-b7df-842890c1a260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:51.027528 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 405/817] 10.222.0.60 () {56 vars in 1133 bytes} [Thu Jul 21 19:15:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:51.027528 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab70992-cb96-492f-8fd0-8f56e4537c8e None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:51.090516 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 413/818] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:15:51.091447 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0dd5f-2fce-4693-b7df-842890c1a260 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:51.129165 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:51.144884 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:51.146882 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab70992-cb96-492f-8fd0-8f56e4537c8e None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:51.181210 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879fae8c-919e-4579-9d99-94f766f5362b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:51.182042 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fae8c-919e-4579-9d99-94f766f5362b None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:51.182317 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fae8c-919e-4579-9d99-94f766f5362b None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:51.182593 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fae8c-919e-4579-9d99-94f766f5362b None admin] PATH_INFO: `/v3/services` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:51.183289 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879fae8c-919e-4579-9d99-94f766f5362b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:51.183624 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879fae8c-919e-4579-9d99-94f766f5362b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:51.184985 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879fae8c-919e-4579-9d99-94f766f5362b None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:51.195121 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 406/819] 10.222.0.60 () {56 vars in 1124 bytes} [Thu Jul 21 19:15:51 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:51.195121 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879fae8c-919e-4579-9d99-94f766f5362b None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:51.197850 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0dd5f-2fce-4693-b7df-842890c1a260 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:51.237108 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92a4e9-6280-401d-a40c-54dc8f110d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:51.237777 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92a4e9-6280-401d-a40c-54dc8f110d03 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:51.238061 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92a4e9-6280-401d-a40c-54dc8f110d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:51.238338 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92a4e9-6280-401d-a40c-54dc8f110d03 None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:51.239151 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b92a4e9-6280-401d-a40c-54dc8f110d03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:51.239506 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b92a4e9-6280-401d-a40c-54dc8f110d03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:51.241628 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b92a4e9-6280-401d-a40c-54dc8f110d03 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:51.253556 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 414/820] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Jul 21 19:15:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:51.254367 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92a4e9-6280-401d-a40c-54dc8f110d03 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:51.306553 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879fae8c-919e-4579-9d99-94f766f5362b None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:51.347565 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa9778-3018-476f-b3cc-5972711387b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:51.348146 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa9778-3018-476f-b3cc-5972711387b2 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:51.348431 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa9778-3018-476f-b3cc-5972711387b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:51.348707 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa9778-3018-476f-b3cc-5972711387b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:51.365391 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92a4e9-6280-401d-a40c-54dc8f110d03 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:51.366584 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:51.378737 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:51.400893 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2fab6-69e2-4ccb-a655-0aaa15456572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:51.401761 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2fab6-69e2-4ccb-a655-0aaa15456572 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:51.402131 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2fab6-69e2-4ccb-a655-0aaa15456572 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:51.402472 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2fab6-69e2-4ccb-a655-0aaa15456572 None admin] PATH_INFO: `/v3/services/network` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:51.403191 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db2fab6-69e2-4ccb-a655-0aaa15456572 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:51.404673 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db2fab6-69e2-4ccb-a655-0aaa15456572 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:51.416648 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa9778-3018-476f-b3cc-5972711387b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:51.416865 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-8db2fab6-69e2-4ccb-a655-0aaa15456572 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 19:15:51.416865 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:51.416865 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 19:15:51.416865 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 19:15:51.416865 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 19:15:51.416865 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 19:15:51.416865 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 19:15:51.416865 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:15:51.416865 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 19:15:51.416865 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:51.416865 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 19:15:51.416865 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:51.416865 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:51.416865 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:51.416865 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:51.416865 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:51.416865 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:51.418013 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:51.418013 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:51.418013 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:51.418013 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:51.418013 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:51.418013 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:51.418013 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 19:15:51.418013 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 19:15:51.418013 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 19:15:51.418013 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 19:15:51.418013 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:51.418013 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:51.418013 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:51.418013 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:51.418013 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:51.418013 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:51.419079 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:51.419079 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:51.419079 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:51.419079 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:51.419079 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:51.419079 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:51.419079 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:51.419079 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:51.419079 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:51.419079 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:51.419079 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 19:15:51.419079 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:15:51.419079 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 19:15:51.419079 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:51.420878 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa9778-3018-476f-b3cc-5972711387b2 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:51.428933 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 415/821] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:15:51 2022] GET /identity/v3/services/network => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:51.428933 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2fab6-69e2-4ccb-a655-0aaa15456572 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:51.527873 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 407/822] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:15:51 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 19:15:51.528567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa9778-3018-476f-b3cc-5972711387b2 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:51.548417 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2fab6-69e2-4ccb-a655-0aaa15456572 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:51.581159 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:51.590300 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b59bd7-f7a3-4b0b-ba58-6e34ecbf55b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:51.590956 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b59bd7-f7a3-4b0b-ba58-6e34ecbf55b4 None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:51.591241 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b59bd7-f7a3-4b0b-ba58-6e34ecbf55b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:51.593688 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b59bd7-f7a3-4b0b-ba58-6e34ecbf55b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:51.593688 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b59bd7-f7a3-4b0b-ba58-6e34ecbf55b4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:51.593688 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b59bd7-f7a3-4b0b-ba58-6e34ecbf55b4 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:51.635019 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa9778-3018-476f-b3cc-5972711387b2 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:51.668919 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a248870-cf1a-4b3b-8919-7ca3e265151e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:51.669838 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a248870-cf1a-4b3b-8919-7ca3e265151e None admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:51.670124 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a248870-cf1a-4b3b-8919-7ca3e265151e None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:51.670401 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a248870-cf1a-4b3b-8919-7ca3e265151e None admin] PATH_INFO: `/v3/projects/9847b5e8bc0b4483bbce060a48f405f4/users/22d11b8e390e4b9db3b84c419266c4b2/roles/beeebaa4e16c40f387f05b67124a424d` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:51.685766 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a248870-cf1a-4b3b-8919-7ca3e265151e None admin] RBAC: Authorizing `identity:create_grant(project_id=9847b5e8bc0b4483bbce060a48f405f4, user_id=22d11b8e390e4b9db3b84c419266c4b2, role_id=beeebaa4e16c40f387f05b67124a424d)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:51.687191 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a248870-cf1a-4b3b-8919-7ca3e265151e None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:51.717516 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 416/823] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Jul 21 19:15:51 2022] POST /identity/v3/endpoints => generated 346 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:15:51.718339 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b59bd7-f7a3-4b0b-ba58-6e34ecbf55b4 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:51.761939 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:51.786106 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 408/824] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Jul 21 19:15:51 2022] PUT /identity/v3/projects/9847b5e8bc0b4483bbce060a48f405f4/users/22d11b8e390e4b9db3b84c419266c4b2/roles/beeebaa4e16c40f387f05b67124a424d => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:15:51.787355 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a248870-cf1a-4b3b-8919-7ca3e265151e None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:51.919510 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b59bd7-f7a3-4b0b-ba58-6e34ecbf55b4 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:51.933073 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:51.939540 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a248870-cf1a-4b3b-8919-7ca3e265151e None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:51.968465 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e03a24-0427-4d92-988a-734bbb7bc44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:51.969539 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e03a24-0427-4d92-988a-734bbb7bc44e None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:51.970094 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e03a24-0427-4d92-988a-734bbb7bc44e None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:51.970697 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e03a24-0427-4d92-988a-734bbb7bc44e None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:51.971685 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e03a24-0427-4d92-988a-734bbb7bc44e None admin] RBAC: Adding query filter params (name=network) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:51.972172 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e03a24-0427-4d92-988a-734bbb7bc44e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:51.975244 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e03a24-0427-4d92-988a-734bbb7bc44e None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:51.982821 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 417/825] 10.222.0.60 () {56 vars in 1112 bytes} [Thu Jul 21 19:15:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:51.986761 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e03a24-0427-4d92-988a-734bbb7bc44e None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:51.988917 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c024e866-9497-48d4-be2e-57d12e3a336e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:51.992404 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024e866-9497-48d4-be2e-57d12e3a336e None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:51.992773 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024e866-9497-48d4-be2e-57d12e3a336e None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:51.993137 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024e866-9497-48d4-be2e-57d12e3a336e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:52.007840 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c024e866-9497-48d4-be2e-57d12e3a336e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:52.009406 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c024e866-9497-48d4-be2e-57d12e3a336e None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:52.028523 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-c024e866-9497-48d4-be2e-57d12e3a336e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:52.028523 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:52.028523 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:52.028523 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:52.028523 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:52.028523 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:52.028523 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:52.028523 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:52.028523 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:52.028523 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:52.028523 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:52.028523 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:52.028523 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:52.028523 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:52.028523 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:52.029474 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:52.029474 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:52.029474 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:52.029474 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:52.029474 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:52.029474 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:52.029474 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:52.029474 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:52.029474 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:52.029474 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:52.029474 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:52.029474 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:52.029474 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:52.029474 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:52.029474 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:52.029474 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:52.029474 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:52.030377 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:52.030377 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:52.030377 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:52.030377 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:52.030377 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 409/826] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:52.036434 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c024e866-9497-48d4-be2e-57d12e3a336e None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:52.112621 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e03a24-0427-4d92-988a-734bbb7bc44e None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:52.116001 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:52.152522 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f6215-dccf-40e7-a559-5e7aef7f3f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:52.153534 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f6215-dccf-40e7-a559-5e7aef7f3f7c None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:52.153997 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f6215-dccf-40e7-a559-5e7aef7f3f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:52.154453 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f6215-dccf-40e7-a559-5e7aef7f3f7c None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:52.155337 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f6215-dccf-40e7-a559-5e7aef7f3f7c None admin] RBAC: Adding query filter params (type=network) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:52.155859 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f6215-dccf-40e7-a559-5e7aef7f3f7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:52.158124 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f6215-dccf-40e7-a559-5e7aef7f3f7c None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:52.164304 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 418/827] 10.222.0.60 () {56 vars in 1112 bytes} [Thu Jul 21 19:15:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:52.169445 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f6215-dccf-40e7-a559-5e7aef7f3f7c None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:52.283392 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c024e866-9497-48d4-be2e-57d12e3a336e None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:52.339171 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f6215-dccf-40e7-a559-5e7aef7f3f7c None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:52.353998 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a1344-bf7f-4919-8721-1364499c3138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:52.355296 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a1344-bf7f-4919-8721-1364499c3138 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:52.355776 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a1344-bf7f-4919-8721-1364499c3138 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:52.356227 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a1344-bf7f-4919-8721-1364499c3138 None admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:52.357124 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a1344-bf7f-4919-8721-1364499c3138 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:52.357629 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a1344-bf7f-4919-8721-1364499c3138 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:52.359485 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a1344-bf7f-4919-8721-1364499c3138 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:52.376937 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 410/828] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:52.382524 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a1344-bf7f-4919-8721-1364499c3138 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:52.396109 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:52.412638 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f249a4f0-943a-4b31-a596-5fa553b36ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:52.419068 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249a4f0-943a-4b31-a596-5fa553b36ed5 None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:52.419068 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249a4f0-943a-4b31-a596-5fa553b36ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:52.419068 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249a4f0-943a-4b31-a596-5fa553b36ed5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:52.419068 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f249a4f0-943a-4b31-a596-5fa553b36ed5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:52.419068 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f249a4f0-943a-4b31-a596-5fa553b36ed5 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:52.506593 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a1344-bf7f-4919-8721-1364499c3138 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:52.521573 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 419/829] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Jul 21 19:15:52 2022] POST /identity/v3/endpoints => generated 327 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 19:15:52.559639 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85fcdb9-ddde-4ade-8ab9-fb8d788ba33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:52.560351 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fcdb9-ddde-4ade-8ab9-fb8d788ba33f None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:52.560681 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fcdb9-ddde-4ade-8ab9-fb8d788ba33f None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:52.560964 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fcdb9-ddde-4ade-8ab9-fb8d788ba33f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:52.572748 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85fcdb9-ddde-4ade-8ab9-fb8d788ba33f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:52.574276 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85fcdb9-ddde-4ade-8ab9-fb8d788ba33f None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:52.592632 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-f85fcdb9-ddde-4ade-8ab9-fb8d788ba33f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:15:52.592632 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:52.592632 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:52.592632 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:52.592632 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:52.592632 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:52.592632 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:52.592632 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:52.592632 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:52.592632 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:52.592632 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:52.592632 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:52.592632 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 19:15:52.592632 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 19:15:52.592632 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 19:15:52.593583 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 19:15:52.593583 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:52.593583 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:52.593583 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:52.593583 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:52.593583 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:52.593583 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:52.593583 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:52.593583 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:52.593583 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:52.593583 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:52.593583 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:52.593583 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:52.593583 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:52.593583 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:52.593583 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:52.593583 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:52.594545 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 19:15:52.594545 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 19:15:52.594545 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 19:15:52.594545 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 19:15:52.594545 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 19:15:52.594545 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 19:15:52.594545 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:15:52.594545 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:52.594545 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 411/830] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:15:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:15:52.601371 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f249a4f0-943a-4b31-a596-5fa553b36ed5 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:52.622591 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:52.686814 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b77b7d-50da-42b0-8aa4-ea090bf77936 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:52.687137 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b77b7d-50da-42b0-8aa4-ea090bf77936 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:52.687387 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b77b7d-50da-42b0-8aa4-ea090bf77936 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:52.688851 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 412/831] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 19:15:52.701657 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c17018-1121-4024-b68c-7f9195579d16 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:52.701983 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c17018-1121-4024-b68c-7f9195579d16 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:52.702228 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c17018-1121-4024-b68c-7f9195579d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:52.739304 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f249a4f0-943a-4b31-a596-5fa553b36ed5 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:52.741213 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-51c17018-1121-4024-b68c-7f9195579d16 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:52.742486 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-51c17018-1121-4024-b68c-7f9195579d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:52.784497 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4187cb54-eb53-4249-b0b6-bb9d6110dd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:52.785639 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187cb54-eb53-4249-b0b6-bb9d6110dd8e None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:52.786122 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187cb54-eb53-4249-b0b6-bb9d6110dd8e None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:52.786752 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187cb54-eb53-4249-b0b6-bb9d6110dd8e None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:52.787786 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4187cb54-eb53-4249-b0b6-bb9d6110dd8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:52.791310 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4187cb54-eb53-4249-b0b6-bb9d6110dd8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:52.793073 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4187cb54-eb53-4249-b0b6-bb9d6110dd8e None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:52.817627 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 420/832] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Jul 21 19:15:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:52.824222 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4187cb54-eb53-4249-b0b6-bb9d6110dd8e None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:52.853729 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:52.866828 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 413/833] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:15:52.892484 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c17018-1121-4024-b68c-7f9195579d16 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:52.898972 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:52.930377 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4187cb54-eb53-4249-b0b6-bb9d6110dd8e None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:52.967633 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0a3b1-a6ea-46b3-8645-89e255bc0d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:52.968685 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0a3b1-a6ea-46b3-8645-89e255bc0d2a None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:52.969081 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0a3b1-a6ea-46b3-8645-89e255bc0d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:52.969377 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0a3b1-a6ea-46b3-8645-89e255bc0d2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:52.970212 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b0a3b1-a6ea-46b3-8645-89e255bc0d2a None admin] RBAC: Adding query filter params (role.id=685e18230e1744c581baaf842d0fd4ca, scope.project.id=9847b5e8bc0b4483bbce060a48f405f4, user.id=6b4d98e967814e5f84f5f0d67ebb3c17) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:52.970524 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b0a3b1-a6ea-46b3-8645-89e255bc0d2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:52.971983 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b0a3b1-a6ea-46b3-8645-89e255bc0d2a None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:52.985287 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 421/834] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:15:52 2022] GET /identity/v3/role_assignments?user.id=6b4d98e967814e5f84f5f0d67ebb3c17&scope.project.id=9847b5e8bc0b4483bbce060a48f405f4&role.id=685e18230e1744c581baaf842d0fd4ca => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:15:53.019466 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c17018-1121-4024-b68c-7f9195579d16 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:53.064016 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da505bca-0f1a-438c-b707-80e5cf7f25b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:53.064826 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da505bca-0f1a-438c-b707-80e5cf7f25b0 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:53.065108 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da505bca-0f1a-438c-b707-80e5cf7f25b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:53.065384 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da505bca-0f1a-438c-b707-80e5cf7f25b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:53.078285 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da505bca-0f1a-438c-b707-80e5cf7f25b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:15:53.086666 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-da505bca-0f1a-438c-b707-80e5cf7f25b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:15:53.086666 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:53.086666 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:53.086666 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:53.086666 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:53.086666 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:53.086666 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:53.086666 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:53.086666 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:53.086666 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:53.086666 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:53.086666 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:53.086666 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:15:53.086666 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:15:53.086666 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:15:53.086666 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:15:53.087734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:15:53.087734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:15:53.087734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:15:53.087734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:15:53.087734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:53.087734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:53.087734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:53.087734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:53.087734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:53.087734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:53.087734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:53.087734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:53.087734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:53.087734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:53.087734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:53.087734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:53.088856 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:53.088856 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:53.088856 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:53.088856 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:53.088856 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:15:53.088856 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:15:53.088856 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:15:53.088856 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:15:53.088856 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:15:53.088856 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:15:53.088856 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:15:53.088856 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:53.088856 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 414/835] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Jul 21 19:15:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:53.095983 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0a3b1-a6ea-46b3-8645-89e255bc0d2a None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:53.232149 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0a3b1-a6ea-46b3-8645-89e255bc0d2a None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:53.272457 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44900cd7-8316-4a07-b7e3-79b247c182fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:53.273132 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44900cd7-8316-4a07-b7e3-79b247c182fb None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:53.273413 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44900cd7-8316-4a07-b7e3-79b247c182fb None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:53.273694 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44900cd7-8316-4a07-b7e3-79b247c182fb None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:53.274439 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44900cd7-8316-4a07-b7e3-79b247c182fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:53.274743 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44900cd7-8316-4a07-b7e3-79b247c182fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:53.276142 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44900cd7-8316-4a07-b7e3-79b247c182fb None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:53.278949 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:53.287172 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 422/836] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:15:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:53.293736 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da505bca-0f1a-438c-b707-80e5cf7f25b0 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:53.369629 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:53.415656 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da505bca-0f1a-438c-b707-80e5cf7f25b0 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:53.465522 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f18eb-3128-4752-ae01-e2c37964e532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:53.466321 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f18eb-3128-4752-ae01-e2c37964e532 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:53.466603 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f18eb-3128-4752-ae01-e2c37964e532 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:53.466876 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f18eb-3128-4752-ae01-e2c37964e532 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:53.479945 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2f18eb-3128-4752-ae01-e2c37964e532 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:53.482491 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2f18eb-3128-4752-ae01-e2c37964e532 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:53.502563 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-7b2f18eb-3128-4752-ae01-e2c37964e532 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:53.502563 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:53.502563 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:53.502563 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:53.502563 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:53.502563 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:53.502563 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:53.502563 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:53.502563 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:53.502563 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:53.502563 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:53.502563 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:53.502563 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:53.502563 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:53.502563 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:53.504680 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:53.504680 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:53.504680 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:53.504680 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:53.504680 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:53.504680 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:53.504680 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:53.504680 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:53.504680 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:53.504680 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:53.504680 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:53.504680 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:53.504680 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:53.504680 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:53.504680 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:53.504680 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:53.504680 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:53.506008 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:53.506008 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:53.506008 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:53.506008 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:53.506008 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 415/837] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:53.513514 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44900cd7-8316-4a07-b7e3-79b247c182fb None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:53.634261 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44900cd7-8316-4a07-b7e3-79b247c182fb None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:53.670671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8e0dc-8768-4534-810c-551da673ebcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:53.671351 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8e0dc-8768-4534-810c-551da673ebcf None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:53.671657 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8e0dc-8768-4534-810c-551da673ebcf None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:53.671941 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8e0dc-8768-4534-810c-551da673ebcf None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:53.672682 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8e0dc-8768-4534-810c-551da673ebcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:53.673011 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8e0dc-8768-4534-810c-551da673ebcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:53.674369 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8e0dc-8768-4534-810c-551da673ebcf None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:53.688031 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 423/838] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:53.695037 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f18eb-3128-4752-ae01-e2c37964e532 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:53.815596 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f18eb-3128-4752-ae01-e2c37964e532 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:53.828425 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:53.855401 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b40f0-4ef9-47ba-9b22-68ce67c08877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:53.862836 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b40f0-4ef9-47ba-9b22-68ce67c08877 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:53.862836 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b40f0-4ef9-47ba-9b22-68ce67c08877 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:53.862836 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b40f0-4ef9-47ba-9b22-68ce67c08877 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:53.866070 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b40f0-4ef9-47ba-9b22-68ce67c08877 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:53.867786 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b40f0-4ef9-47ba-9b22-68ce67c08877 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:53.888958 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-eb9b40f0-4ef9-47ba-9b22-68ce67c08877 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 19:15:53.888958 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:53.888958 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:53.888958 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:53.888958 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:53.888958 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:53.888958 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:53.888958 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:53.888958 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:53.888958 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:53.888958 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:53.888958 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:53.888958 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 19:15:53.888958 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 19:15:53.888958 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 19:15:53.888958 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 19:15:53.889999 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:53.889999 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:53.889999 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 19:15:53.889999 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:15:53.889999 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 19:15:53.889999 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:15:53.889999 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:53.889999 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:53.889999 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:53.889999 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:53.889999 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:53.889999 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:53.889999 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:53.889999 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:53.889999 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:53.889999 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:53.889999 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:53.889999 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:53.890947 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:53.890947 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:53.890947 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 19:15:53.890947 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 19:15:53.890947 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 19:15:53.890947 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 19:15:53.890947 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 19:15:53.890947 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 19:15:53.890947 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 19:15:53.890947 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:53.890947 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 416/839] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Jul 21 19:15:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:53.897501 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8e0dc-8768-4534-810c-551da673ebcf None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:53.979835 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:54.019595 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8e0dc-8768-4534-810c-551da673ebcf None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:54.057665 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95100d4-53fd-4e44-8e15-355760855402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:54.058518 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95100d4-53fd-4e44-8e15-355760855402 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:54.058806 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95100d4-53fd-4e44-8e15-355760855402 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:54.059086 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95100d4-53fd-4e44-8e15-355760855402 None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:54.059948 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95100d4-53fd-4e44-8e15-355760855402 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:54.060259 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95100d4-53fd-4e44-8e15-355760855402 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:54.061685 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95100d4-53fd-4e44-8e15-355760855402 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:54.080931 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 424/840] 10.222.0.60 () {56 vars in 1135 bytes} [Thu Jul 21 19:15:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:54.088200 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b40f0-4ef9-47ba-9b22-68ce67c08877 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:54.094025 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d1610-c577-4f33-bb7d-731b0f4e2aaa None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:54.094382 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d1610-c577-4f33-bb7d-731b0f4e2aaa None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:54.094659 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d1610-c577-4f33-bb7d-731b0f4e2aaa None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:54.096202 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 425/841] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 19:15:54.101618 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68b6e6-d782-4c22-8786-2d77eb4e56f3 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:54.101927 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68b6e6-d782-4c22-8786-2d77eb4e56f3 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:54.102191 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68b6e6-d782-4c22-8786-2d77eb4e56f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:54.119668 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-3c68b6e6-d782-4c22-8786-2d77eb4e56f3 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:54.120872 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3c68b6e6-d782-4c22-8786-2d77eb4e56f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:54.207667 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 426/842] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:54 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 19:15:54.227533 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68b6e6-d782-4c22-8786-2d77eb4e56f3 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:54.233007 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b40f0-4ef9-47ba-9b22-68ce67c08877 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:54.280004 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:54.283077 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ed7c6-61fe-46cd-9162-9c42e5d7cb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:54.283913 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ed7c6-61fe-46cd-9162-9c42e5d7cb6e None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:54.284208 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ed7c6-61fe-46cd-9162-9c42e5d7cb6e None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:54.284493 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ed7c6-61fe-46cd-9162-9c42e5d7cb6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:54.327836 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:54.339771 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68b6e6-d782-4c22-8786-2d77eb4e56f3 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:54.376996 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ed7c6-61fe-46cd-9162-9c42e5d7cb6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:54.379422 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0fc62b-d24c-4285-a623-b1f3a7b69bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:54.379829 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ed7c6-61fe-46cd-9162-9c42e5d7cb6e None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:54.381218 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fc62b-d24c-4285-a623-b1f3a7b69bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:54.381681 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fc62b-d24c-4285-a623-b1f3a7b69bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:54.382279 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fc62b-d24c-4285-a623-b1f3a7b69bb1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:54.393898 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0fc62b-d24c-4285-a623-b1f3a7b69bb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:15:54.402186 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-cb0fc62b-d24c-4285-a623-b1f3a7b69bb1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 19:15:54.402186 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:54.402186 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:54.402186 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:54.402186 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:54.402186 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:54.402186 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:54.402186 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:54.402186 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:54.402186 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:54.402186 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:54.402186 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:54.402186 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:15:54.402186 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:15:54.402186 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:15:54.402186 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:15:54.403105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:15:54.403105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:15:54.403105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:15:54.403105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:15:54.403105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:54.403105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:54.403105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:54.403105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:54.403105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:54.403105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:54.403105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:54.403105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:54.403105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:54.403105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:54.403105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:54.403105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:54.403988 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:54.403988 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:54.403988 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:54.403988 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:54.403988 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:15:54.403988 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:15:54.403988 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:15:54.403988 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:15:54.403988 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:15:54.403988 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:15:54.403988 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 19:15:54.403988 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:54.403988 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 427/843] 10.222.0.60 () {56 vars in 1102 bytes} [Thu Jul 21 19:15:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:15:54.405518 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a195f9-e57b-4ad0-8324-5159f29072b2 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:54.405518 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a195f9-e57b-4ad0-8324-5159f29072b2 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:54.405518 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a195f9-e57b-4ad0-8324-5159f29072b2 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:54.406655 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 428/844] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:54.412034 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a195f9-e57b-4ad0-8324-5159f29072b2 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:54.496129 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 417/845] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:15:54 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 19:15:54.497848 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92918f-7d4c-4cb0-aff0-8c1ace27face None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:54.498209 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92918f-7d4c-4cb0-aff0-8c1ace27face None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:54.498555 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92918f-7d4c-4cb0-aff0-8c1ace27face None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:54.516179 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-ea92918f-7d4c-4cb0-aff0-8c1ace27face None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:54.517505 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-ea92918f-7d4c-4cb0-aff0-8c1ace27face None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:54.548074 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a195f9-e57b-4ad0-8324-5159f29072b2 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:54.556850 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:54.584009 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6e599-de2f-461d-8436-e6c791e72e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:54.584681 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6e599-de2f-461d-8436-e6c791e72e1b None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:54.584965 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6e599-de2f-461d-8436-e6c791e72e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:54.585255 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6e599-de2f-461d-8436-e6c791e72e1b None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:54.586042 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c6e599-de2f-461d-8436-e6c791e72e1b None admin] RBAC: Adding query filter params (name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:54.586361 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c6e599-de2f-461d-8436-e6c791e72e1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:54.587782 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c6e599-de2f-461d-8436-e6c791e72e1b None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:54.590499 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:54.603468 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 418/846] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:54 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:15:54.603468 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea92918f-7d4c-4cb0-aff0-8c1ace27face None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:54.603708 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 429/847] 10.222.0.60 () {56 vars in 1103 bytes} [Thu Jul 21 19:15:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:54.604075 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6e599-de2f-461d-8436-e6c791e72e1b None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:54.709414 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6e599-de2f-461d-8436-e6c791e72e1b None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:54.711267 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea92918f-7d4c-4cb0-aff0-8c1ace27face None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:54.745274 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1acb8f2-7faa-49f5-95a2-ecd76ba1f60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:54.746075 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1acb8f2-7faa-49f5-95a2-ecd76ba1f60b None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:54.746406 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1acb8f2-7faa-49f5-95a2-ecd76ba1f60b None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:54.746623 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1acb8f2-7faa-49f5-95a2-ecd76ba1f60b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:54.748518 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afdd2a-c928-42e9-b132-f1a7d3bfa82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:54.749634 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afdd2a-c928-42e9-b132-f1a7d3bfa82d None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:54.749928 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afdd2a-c928-42e9-b132-f1a7d3bfa82d None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:54.750211 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afdd2a-c928-42e9-b132-f1a7d3bfa82d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:54.757605 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1acb8f2-7faa-49f5-95a2-ecd76ba1f60b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:54.759050 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1acb8f2-7faa-49f5-95a2-ecd76ba1f60b None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:54.762830 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90afdd2a-c928-42e9-b132-f1a7d3bfa82d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:54.764316 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90afdd2a-c928-42e9-b132-f1a7d3bfa82d None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:54.777200 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-a1acb8f2-7faa-49f5-95a2-ecd76ba1f60b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:54.777200 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:54.777200 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:54.777200 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:54.777200 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:54.777200 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:54.777200 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:54.777200 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:54.777200 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:54.777200 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:54.777200 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:54.777200 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:54.777200 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:54.777200 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:54.777200 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:54.778097 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:54.778097 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:54.778097 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:54.778097 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:54.778097 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:54.778097 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:54.778097 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:54.778097 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:54.778097 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:54.778097 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:54.778097 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:54.778097 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:54.778097 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:54.778097 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:54.778097 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:54.778097 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:54.778097 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:54.784262 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:54.784262 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:54.784262 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:54.784262 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:54.784262 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 430/848] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:15:54.784262 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1acb8f2-7faa-49f5-95a2-ecd76ba1f60b None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:54.784604 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-90afdd2a-c928-42e9-b132-f1a7d3bfa82d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:54.784604 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:54.784604 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:54.784604 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:54.784604 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:54.784604 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:54.784604 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:54.784604 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:54.784604 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:54.784604 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:54.784604 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:54.784604 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:54.784604 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:54.784604 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:54.784604 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:54.785415 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:54.785415 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:54.785415 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:54.785415 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:54.785415 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:54.785415 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:54.785415 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:54.785415 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:54.785415 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:54.785415 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:54.785415 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:54.785415 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:54.785415 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:54.785415 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:54.785415 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:54.785415 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:54.785415 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:54.786382 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:54.786382 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:54.786382 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:54.786382 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:54.786382 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 419/849] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:54.786382 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afdd2a-c928-42e9-b132-f1a7d3bfa82d None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:54.815696 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:54.844320 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:54.900621 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1acb8f2-7faa-49f5-95a2-ecd76ba1f60b None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:54.902086 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afdd2a-c928-42e9-b132-f1a7d3bfa82d None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:54.939568 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1720428-706c-469c-a126-744d491eb6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:54.940253 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1720428-706c-469c-a126-744d491eb6de None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:54.940537 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1720428-706c-469c-a126-744d491eb6de None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:54.940813 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1720428-706c-469c-a126-744d491eb6de None admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:54.941550 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1720428-706c-469c-a126-744d491eb6de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:54.941855 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1720428-706c-469c-a126-744d491eb6de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:54.943810 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1720428-706c-469c-a126-744d491eb6de None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:54.962188 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 420/850] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:54.962188 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1720428-706c-469c-a126-744d491eb6de None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:55.054999 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0c023-5be1-4f23-9859-439e5d7a065b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:55.055735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0c023-5be1-4f23-9859-439e5d7a065b None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:55.056020 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0c023-5be1-4f23-9859-439e5d7a065b None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:55.056416 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0c023-5be1-4f23-9859-439e5d7a065b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:55.057064 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce0c023-5be1-4f23-9859-439e5d7a065b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:55.058474 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce0c023-5be1-4f23-9859-439e5d7a065b None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:55.069138 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1720428-706c-469c-a126-744d491eb6de None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:55.071286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-fce0c023-5be1-4f23-9859-439e5d7a065b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 19:15:55.071286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:55.071286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 19:15:55.071286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 19:15:55.071286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 19:15:55.071286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 19:15:55.071286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 19:15:55.071286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:15:55.071286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 19:15:55.071286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:55.071286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 19:15:55.071286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:55.071286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:55.071286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:55.071286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:55.071286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:55.071286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:55.072263 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:55.072263 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:55.072263 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:55.072263 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:55.072263 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:55.072263 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:55.072263 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 19:15:55.072263 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 19:15:55.072263 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 19:15:55.072263 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 19:15:55.072263 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:55.072263 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:55.072263 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:55.072263 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:55.072263 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:55.072263 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:55.073174 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:55.073174 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:55.073174 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:55.073174 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:55.073174 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:55.073174 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:55.073174 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:55.073174 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:55.073174 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:55.073174 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:55.073174 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 19:15:55.073174 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:15:55.073174 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 19:15:55.073174 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:55.073174 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 431/851] 10.222.0.60 () {56 vars in 1114 bytes} [Thu Jul 21 19:15:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:55.073951 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0c023-5be1-4f23-9859-439e5d7a065b None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:55.086533 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:55.110432 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619df17-f5ce-44b2-bb29-be0c0672b699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:55.111109 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619df17-f5ce-44b2-bb29-be0c0672b699 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:55.111388 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619df17-f5ce-44b2-bb29-be0c0672b699 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:55.111695 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619df17-f5ce-44b2-bb29-be0c0672b699 None admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:55.112422 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d619df17-f5ce-44b2-bb29-be0c0672b699 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:55.112729 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d619df17-f5ce-44b2-bb29-be0c0672b699 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:55.114091 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d619df17-f5ce-44b2-bb29-be0c0672b699 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:55.127198 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 421/852] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:55.128280 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619df17-f5ce-44b2-bb29-be0c0672b699 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:55.168699 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:55.185429 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0c023-5be1-4f23-9859-439e5d7a065b None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:55.221269 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f0584-9f29-4d7c-80a4-8185baafcf47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:55.222078 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f0584-9f29-4d7c-80a4-8185baafcf47 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:55.222356 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f0584-9f29-4d7c-80a4-8185baafcf47 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:55.222636 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f0584-9f29-4d7c-80a4-8185baafcf47 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:55.230258 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f0584-9f29-4d7c-80a4-8185baafcf47 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:55.231689 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f0584-9f29-4d7c-80a4-8185baafcf47 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:55.246629 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-163f0584-9f29-4d7c-80a4-8185baafcf47 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 19:15:55.246629 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:55.246629 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:55.246629 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:55.246629 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:55.246629 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:55.246629 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:55.246629 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:55.246629 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:55.246629 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:55.246629 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:55.246629 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:55.246629 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 19:15:55.246629 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 19:15:55.246629 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 19:15:55.246629 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 19:15:55.247620 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:55.247620 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:55.247620 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 19:15:55.247620 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:15:55.247620 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 19:15:55.247620 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:15:55.247620 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:55.247620 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:55.247620 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:55.247620 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:55.247620 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:55.247620 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:55.247620 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:55.247620 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:55.247620 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:55.247620 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:55.247620 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:55.247620 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:55.253763 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:55.253763 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:55.253763 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 19:15:55.253763 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 19:15:55.253763 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 19:15:55.253763 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 19:15:55.253763 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 19:15:55.253763 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 19:15:55.253763 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 19:15:55.253763 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:55.254406 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619df17-f5ce-44b2-bb29-be0c0672b699 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:55.254498 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 432/853] 10.222.0.60 () {56 vars in 1117 bytes} [Thu Jul 21 19:15:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:55.254498 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f0584-9f29-4d7c-80a4-8185baafcf47 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:55.288265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100575b-aee4-4cc7-a661-2a9067ab36c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:55.288939 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100575b-aee4-4cc7-a661-2a9067ab36c3 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:55.289221 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100575b-aee4-4cc7-a661-2a9067ab36c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:55.289499 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100575b-aee4-4cc7-a661-2a9067ab36c3 None admin] PATH_INFO: `/v3/services` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:55.290200 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3100575b-aee4-4cc7-a661-2a9067ab36c3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:55.290507 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3100575b-aee4-4cc7-a661-2a9067ab36c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:55.291919 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3100575b-aee4-4cc7-a661-2a9067ab36c3 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:55.296567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 422/854] 10.222.0.60 () {56 vars in 1114 bytes} [Thu Jul 21 19:15:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:55.297329 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100575b-aee4-4cc7-a661-2a9067ab36c3 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:55.332720 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:55.357258 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f0584-9f29-4d7c-80a4-8185baafcf47 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:55.390192 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8946f-c375-4d92-9a63-e02f7a1f41ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:55.390972 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8946f-c375-4d92-9a63-e02f7a1f41ff None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:55.391254 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8946f-c375-4d92-9a63-e02f7a1f41ff None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:55.391560 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8946f-c375-4d92-9a63-e02f7a1f41ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:55.397769 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100575b-aee4-4cc7-a661-2a9067ab36c3 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:55.398216 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a8946f-c375-4d92-9a63-e02f7a1f41ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:55.399614 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a8946f-c375-4d92-9a63-e02f7a1f41ff None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:55.413916 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-e5a8946f-c375-4d92-9a63-e02f7a1f41ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:15:55.413916 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:55.413916 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:55.413916 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:55.413916 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:55.413916 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:55.413916 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:55.413916 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:55.413916 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:55.413916 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:55.413916 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:55.413916 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:55.413916 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 19:15:55.413916 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 19:15:55.413916 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 19:15:55.414790 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 19:15:55.414790 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:55.414790 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:55.414790 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:55.414790 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:55.414790 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:55.414790 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:55.414790 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:55.414790 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:55.414790 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:55.414790 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:55.414790 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:55.414790 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:55.414790 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:55.414790 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:55.414790 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:55.414790 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:55.415991 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 19:15:55.415991 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 19:15:55.415991 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 19:15:55.415991 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 19:15:55.415991 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 19:15:55.415991 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 19:15:55.415991 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:15:55.415991 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:55.415991 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 433/855] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:15:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:55.416476 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef56b72-482f-411b-b454-632123c7c06a None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:55.416543 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef56b72-482f-411b-b454-632123c7c06a None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:55.416778 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef56b72-482f-411b-b454-632123c7c06a None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:55.417999 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 434/856] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:55.418677 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef56b72-482f-411b-b454-632123c7c06a None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:55.425992 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:55.435306 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4649227f-7b11-46ab-b7e8-3c4a3600fc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:55.436027 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649227f-7b11-46ab-b7e8-3c4a3600fc24 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:55.436310 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649227f-7b11-46ab-b7e8-3c4a3600fc24 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:55.437994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649227f-7b11-46ab-b7e8-3c4a3600fc24 None admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:55.437994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4649227f-7b11-46ab-b7e8-3c4a3600fc24 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:55.437994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4649227f-7b11-46ab-b7e8-3c4a3600fc24 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:55.439111 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4649227f-7b11-46ab-b7e8-3c4a3600fc24 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:55.456431 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 423/857] 10.222.0.60 () {56 vars in 1149 bytes} [Thu Jul 21 19:15:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:55.457219 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4649227f-7b11-46ab-b7e8-3c4a3600fc24 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:55.530581 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef56b72-482f-411b-b454-632123c7c06a None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:55.546314 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:55.556451 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4649227f-7b11-46ab-b7e8-3c4a3600fc24 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:55.569829 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943a3b9-f404-4d90-9c07-89adfe5b3525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:55.570875 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943a3b9-f404-4d90-9c07-89adfe5b3525 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:55.571340 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943a3b9-f404-4d90-9c07-89adfe5b3525 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:55.571853 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943a3b9-f404-4d90-9c07-89adfe5b3525 None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:55.572921 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e943a3b9-f404-4d90-9c07-89adfe5b3525 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:55.573431 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e943a3b9-f404-4d90-9c07-89adfe5b3525 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:55.575789 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e943a3b9-f404-4d90-9c07-89adfe5b3525 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:55.595555 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 435/858] 10.222.0.60 () {56 vars in 1114 bytes} [Thu Jul 21 19:15:55 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:55.595555 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a1357-4de3-4fe1-b9bb-29e66653f735 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:55.595555 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a1357-4de3-4fe1-b9bb-29e66653f735 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:55.595555 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a1357-4de3-4fe1-b9bb-29e66653f735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:55.599590 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7cc4d-e6fb-4b76-9efd-8392e550513c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:55.600561 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7cc4d-e6fb-4b76-9efd-8392e550513c None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:55.600849 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7cc4d-e6fb-4b76-9efd-8392e550513c None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:55.601132 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7cc4d-e6fb-4b76-9efd-8392e550513c None admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:55.601942 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e7cc4d-e6fb-4b76-9efd-8392e550513c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:55.602252 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e7cc4d-e6fb-4b76-9efd-8392e550513c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:55.603774 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e7cc4d-e6fb-4b76-9efd-8392e550513c None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:55.613153 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-fc6a1357-4de3-4fe1-b9bb-29e66653f735 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:55.614402 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-fc6a1357-4de3-4fe1-b9bb-29e66653f735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:55.618105 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 424/859] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Jul 21 19:15:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:55.623910 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7cc4d-e6fb-4b76-9efd-8392e550513c None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:55.689505 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:55.696766 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 436/860] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:55 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:15:55.705369 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a1357-4de3-4fe1-b9bb-29e66653f735 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:55.747361 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7cc4d-e6fb-4b76-9efd-8392e550513c None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:55.783165 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da0c77-d3fa-4007-bb46-0ae2987aa95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:55.783847 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da0c77-d3fa-4007-bb46-0ae2987aa95c None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:55.784130 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da0c77-d3fa-4007-bb46-0ae2987aa95c None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:55.784407 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da0c77-d3fa-4007-bb46-0ae2987aa95c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:55.809996 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:55.822593 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a1357-4de3-4fe1-b9bb-29e66653f735 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:55.858473 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30da0c77-d3fa-4007-bb46-0ae2987aa95c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:55.859997 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30da0c77-d3fa-4007-bb46-0ae2987aa95c None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:55.860810 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c6825b-85f7-4e94-bc32-e1923beb5ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:55.861470 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6825b-85f7-4e94-bc32-e1923beb5ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:55.861777 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6825b-85f7-4e94-bc32-e1923beb5ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:55.862020 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6825b-85f7-4e94-bc32-e1923beb5ab3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:55.862840 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c6825b-85f7-4e94-bc32-e1923beb5ab3 None admin] RBAC: Adding query filter params (role.id=685e18230e1744c581baaf842d0fd4ca, scope.project.id=9847b5e8bc0b4483bbce060a48f405f4, user.id=0aa579af53a6441a9205cf82864a640e) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:55.863774 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c6825b-85f7-4e94-bc32-e1923beb5ab3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:55.864627 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c6825b-85f7-4e94-bc32-e1923beb5ab3 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:55.875590 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 437/861] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:15:55 2022] GET /identity/v3/role_assignments?user.id=0aa579af53a6441a9205cf82864a640e&scope.project.id=9847b5e8bc0b4483bbce060a48f405f4&role.id=685e18230e1744c581baaf842d0fd4ca => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:55.877566 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c6825b-85f7-4e94-bc32-e1923beb5ab3 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:55.963335 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:55.975103 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 425/862] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:15:55 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 19:15:55.981589 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da0c77-d3fa-4007-bb46-0ae2987aa95c None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:56.017218 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c6825b-85f7-4e94-bc32-e1923beb5ab3 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:56.046328 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:56.068498 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9973e0-d9bb-4c38-846d-506700a256fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:56.069312 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9973e0-d9bb-4c38-846d-506700a256fe None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:56.069591 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9973e0-d9bb-4c38-846d-506700a256fe None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:56.069862 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9973e0-d9bb-4c38-846d-506700a256fe None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:56.070578 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9973e0-d9bb-4c38-846d-506700a256fe None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:56.071991 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9973e0-d9bb-4c38-846d-506700a256fe None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:56.088186 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-ee9973e0-d9bb-4c38-846d-506700a256fe None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 19:15:56.088186 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:56.088186 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 19:15:56.088186 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 19:15:56.088186 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 19:15:56.088186 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 19:15:56.088186 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 19:15:56.088186 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:15:56.088186 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 19:15:56.088186 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:56.088186 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 19:15:56.088186 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:56.088186 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:56.088186 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:56.088186 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:56.088186 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:56.089163 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:56.089163 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:56.089163 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:56.089163 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:56.089163 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:56.089163 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:56.089163 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:56.089163 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 19:15:56.089163 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 19:15:56.089163 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 19:15:56.089163 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 19:15:56.089163 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:56.089163 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:56.089163 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:56.089163 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:56.089163 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:56.089993 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:56.089993 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:56.089993 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:56.089993 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:56.089993 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:56.089993 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:56.089993 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:56.089993 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:56.089993 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:56.089993 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:56.089993 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:56.089993 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 19:15:56.089993 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:15:56.089993 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 19:15:56.089993 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:15:56.089993 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 438/863] 10.222.0.60 () {56 vars in 1132 bytes} [Thu Jul 21 19:15:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:56.095052 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9973e0-d9bb-4c38-846d-506700a256fe None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:56.096712 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da0c77-d3fa-4007-bb46-0ae2987aa95c None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:56.147165 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc7397-5109-48d1-8240-1677a50470bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:56.148007 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc7397-5109-48d1-8240-1677a50470bf None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:56.148293 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc7397-5109-48d1-8240-1677a50470bf None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:56.149030 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc7397-5109-48d1-8240-1677a50470bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:56.164157 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cc7397-5109-48d1-8240-1677a50470bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:56.166323 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cc7397-5109-48d1-8240-1677a50470bf None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:56.193337 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-70cc7397-5109-48d1-8240-1677a50470bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:56.193337 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:56.193337 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:56.193337 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:56.193337 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:56.193337 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:56.193337 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:56.193337 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:56.193337 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:56.193337 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:56.193337 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:56.193337 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:56.193337 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:56.193337 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:56.193337 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:56.194525 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:56.194525 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:56.194525 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:56.194525 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:56.194525 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:56.194525 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:56.194525 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:56.194525 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:56.194525 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:56.194525 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:56.194525 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:56.194525 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:56.194525 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:56.194525 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:56.194525 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:56.194525 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:56.194525 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:56.196099 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:56.196099 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:56.196099 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:56.196099 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:56.196099 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 426/864] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:56.200558 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc7397-5109-48d1-8240-1677a50470bf None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:56.218705 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9973e0-d9bb-4c38-846d-506700a256fe None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:56.246499 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:56.257100 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81275993-647e-4e07-ba51-fdb951d35a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:56.258075 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81275993-647e-4e07-ba51-fdb951d35a57 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:56.258511 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81275993-647e-4e07-ba51-fdb951d35a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:56.258930 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81275993-647e-4e07-ba51-fdb951d35a57 None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:56.259843 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81275993-647e-4e07-ba51-fdb951d35a57 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:56.260294 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81275993-647e-4e07-ba51-fdb951d35a57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:56.261888 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81275993-647e-4e07-ba51-fdb951d35a57 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:56.267182 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 439/865] 10.222.0.60 () {56 vars in 1126 bytes} [Thu Jul 21 19:15:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:15:56.273640 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81275993-647e-4e07-ba51-fdb951d35a57 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:56.328727 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc7397-5109-48d1-8240-1677a50470bf None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:56.331639 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:56.368160 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7986553-57be-4183-a127-71abf40c395e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:56.369208 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7986553-57be-4183-a127-71abf40c395e None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:56.369712 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7986553-57be-4183-a127-71abf40c395e None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:56.370250 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7986553-57be-4183-a127-71abf40c395e None admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:56.371161 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7986553-57be-4183-a127-71abf40c395e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:56.371692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7986553-57be-4183-a127-71abf40c395e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:56.373432 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7986553-57be-4183-a127-71abf40c395e None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:56.382797 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81275993-647e-4e07-ba51-fdb951d35a57 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:56.387083 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 427/866] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:15:56.394640 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7986553-57be-4183-a127-71abf40c395e None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:56.417779 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d551cae-2443-42ba-8aa0-093a76aff77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:56.418367 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d551cae-2443-42ba-8aa0-093a76aff77a None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:56.418650 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d551cae-2443-42ba-8aa0-093a76aff77a None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:56.418936 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d551cae-2443-42ba-8aa0-093a76aff77a None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:56.419654 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d551cae-2443-42ba-8aa0-093a76aff77a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:56.419963 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d551cae-2443-42ba-8aa0-093a76aff77a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:56.421334 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d551cae-2443-42ba-8aa0-093a76aff77a None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:56.426377 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 440/867] 10.222.0.60 () {56 vars in 1126 bytes} [Thu Jul 21 19:15:56 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:56.515057 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7986553-57be-4183-a127-71abf40c395e None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:56.554342 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37725c52-c8d0-4960-9d54-59369a107cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:56.555154 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37725c52-c8d0-4960-9d54-59369a107cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:56.555461 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37725c52-c8d0-4960-9d54-59369a107cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:56.555739 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37725c52-c8d0-4960-9d54-59369a107cd3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:56.563699 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37725c52-c8d0-4960-9d54-59369a107cd3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:56.565183 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37725c52-c8d0-4960-9d54-59369a107cd3 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:56.581069 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-37725c52-c8d0-4960-9d54-59369a107cd3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:15:56.581069 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:56.581069 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:56.581069 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:56.581069 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:56.581069 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:56.581069 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:56.581069 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:56.581069 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:56.581069 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:56.581069 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:56.581069 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:56.581069 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 19:15:56.581069 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 19:15:56.581069 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 19:15:56.582059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 19:15:56.582059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:56.582059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:56.582059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:56.582059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:56.582059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:56.582059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:56.582059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:56.582059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:56.582059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:56.582059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:56.582059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:56.582059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:56.582059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:56.582059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:56.582059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:56.582059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:56.582999 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 19:15:56.582999 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 19:15:56.582999 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 19:15:56.582999 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 19:15:56.582999 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 19:15:56.582999 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 19:15:56.582999 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:15:56.582999 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:56.582999 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 428/868] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:15:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:56.589861 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d551cae-2443-42ba-8aa0-093a76aff77a None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:56.657087 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:56.703656 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d551cae-2443-42ba-8aa0-093a76aff77a None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:56.740318 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f640cefe-8297-42f9-91e5-09398a1f050b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:56.741390 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640cefe-8297-42f9-91e5-09398a1f050b None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:56.741879 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640cefe-8297-42f9-91e5-09398a1f050b None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:56.742368 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640cefe-8297-42f9-91e5-09398a1f050b None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:56.743414 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f640cefe-8297-42f9-91e5-09398a1f050b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:56.743966 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f640cefe-8297-42f9-91e5-09398a1f050b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:56.745665 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f640cefe-8297-42f9-91e5-09398a1f050b None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:56.763536 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 441/869] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Jul 21 19:15:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:56.768506 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37725c52-c8d0-4960-9d54-59369a107cd3 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:56.794278 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:56.870711 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37725c52-c8d0-4960-9d54-59369a107cd3 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:56.906032 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4507f-0ccb-49eb-898b-8d722727be33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:56.907074 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4507f-0ccb-49eb-898b-8d722727be33 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:56.907593 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4507f-0ccb-49eb-898b-8d722727be33 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:56.908092 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4507f-0ccb-49eb-898b-8d722727be33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:56.909122 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e4507f-0ccb-49eb-898b-8d722727be33 None admin] RBAC: Adding query filter params (role.id=beeebaa4e16c40f387f05b67124a424d, scope.project.id=9847b5e8bc0b4483bbce060a48f405f4, user.id=22d11b8e390e4b9db3b84c419266c4b2) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:56.909637 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e4507f-0ccb-49eb-898b-8d722727be33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:56.911284 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e4507f-0ccb-49eb-898b-8d722727be33 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:56.917679 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 429/870] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:15:56 2022] GET /identity/v3/role_assignments?user.id=22d11b8e390e4b9db3b84c419266c4b2&scope.project.id=9847b5e8bc0b4483bbce060a48f405f4&role.id=beeebaa4e16c40f387f05b67124a424d => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:57.700830 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c00fd-87c0-456b-b180-ba5e46c4bdfb None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:57.701821 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c00fd-87c0-456b-b180-ba5e46c4bdfb None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:57.702326 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c00fd-87c0-456b-b180-ba5e46c4bdfb None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:57.704174 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 442/871] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:57.712608 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189257f-de6f-4093-8b1e-57908cdfe464 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:57.713466 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189257f-de6f-4093-8b1e-57908cdfe464 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:57.713965 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189257f-de6f-4093-8b1e-57908cdfe464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:57.731140 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-0189257f-de6f-4093-8b1e-57908cdfe464 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:57.732703 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-0189257f-de6f-4093-8b1e-57908cdfe464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:57.800270 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 430/872] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:57 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:15:57.823668 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c00fd-87c0-456b-b180-ba5e46c4bdfb None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:57.930332 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c00fd-87c0-456b-b180-ba5e46c4bdfb None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:57.956847 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:57.966305 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a256ac9-1f44-4adc-9961-be6337e8ed43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:57.966981 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a256ac9-1f44-4adc-9961-be6337e8ed43 None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:57.967266 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a256ac9-1f44-4adc-9961-be6337e8ed43 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:57.967571 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a256ac9-1f44-4adc-9961-be6337e8ed43 None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:57.968308 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a256ac9-1f44-4adc-9961-be6337e8ed43 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:57.969682 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a256ac9-1f44-4adc-9961-be6337e8ed43 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:58.076820 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 443/873] 10.222.0.60 () {60 vars in 1141 bytes} [Thu Jul 21 19:15:57 2022] POST /identity/v3/services => generated 251 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:15:58.106382 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695f767-9533-44e7-a2e8-a7ff27355308 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:58.106382 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695f767-9533-44e7-a2e8-a7ff27355308 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:58.106382 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695f767-9533-44e7-a2e8-a7ff27355308 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:58.106382 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 431/874] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:58.112740 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44620e44-c1a1-4770-90fb-ead9b0c6878a None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:58.113418 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44620e44-c1a1-4770-90fb-ead9b0c6878a None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:58.114010 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44620e44-c1a1-4770-90fb-ead9b0c6878a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:58.133703 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-44620e44-c1a1-4770-90fb-ead9b0c6878a None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:58.135315 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-44620e44-c1a1-4770-90fb-ead9b0c6878a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:58.219070 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 444/875] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:58 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:15:58.242675 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695f767-9533-44e7-a2e8-a7ff27355308 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:58.263323 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:58.347792 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695f767-9533-44e7-a2e8-a7ff27355308 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:58.382517 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf8150-a698-4e73-b4e4-e0301472fdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:58.383317 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf8150-a698-4e73-b4e4-e0301472fdc6 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:58.383668 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf8150-a698-4e73-b4e4-e0301472fdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:58.383943 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf8150-a698-4e73-b4e4-e0301472fdc6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:58.384587 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cf8150-a698-4e73-b4e4-e0301472fdc6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:58.385940 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cf8150-a698-4e73-b4e4-e0301472fdc6 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:58.398255 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-b2cf8150-a698-4e73-b4e4-e0301472fdc6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 19:15:58.398255 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:58.398255 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 19:15:58.398255 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 19:15:58.398255 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 19:15:58.398255 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 19:15:58.398255 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 19:15:58.398255 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:15:58.398255 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 19:15:58.398255 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:58.398255 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 19:15:58.398255 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:58.398255 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:58.398255 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:58.398255 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:58.398255 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:58.398255 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:58.399341 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:58.399341 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:58.399341 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:58.399341 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:58.399341 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:58.399341 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:58.399341 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 19:15:58.399341 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 19:15:58.399341 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 19:15:58.399341 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 19:15:58.399341 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:58.399341 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:58.399341 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:58.399341 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:58.399341 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:58.399341 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:58.400296 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:58.400296 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:58.400296 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:58.400296 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:58.400296 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:58.400296 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:58.400296 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:58.400296 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:58.400296 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:58.400296 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:58.400296 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 19:15:58.400296 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:15:58.400296 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 19:15:58.400296 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:58.400296 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 432/876] 10.222.0.60 () {56 vars in 1126 bytes} [Thu Jul 21 19:15:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:58.405823 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44620e44-c1a1-4770-90fb-ead9b0c6878a None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:58.513515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:58.520004 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44620e44-c1a1-4770-90fb-ead9b0c6878a None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:58.556359 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933cb937-c1a1-4b05-857e-f372ff20eef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:58.557027 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933cb937-c1a1-4b05-857e-f372ff20eef7 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:58.557309 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933cb937-c1a1-4b05-857e-f372ff20eef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:58.557580 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933cb937-c1a1-4b05-857e-f372ff20eef7 None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:58.558283 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933cb937-c1a1-4b05-857e-f372ff20eef7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:58.558583 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933cb937-c1a1-4b05-857e-f372ff20eef7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:58.560043 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933cb937-c1a1-4b05-857e-f372ff20eef7 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:58.565188 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 445/877] 10.222.0.60 () {56 vars in 1122 bytes} [Thu Jul 21 19:15:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:58.571336 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf8150-a698-4e73-b4e4-e0301472fdc6 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:58.601976 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb67d35-3ac9-4bb6-ab65-4076af7cf9be None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:58.602317 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb67d35-3ac9-4bb6-ab65-4076af7cf9be None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:58.602511 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb67d35-3ac9-4bb6-ab65-4076af7cf9be None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:58.603926 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 446/878] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 19:15:58.608846 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee7b18-8ac3-4d52-8dc5-1d7da5a6e4f2 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:58.609133 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee7b18-8ac3-4d52-8dc5-1d7da5a6e4f2 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:58.609413 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee7b18-8ac3-4d52-8dc5-1d7da5a6e4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:58.627309 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-95ee7b18-8ac3-4d52-8dc5-1d7da5a6e4f2 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:58.628552 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-95ee7b18-8ac3-4d52-8dc5-1d7da5a6e4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:58.672216 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:58.695355 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf8150-a698-4e73-b4e4-e0301472fdc6 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:58.719532 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 447/879] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:58 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 19:15:58.741619 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c3b97e-8ae4-47ec-9e66-5e5b8ea32700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:58.742274 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee7b18-8ac3-4d52-8dc5-1d7da5a6e4f2 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:58.742444 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3b97e-8ae4-47ec-9e66-5e5b8ea32700 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:58.742615 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3b97e-8ae4-47ec-9e66-5e5b8ea32700 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:58.742836 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3b97e-8ae4-47ec-9e66-5e5b8ea32700 None admin] PATH_INFO: `/v3/services` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:58.743650 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c3b97e-8ae4-47ec-9e66-5e5b8ea32700 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:58.744178 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c3b97e-8ae4-47ec-9e66-5e5b8ea32700 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:58.746495 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c3b97e-8ae4-47ec-9e66-5e5b8ea32700 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:58.752795 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 433/880] 10.222.0.60 () {56 vars in 1122 bytes} [Thu Jul 21 19:15:58 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:58.855620 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:58.862645 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee7b18-8ac3-4d52-8dc5-1d7da5a6e4f2 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:58.903149 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee369b-1811-4e74-8f8f-ac251dc65bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:58.903870 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee369b-1811-4e74-8f8f-ac251dc65bfe None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:58.904159 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee369b-1811-4e74-8f8f-ac251dc65bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:58.904442 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee369b-1811-4e74-8f8f-ac251dc65bfe None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:58.905176 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee369b-1811-4e74-8f8f-ac251dc65bfe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:58.906915 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee369b-1811-4e74-8f8f-ac251dc65bfe None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:59.011466 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 448/881] 10.222.0.60 () {60 vars in 1141 bytes} [Thu Jul 21 19:15:58 2022] POST /identity/v3/services => generated 269 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 19:15:59.103855 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4d064-4682-4e59-b2ad-f726363eb05e None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:59.103855 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4d064-4682-4e59-b2ad-f726363eb05e None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:59.103855 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4d064-4682-4e59-b2ad-f726363eb05e None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:59.105845 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 434/882] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:15:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:15:59.111848 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f84e8-c7da-49b4-b3d5-aedd57260f41 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:59.112460 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f84e8-c7da-49b4-b3d5-aedd57260f41 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:59.112967 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f84e8-c7da-49b4-b3d5-aedd57260f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:59.131529 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-ab9f84e8-c7da-49b4-b3d5-aedd57260f41 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:15:59.133115 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ab9f84e8-c7da-49b4-b3d5-aedd57260f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:15:59.213604 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 449/883] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:15:59 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:15:59.238014 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c4d064-4682-4e59-b2ad-f726363eb05e None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:59.369602 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c4d064-4682-4e59-b2ad-f726363eb05e None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:59.405267 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc74dba1-b5d4-41dd-8149-4a8eb09f2e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:59.406138 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74dba1-b5d4-41dd-8149-4a8eb09f2e66 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:59.406428 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74dba1-b5d4-41dd-8149-4a8eb09f2e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:59.406708 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74dba1-b5d4-41dd-8149-4a8eb09f2e66 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:59.417169 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc74dba1-b5d4-41dd-8149-4a8eb09f2e66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:15:59.425567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-fc74dba1-b5d4-41dd-8149-4a8eb09f2e66 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 19:15:59.425567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:59.425567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:59.425567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:59.425567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:59.425567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:59.425567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:59.425567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:59.425567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:59.425567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:59.425567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:59.425567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:59.425567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:15:59.425567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:15:59.425567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:15:59.425567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:15:59.426510 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:15:59.426510 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:15:59.426510 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:15:59.426510 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:15:59.426510 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:59.426510 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:59.426510 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:59.426510 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:59.426510 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:59.426510 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:59.426510 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:59.426510 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:59.426510 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:59.426510 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:59.426510 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:59.426510 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:59.427393 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:59.427393 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:59.427393 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:59.427393 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:59.427393 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:15:59.427393 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:15:59.427393 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:15:59.427393 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:15:59.427393 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:15:59.427393 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:15:59.427393 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 19:15:59.427393 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:59.427393 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 435/884] 10.222.0.60 () {56 vars in 1120 bytes} [Thu Jul 21 19:15:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:59.435337 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f84e8-c7da-49b4-b3d5-aedd57260f41 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:59.518616 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:59.539327 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f84e8-c7da-49b4-b3d5-aedd57260f41 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:59.575402 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a94afa-2c5b-4051-9721-001ccb5396bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:59.576096 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a94afa-2c5b-4051-9721-001ccb5396bb None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:59.576379 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a94afa-2c5b-4051-9721-001ccb5396bb None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:59.576658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a94afa-2c5b-4051-9721-001ccb5396bb None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:59.577405 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a94afa-2c5b-4051-9721-001ccb5396bb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:59.577710 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a94afa-2c5b-4051-9721-001ccb5396bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:59.579079 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a94afa-2c5b-4051-9721-001ccb5396bb None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:59.588476 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 450/885] 10.222.0.60 () {56 vars in 1115 bytes} [Thu Jul 21 19:15:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:59.593945 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc74dba1-b5d4-41dd-8149-4a8eb09f2e66 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:59.604153 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:15:59.702618 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc74dba1-b5d4-41dd-8149-4a8eb09f2e66 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:59.737880 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0cc41-a240-48ab-a4f9-fe5c3e6c364c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:59.739030 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0cc41-a240-48ab-a4f9-fe5c3e6c364c None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:59.740078 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0cc41-a240-48ab-a4f9-fe5c3e6c364c None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:59.740569 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0cc41-a240-48ab-a4f9-fe5c3e6c364c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:59.751843 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0cc41-a240-48ab-a4f9-fe5c3e6c364c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:59.754010 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0cc41-a240-48ab-a4f9-fe5c3e6c364c None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:59.772194 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-d5c0cc41-a240-48ab-a4f9-fe5c3e6c364c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:59.772194 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:15:59.772194 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:15:59.772194 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:15:59.772194 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:15:59.772194 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:15:59.772194 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:15:59.772194 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:15:59.772194 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:15:59.772194 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:15:59.772194 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:15:59.772194 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:15:59.772194 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:15:59.772194 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:15:59.772194 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:15:59.773153 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:15:59.773153 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:15:59.773153 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:15:59.773153 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:15:59.773153 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:15:59.773153 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:15:59.773153 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:15:59.773153 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:15:59.773153 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:15:59.773153 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:15:59.773153 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:15:59.773153 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:15:59.773153 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:15:59.773153 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:15:59.773153 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:15:59.773153 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:15:59.773153 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:15:59.774057 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:15:59.774057 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:15:59.774057 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:15:59.774057 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:15:59.776294 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 436/886] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:15:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:15:59.782054 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a94afa-2c5b-4051-9721-001ccb5396bb None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:15:59.889662 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a94afa-2c5b-4051-9721-001ccb5396bb None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:15:59.925360 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e4f2b-c344-413a-a233-328621f0d5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:15:59.926418 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e4f2b-c344-413a-a233-328621f0d5d9 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:15:59.928488 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e4f2b-c344-413a-a233-328621f0d5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:15:59.928992 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e4f2b-c344-413a-a233-328621f0d5d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:15:59.929935 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e4f2b-c344-413a-a233-328621f0d5d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:15:59.930459 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e4f2b-c344-413a-a233-328621f0d5d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:15:59.932070 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e4f2b-c344-413a-a233-328621f0d5d9 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:15:59.945264 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 451/887] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:15:59.951072 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0cc41-a240-48ab-a4f9-fe5c3e6c364c None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:00.013190 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:00.058437 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0cc41-a240-48ab-a4f9-fe5c3e6c364c None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:00.094228 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca8938-5e7f-4aca-bd66-bc2873016230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:00.095362 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca8938-5e7f-4aca-bd66-bc2873016230 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:00.095887 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca8938-5e7f-4aca-bd66-bc2873016230 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:00.096381 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca8938-5e7f-4aca-bd66-bc2873016230 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:00.105796 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca8938-5e7f-4aca-bd66-bc2873016230 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:00.107516 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca8938-5e7f-4aca-bd66-bc2873016230 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:00.122645 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-7dca8938-5e7f-4aca-bd66-bc2873016230 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 19:16:00.122645 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:00.122645 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:00.122645 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:00.122645 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:00.122645 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:00.122645 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:00.122645 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:00.122645 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:00.122645 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:00.122645 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:00.122645 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:00.122645 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 19:16:00.122645 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 19:16:00.122645 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 19:16:00.122645 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 19:16:00.123675 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:00.123675 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:00.123675 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 19:16:00.123675 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:16:00.123675 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 19:16:00.123675 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:16:00.123675 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:00.123675 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:00.123675 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:00.123675 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:00.123675 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:00.123675 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:00.123675 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:00.123675 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:00.123675 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:00.123675 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:00.123675 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:00.123675 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:00.124631 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:00.124631 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:00.124631 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 19:16:00.124631 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 19:16:00.124631 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 19:16:00.124631 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 19:16:00.124631 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 19:16:00.124631 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 19:16:00.124631 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 19:16:00.124631 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:16:00.127270 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 437/888] 10.222.0.60 () {56 vars in 1117 bytes} [Thu Jul 21 19:15:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:16:00.133748 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e4f2b-c344-413a-a233-328621f0d5d9 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:00.136849 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:00.244831 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e4f2b-c344-413a-a233-328621f0d5d9 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:00.269102 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c894666-1918-4868-8ef2-f9fcfe0c99a5 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:00.269687 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c894666-1918-4868-8ef2-f9fcfe0c99a5 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:00.270162 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c894666-1918-4868-8ef2-f9fcfe0c99a5 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:00.272950 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 438/889] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:16:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 19:16:00.279887 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3caa3-1db0-476f-82eb-9bfd16e498af None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:00.280468 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3caa3-1db0-476f-82eb-9bfd16e498af None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:00.281073 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3caa3-1db0-476f-82eb-9bfd16e498af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:00.284212 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e5991-06da-4922-8e29-d5bef48a2e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:00.284877 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e5991-06da-4922-8e29-d5bef48a2e49 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:00.285161 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e5991-06da-4922-8e29-d5bef48a2e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:00.285439 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e5991-06da-4922-8e29-d5bef48a2e49 None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:00.286328 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e5991-06da-4922-8e29-d5bef48a2e49 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:00.286635 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e5991-06da-4922-8e29-d5bef48a2e49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:00.288151 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e5991-06da-4922-8e29-d5bef48a2e49 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:00.300839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-45d3caa3-1db0-476f-82eb-9bfd16e498af None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:16:00.303094 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-45d3caa3-1db0-476f-82eb-9bfd16e498af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:16:00.310491 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 452/890] 10.222.0.60 () {56 vars in 1149 bytes} [Thu Jul 21 19:16:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:00.316005 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e5991-06da-4922-8e29-d5bef48a2e49 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:00.376791 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 439/891] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:16:00 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 19:16:00.398982 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:00.401375 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d3caa3-1db0-476f-82eb-9bfd16e498af None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:00.435137 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e5991-06da-4922-8e29-d5bef48a2e49 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:00.463045 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:00.475589 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3d527-410c-4ee1-aa9d-7668c5957b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:00.477363 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3d527-410c-4ee1-aa9d-7668c5957b83 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:00.477363 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3d527-410c-4ee1-aa9d-7668c5957b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:00.477363 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3d527-410c-4ee1-aa9d-7668c5957b83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:00.527195 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d3caa3-1db0-476f-82eb-9bfd16e498af None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:00.554327 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f3d527-410c-4ee1-aa9d-7668c5957b83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:00.556373 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f3d527-410c-4ee1-aa9d-7668c5957b83 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:00.569000 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75e698-edc3-4979-99f2-2b0d23a90dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:00.569811 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75e698-edc3-4979-99f2-2b0d23a90dba None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:00.570095 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75e698-edc3-4979-99f2-2b0d23a90dba None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:00.570396 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75e698-edc3-4979-99f2-2b0d23a90dba None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:00.571009 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75e698-edc3-4979-99f2-2b0d23a90dba None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:00.572390 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75e698-edc3-4979-99f2-2b0d23a90dba None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:00.587472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-bb75e698-edc3-4979-99f2-2b0d23a90dba None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 19:16:00.587472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:00.587472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 19:16:00.587472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 19:16:00.587472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 19:16:00.587472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 19:16:00.587472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 19:16:00.587472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:16:00.587472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 19:16:00.587472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:16:00.587472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 19:16:00.587472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:16:00.587472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:00.587472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:00.587472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:00.587472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:00.587472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:00.588521 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:00.588521 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:00.588521 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:00.588521 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:00.588521 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:00.588521 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:00.588521 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 19:16:00.588521 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 19:16:00.588521 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 19:16:00.588521 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 19:16:00.588521 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:00.588521 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:00.588521 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:00.588521 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:00.588521 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:00.588521 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:00.589369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:00.589369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:00.589369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:00.589369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:00.589369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:00.589369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:00.589369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:00.589369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:00.589369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:00.589369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:00.589369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 19:16:00.589369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:16:00.589369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 19:16:00.589369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:16:00.589369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 440/892] 10.222.0.60 () {56 vars in 1114 bytes} [Thu Jul 21 19:16:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:16:00.596088 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75e698-edc3-4979-99f2-2b0d23a90dba None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:00.629271 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:00.676209 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 453/893] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:16:00 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 19:16:00.682365 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3d527-410c-4ee1-aa9d-7668c5957b83 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:00.732888 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75e698-edc3-4979-99f2-2b0d23a90dba None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:00.748750 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:00.771177 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeca8c7-ac18-48f6-975c-1392be67a8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:00.772671 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeca8c7-ac18-48f6-975c-1392be67a8a0 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:00.773107 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeca8c7-ac18-48f6-975c-1392be67a8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:00.773566 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeca8c7-ac18-48f6-975c-1392be67a8a0 None admin] PATH_INFO: `/v3/services` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:00.774461 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeca8c7-ac18-48f6-975c-1392be67a8a0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:00.774961 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeca8c7-ac18-48f6-975c-1392be67a8a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:00.776753 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeca8c7-ac18-48f6-975c-1392be67a8a0 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:00.788428 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 441/894] 10.222.0.60 () {56 vars in 1114 bytes} [Thu Jul 21 19:16:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:00.789554 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeca8c7-ac18-48f6-975c-1392be67a8a0 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:00.798089 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3d527-410c-4ee1-aa9d-7668c5957b83 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:00.843894 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31e49a-b0fd-49a7-9ede-fabf1da72b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:00.845063 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31e49a-b0fd-49a7-9ede-fabf1da72b5e None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:00.845414 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31e49a-b0fd-49a7-9ede-fabf1da72b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:00.845759 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31e49a-b0fd-49a7-9ede-fabf1da72b5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:00.859304 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31e49a-b0fd-49a7-9ede-fabf1da72b5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:00.861098 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31e49a-b0fd-49a7-9ede-fabf1da72b5e None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:00.883557 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-3c31e49a-b0fd-49a7-9ede-fabf1da72b5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:16:00.883557 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:00.883557 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:00.883557 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:00.883557 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:00.883557 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:00.883557 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:00.883557 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:00.883557 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:00.883557 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:00.883557 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:00.883557 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:00.883557 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:16:00.883557 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:16:00.883557 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:16:00.884522 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:16:00.884522 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:00.884522 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:00.884522 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:00.884522 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:00.884522 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:00.884522 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:00.884522 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:00.884522 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:00.884522 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:00.884522 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:00.884522 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:00.884522 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:00.884522 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:00.884522 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:00.884522 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:00.884522 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:00.885413 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:16:00.885413 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:16:00.885413 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:16:00.885413 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:00.887518 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 454/895] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:16:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:16:00.891337 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31e49a-b0fd-49a7-9ede-fabf1da72b5e None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:00.908997 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:00.910909 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeca8c7-ac18-48f6-975c-1392be67a8a0 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:00.949141 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82931fc6-dde4-45e4-be5e-f2637cae0104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:00.949816 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82931fc6-dde4-45e4-be5e-f2637cae0104 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:00.950125 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82931fc6-dde4-45e4-be5e-f2637cae0104 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:00.950376 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82931fc6-dde4-45e4-be5e-f2637cae0104 None admin] PATH_INFO: `/v3/services` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:00.951087 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82931fc6-dde4-45e4-be5e-f2637cae0104 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:00.951399 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82931fc6-dde4-45e4-be5e-f2637cae0104 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:00.952798 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82931fc6-dde4-45e4-be5e-f2637cae0104 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:00.963139 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 442/896] 10.222.0.60 () {56 vars in 1114 bytes} [Thu Jul 21 19:16:00 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:00.964502 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c06ea2-b9a3-4e00-b719-48736586a593 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:00.964800 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c06ea2-b9a3-4e00-b719-48736586a593 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:00.965086 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c06ea2-b9a3-4e00-b719-48736586a593 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:00.970361 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 443/897] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:16:00.970361 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c06ea2-b9a3-4e00-b719-48736586a593 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:01.011615 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31e49a-b0fd-49a7-9ede-fabf1da72b5e None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:01.012370 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:01.050504 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d706c67-02fa-4254-9397-6e33ceb55747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:01.051114 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d706c67-02fa-4254-9397-6e33ceb55747 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:01.051401 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d706c67-02fa-4254-9397-6e33ceb55747 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:01.051739 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d706c67-02fa-4254-9397-6e33ceb55747 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:01.052476 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d706c67-02fa-4254-9397-6e33ceb55747 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:01.053028 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d706c67-02fa-4254-9397-6e33ceb55747 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:01.054413 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d706c67-02fa-4254-9397-6e33ceb55747 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:01.066449 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 455/898] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:16:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:01.067934 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ca00d-e4f3-4ec4-b41a-890138ab4b56 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:01.068329 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ca00d-e4f3-4ec4-b41a-890138ab4b56 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:01.068611 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ca00d-e4f3-4ec4-b41a-890138ab4b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:01.078836 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c06ea2-b9a3-4e00-b719-48736586a593 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:01.086006 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-338ca00d-e4f3-4ec4-b41a-890138ab4b56 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:16:01.087206 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-338ca00d-e4f3-4ec4-b41a-890138ab4b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:16:01.116076 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc99907c-f873-4b22-9ad3-26cb869afb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:01.116764 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99907c-f873-4b22-9ad3-26cb869afb31 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:01.117050 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99907c-f873-4b22-9ad3-26cb869afb31 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:01.117330 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99907c-f873-4b22-9ad3-26cb869afb31 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:01.118118 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc99907c-f873-4b22-9ad3-26cb869afb31 None admin] RBAC: Adding query filter params (interface=public, service_id=96e424a1f749412993e16e2a7ade3f6b, region_id=RegionOne) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:01.118428 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc99907c-f873-4b22-9ad3-26cb869afb31 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:01.119823 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc99907c-f873-4b22-9ad3-26cb869afb31 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:01.125106 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 444/899] 10.222.0.60 () {56 vars in 1251 bytes} [Thu Jul 21 19:16:00 2022] GET /identity/v3/endpoints?service_id=96e424a1f749412993e16e2a7ade3f6b&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:01.125880 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc99907c-f873-4b22-9ad3-26cb869afb31 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:01.166184 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 456/900] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:16:01 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:16:01.167250 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ca00d-e4f3-4ec4-b41a-890138ab4b56 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:01.170657 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:01.238307 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc99907c-f873-4b22-9ad3-26cb869afb31 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:01.240869 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:01.269879 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ca00d-e4f3-4ec4-b41a-890138ab4b56 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:01.272315 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec581e38-a795-4267-8d4f-3e85c52d3a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:01.273107 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec581e38-a795-4267-8d4f-3e85c52d3a97 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:01.273395 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec581e38-a795-4267-8d4f-3e85c52d3a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:01.273674 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec581e38-a795-4267-8d4f-3e85c52d3a97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:01.280191 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec581e38-a795-4267-8d4f-3e85c52d3a97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:01.281629 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec581e38-a795-4267-8d4f-3e85c52d3a97 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:01.295746 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-ec581e38-a795-4267-8d4f-3e85c52d3a97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:16:01.295746 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:01.295746 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:01.295746 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:01.295746 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:01.295746 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:01.295746 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:01.295746 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:01.295746 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:01.295746 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:01.295746 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:01.295746 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:01.295746 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 19:16:01.295746 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 19:16:01.295746 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 19:16:01.296680 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 19:16:01.296680 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:01.296680 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:01.296680 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:01.296680 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:01.296680 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:01.296680 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:01.296680 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:01.296680 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:01.296680 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:01.296680 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:01.296680 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:01.296680 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:01.296680 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:01.296680 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:01.296680 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:01.296680 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:01.297679 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 19:16:01.297679 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 19:16:01.297679 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 19:16:01.297679 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 19:16:01.297679 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 19:16:01.297679 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 19:16:01.297679 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:16:01.297679 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:16:01.297679 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 445/901] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:16:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:16:01.298534 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf08e72-dc44-482c-84f7-64c613098412 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:01.298534 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf08e72-dc44-482c-84f7-64c613098412 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:01.298805 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf08e72-dc44-482c-84f7-64c613098412 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:01.303652 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 446/902] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:16:01.303652 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf08e72-dc44-482c-84f7-64c613098412 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:01.309105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e7329-4378-4418-be9a-05984441a849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:01.309770 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e7329-4378-4418-be9a-05984441a849 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:01.310054 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e7329-4378-4418-be9a-05984441a849 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:01.310328 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e7329-4378-4418-be9a-05984441a849 None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:01.311009 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e7329-4378-4418-be9a-05984441a849 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:01.312411 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e7329-4378-4418-be9a-05984441a849 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:01.318484 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 457/903] 10.222.0.60 () {56 vars in 1087 bytes} [Thu Jul 21 19:16:01 2022] GET /identity/v3/services => generated 1268 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:16:01.319244 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e7329-4378-4418-be9a-05984441a849 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:01.413588 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:01.415207 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf08e72-dc44-482c-84f7-64c613098412 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:01.458684 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e7329-4378-4418-be9a-05984441a849 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:01.462084 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5815cec-5481-43e6-ba5b-7940cd9a806a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:01.462773 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5815cec-5481-43e6-ba5b-7940cd9a806a None admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:01.463059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5815cec-5481-43e6-ba5b-7940cd9a806a None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:01.463337 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5815cec-5481-43e6-ba5b-7940cd9a806a None admin] PATH_INFO: `/v3/services` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:01.464120 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5815cec-5481-43e6-ba5b-7940cd9a806a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:01.465470 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5815cec-5481-43e6-ba5b-7940cd9a806a None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:01.493901 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a746f05-dbd0-4504-b9a9-ac531514dc5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:01.494561 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a746f05-dbd0-4504-b9a9-ac531514dc5c None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:01.494843 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a746f05-dbd0-4504-b9a9-ac531514dc5c None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:01.495121 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a746f05-dbd0-4504-b9a9-ac531514dc5c None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:01.495957 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a746f05-dbd0-4504-b9a9-ac531514dc5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:01.496268 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a746f05-dbd0-4504-b9a9-ac531514dc5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:01.497682 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a746f05-dbd0-4504-b9a9-ac531514dc5c None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:01.510111 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 458/904] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Jul 21 19:16:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:01.511348 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bacb0e-37b0-49f5-a7bf-aeac85f61041 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:01.511681 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bacb0e-37b0-49f5-a7bf-aeac85f61041 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:01.511957 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bacb0e-37b0-49f5-a7bf-aeac85f61041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:01.528312 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-37bacb0e-37b0-49f5-a7bf-aeac85f61041 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:16:01.529483 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-37bacb0e-37b0-49f5-a7bf-aeac85f61041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:16:01.544245 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 447/905] 10.222.0.60 () {60 vars in 1141 bytes} [Thu Jul 21 19:16:01 2022] POST /identity/v3/services => generated 241 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:16:01.551576 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5815cec-5481-43e6-ba5b-7940cd9a806a None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:01.583095 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:01.635123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 459/906] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:16:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:16:01.663563 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bacb0e-37b0-49f5-a7bf-aeac85f61041 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:01.682306 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5815cec-5481-43e6-ba5b-7940cd9a806a None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:01.728907 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0d693-f13d-4689-a3c5-e4cbbc6303f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:01.729576 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0d693-f13d-4689-a3c5-e4cbbc6303f9 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:01.729861 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0d693-f13d-4689-a3c5-e4cbbc6303f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:01.730141 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0d693-f13d-4689-a3c5-e4cbbc6303f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:01.730976 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf0d693-f13d-4689-a3c5-e4cbbc6303f9 None admin] RBAC: Adding query filter params (role.id=09fd90e2b50d4b809ba2614d2d228a4c, scope.project.id=9847b5e8bc0b4483bbce060a48f405f4, user.id=22d11b8e390e4b9db3b84c419266c4b2) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:01.731300 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf0d693-f13d-4689-a3c5-e4cbbc6303f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:01.732764 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf0d693-f13d-4689-a3c5-e4cbbc6303f9 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:01.740098 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:01.740747 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 448/907] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:16:01 2022] GET /identity/v3/role_assignments?user.id=22d11b8e390e4b9db3b84c419266c4b2&scope.project.id=9847b5e8bc0b4483bbce060a48f405f4&role.id=09fd90e2b50d4b809ba2614d2d228a4c => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:01.811831 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bacb0e-37b0-49f5-a7bf-aeac85f61041 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:01.850373 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36dee0-f949-4648-b6f4-8306cc67984a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:01.851123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36dee0-f949-4648-b6f4-8306cc67984a None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:01.851407 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36dee0-f949-4648-b6f4-8306cc67984a None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:01.851710 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36dee0-f949-4648-b6f4-8306cc67984a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:01.852379 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b36dee0-f949-4648-b6f4-8306cc67984a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:01.853778 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b36dee0-f949-4648-b6f4-8306cc67984a None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:01.867289 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-2b36dee0-f949-4648-b6f4-8306cc67984a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 19:16:01.867289 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:01.867289 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 19:16:01.867289 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 19:16:01.867289 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 19:16:01.867289 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 19:16:01.867289 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 19:16:01.867289 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:16:01.867289 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 19:16:01.867289 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:01.867289 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 19:16:01.867289 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:01.867289 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:01.867289 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:01.867289 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:01.867289 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:01.868346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:01.868346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:01.868346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:01.868346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:01.868346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:01.868346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:01.868346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:01.868346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 19:16:01.868346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 19:16:01.868346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 19:16:01.868346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 19:16:01.868346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:01.868346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:01.868346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:01.868346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:01.868346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:01.869185 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:01.869185 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:01.869185 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:01.869185 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:01.869185 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:01.869185 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:01.869185 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:01.869185 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:01.869185 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:01.869185 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:01.869185 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:01.869185 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 19:16:01.869185 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:16:01.869185 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 19:16:01.869185 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:01.869185 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 460/908] 10.222.0.60 () {56 vars in 1132 bytes} [Thu Jul 21 19:16:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:16:01.875560 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0d693-f13d-4689-a3c5-e4cbbc6303f9 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:01.977227 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:01.990316 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0d693-f13d-4689-a3c5-e4cbbc6303f9 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:02.026459 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e5b9e-a89c-453a-aa08-ffa37d41710a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:02.027129 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e5b9e-a89c-453a-aa08-ffa37d41710a None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:02.028790 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e5b9e-a89c-453a-aa08-ffa37d41710a None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:02.029075 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e5b9e-a89c-453a-aa08-ffa37d41710a None admin] PATH_INFO: `/v3/services` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:02.029789 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e5b9e-a89c-453a-aa08-ffa37d41710a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:02.030095 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e5b9e-a89c-453a-aa08-ffa37d41710a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:02.031476 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e5b9e-a89c-453a-aa08-ffa37d41710a None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:02.037637 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 449/909] 10.222.0.60 () {56 vars in 1126 bytes} [Thu Jul 21 19:16:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:02.043125 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36dee0-f949-4648-b6f4-8306cc67984a None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:02.152937 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36dee0-f949-4648-b6f4-8306cc67984a None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:02.169928 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:02.188174 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78ce81a-af4c-4543-aeb1-06db257d2d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:02.188837 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ce81a-af4c-4543-aeb1-06db257d2d0f None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:02.189118 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ce81a-af4c-4543-aeb1-06db257d2d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:02.189392 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ce81a-af4c-4543-aeb1-06db257d2d0f None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:02.190281 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78ce81a-af4c-4543-aeb1-06db257d2d0f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:02.190589 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78ce81a-af4c-4543-aeb1-06db257d2d0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:02.192068 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78ce81a-af4c-4543-aeb1-06db257d2d0f None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:02.198390 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 461/910] 10.222.0.60 () {56 vars in 1126 bytes} [Thu Jul 21 19:16:02 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:02.205380 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e5b9e-a89c-453a-aa08-ffa37d41710a None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:02.313775 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e5b9e-a89c-453a-aa08-ffa37d41710a None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:02.350231 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee7946-84f9-4892-8166-648c479c43c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:02.350898 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee7946-84f9-4892-8166-648c479c43c3 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:02.351178 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee7946-84f9-4892-8166-648c479c43c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:02.351472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee7946-84f9-4892-8166-648c479c43c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:02.352264 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee7946-84f9-4892-8166-648c479c43c3 None admin] RBAC: Adding query filter params (interface=public, service_id=c27ba8098d1d4a17bf8dc8958c68ad77, region_id=RegionOne) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:02.352576 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee7946-84f9-4892-8166-648c479c43c3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:02.353938 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee7946-84f9-4892-8166-648c479c43c3 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:02.359614 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 450/911] 10.222.0.60 () {56 vars in 1251 bytes} [Thu Jul 21 19:16:02 2022] GET /identity/v3/endpoints?service_id=c27ba8098d1d4a17bf8dc8958c68ad77&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:02.368543 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78ce81a-af4c-4543-aeb1-06db257d2d0f None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:02.473524 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78ce81a-af4c-4543-aeb1-06db257d2d0f None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:02.509444 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa20f751-fce5-4938-927e-fd4c8309056d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:02.510110 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20f751-fce5-4938-927e-fd4c8309056d None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:02.510392 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20f751-fce5-4938-927e-fd4c8309056d None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:02.510663 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20f751-fce5-4938-927e-fd4c8309056d None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:02.511337 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa20f751-fce5-4938-927e-fd4c8309056d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:02.512734 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa20f751-fce5-4938-927e-fd4c8309056d None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:02.519135 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 462/912] 10.222.0.60 () {56 vars in 1087 bytes} [Thu Jul 21 19:16:02 2022] GET /identity/v3/services => generated 1497 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:16:03.479219 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8882c9-2a0b-47a8-b1f8-380ba5aa2585 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:03.479791 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8882c9-2a0b-47a8-b1f8-380ba5aa2585 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:03.480038 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8882c9-2a0b-47a8-b1f8-380ba5aa2585 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:03.481744 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 451/913] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:16:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:16:03.486943 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3045da-c3c2-4abc-8045-127f2ad15edb None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:03.487355 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3045da-c3c2-4abc-8045-127f2ad15edb None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:03.487714 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3045da-c3c2-4abc-8045-127f2ad15edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:03.505085 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-ee3045da-c3c2-4abc-8045-127f2ad15edb None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:16:03.506255 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ee3045da-c3c2-4abc-8045-127f2ad15edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:16:03.547673 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:03.577569 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 463/914] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:16:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:16:03.600908 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8882c9-2a0b-47a8-b1f8-380ba5aa2585 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:03.620312 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:03.707590 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159f47a-15b1-41b8-9834-d108f697698d None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:03.707814 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159f47a-15b1-41b8-9834-d108f697698d None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:03.708098 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159f47a-15b1-41b8-9834-d108f697698d None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:03.709711 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 464/915] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:16:03.709889 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8882c9-2a0b-47a8-b1f8-380ba5aa2585 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:03.717183 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b560d-85d0-41c6-bf25-3effb7249416 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:03.717467 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b560d-85d0-41c6-bf25-3effb7249416 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:03.717745 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b560d-85d0-41c6-bf25-3effb7249416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:03.739810 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-f23b560d-85d0-41c6-bf25-3effb7249416 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:16:03.741436 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f23b560d-85d0-41c6-bf25-3effb7249416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:16:03.750972 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedbe510-e78a-4f6b-a030-b46847e6c043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:03.751803 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedbe510-e78a-4f6b-a030-b46847e6c043 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:03.752091 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedbe510-e78a-4f6b-a030-b46847e6c043 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:03.752368 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedbe510-e78a-4f6b-a030-b46847e6c043 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:03.753017 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedbe510-e78a-4f6b-a030-b46847e6c043 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:03.754385 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedbe510-e78a-4f6b-a030-b46847e6c043 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:03.766693 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-bedbe510-e78a-4f6b-a030-b46847e6c043 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 19:16:03.766693 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:03.766693 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 19:16:03.766693 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 19:16:03.766693 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 19:16:03.766693 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 19:16:03.766693 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 19:16:03.766693 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:16:03.766693 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 19:16:03.766693 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:16:03.766693 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 19:16:03.766693 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:16:03.766693 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:03.766693 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:03.766693 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:03.766693 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:03.766693 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:03.767722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:03.767722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:03.767722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:03.767722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:03.767722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:03.767722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:03.767722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 19:16:03.767722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 19:16:03.767722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 19:16:03.767722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 19:16:03.767722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:03.767722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:03.767722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:03.767722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:03.767722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:03.767722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:03.768576 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:03.768576 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:03.768576 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:03.768576 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:03.768576 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:03.768576 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:03.768576 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:03.768576 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:03.768576 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:03.768576 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:03.768576 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 19:16:03.768576 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:16:03.768576 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 19:16:03.768576 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:16:03.768576 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 452/916] 10.222.0.60 () {56 vars in 1114 bytes} [Thu Jul 21 19:16:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:16:03.774400 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedbe510-e78a-4f6b-a030-b46847e6c043 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:03.831534 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 465/917] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:16:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:16:03.847806 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b560d-85d0-41c6-bf25-3effb7249416 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:03.880202 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:03.900864 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedbe510-e78a-4f6b-a030-b46847e6c043 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:03.936275 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1d670-27c6-4d1e-8187-d4e191424017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:03.936936 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1d670-27c6-4d1e-8187-d4e191424017 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:03.937218 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1d670-27c6-4d1e-8187-d4e191424017 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:03.937498 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1d670-27c6-4d1e-8187-d4e191424017 None admin] PATH_INFO: `/v3/services` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:03.938189 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c1d670-27c6-4d1e-8187-d4e191424017 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:03.938493 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c1d670-27c6-4d1e-8187-d4e191424017 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:03.939903 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c1d670-27c6-4d1e-8187-d4e191424017 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:03.947476 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 453/918] 10.222.0.60 () {56 vars in 1114 bytes} [Thu Jul 21 19:16:03 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:16:03.947476 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccf859-b249-4e37-9c63-37ba751fb021 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:03.947476 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccf859-b249-4e37-9c63-37ba751fb021 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:03.947476 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccf859-b249-4e37-9c63-37ba751fb021 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:03.951685 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 454/919] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:16:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:16:03.953050 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ccf859-b249-4e37-9c63-37ba751fb021 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:03.958882 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b560d-85d0-41c6-bf25-3effb7249416 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:03.962100 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:03.995832 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d0216-a108-4421-91d5-7c5b259f753f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:03.996645 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d0216-a108-4421-91d5-7c5b259f753f None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:03.996929 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d0216-a108-4421-91d5-7c5b259f753f None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:03.997209 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d0216-a108-4421-91d5-7c5b259f753f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:03.997944 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d0216-a108-4421-91d5-7c5b259f753f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:04.000012 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d0216-a108-4421-91d5-7c5b259f753f None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:04.013278 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-3a9d0216-a108-4421-91d5-7c5b259f753f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 19:16:04.013278 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:04.013278 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 19:16:04.013278 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 19:16:04.013278 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 19:16:04.013278 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 19:16:04.013278 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 19:16:04.013278 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:16:04.013278 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 19:16:04.013278 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:04.013278 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 19:16:04.013278 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:04.013278 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:04.013278 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:04.013278 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:04.013278 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:04.013278 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:04.014466 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:04.014466 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:04.014466 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:04.014466 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:04.014466 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:04.014466 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:04.014466 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 19:16:04.014466 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 19:16:04.014466 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 19:16:04.014466 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 19:16:04.014466 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:04.014466 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:04.014466 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:04.014466 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:04.014466 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:04.014466 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:04.015480 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:04.015480 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:04.015480 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:04.015480 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:04.015480 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:04.015480 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:04.015480 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:04.015480 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:04.015480 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:04.015480 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:04.015480 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 19:16:04.015480 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:16:04.015480 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 19:16:04.015480 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:04.015480 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 466/920] 10.222.0.60 () {56 vars in 1126 bytes} [Thu Jul 21 19:16:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:16:04.020529 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ecdee-525f-44ac-b744-5f01e7921cd9 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:04.020819 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ecdee-525f-44ac-b744-5f01e7921cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:04.021250 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ecdee-525f-44ac-b744-5f01e7921cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:04.044578 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-5c0ecdee-525f-44ac-b744-5f01e7921cd9 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:16:04.046373 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-5c0ecdee-525f-44ac-b744-5f01e7921cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:16:04.065643 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ccf859-b249-4e37-9c63-37ba751fb021 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:04.103825 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026ec84-af2c-4bc6-8bbc-434c0c4812e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:04.104740 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026ec84-af2c-4bc6-8bbc-434c0c4812e1 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:04.105026 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026ec84-af2c-4bc6-8bbc-434c0c4812e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:04.105305 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026ec84-af2c-4bc6-8bbc-434c0c4812e1 None admin] PATH_INFO: `/v3/services` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:04.106006 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3026ec84-af2c-4bc6-8bbc-434c0c4812e1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:04.106316 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3026ec84-af2c-4bc6-8bbc-434c0c4812e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:04.107704 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3026ec84-af2c-4bc6-8bbc-434c0c4812e1 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:04.112789 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 455/921] 10.222.0.60 () {56 vars in 1114 bytes} [Thu Jul 21 19:16:03 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:04.113811 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026ec84-af2c-4bc6-8bbc-434c0c4812e1 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:04.122754 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 467/922] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:16:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:16:04.123613 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0ecdee-525f-44ac-b744-5f01e7921cd9 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:04.129388 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:04.221802 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026ec84-af2c-4bc6-8bbc-434c0c4812e1 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:04.231746 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:04.235539 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0ecdee-525f-44ac-b744-5f01e7921cd9 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:04.257531 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163e62a-8fc4-407f-82cb-3420b90d9744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:04.258207 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163e62a-8fc4-407f-82cb-3420b90d9744 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:04.258494 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163e62a-8fc4-407f-82cb-3420b90d9744 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:04.258774 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163e62a-8fc4-407f-82cb-3420b90d9744 None admin] PATH_INFO: `/v3/services` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:04.259501 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b163e62a-8fc4-407f-82cb-3420b90d9744 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:04.259815 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b163e62a-8fc4-407f-82cb-3420b90d9744 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:04.261176 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b163e62a-8fc4-407f-82cb-3420b90d9744 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:04.270681 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 456/923] 10.222.0.60 () {56 vars in 1122 bytes} [Thu Jul 21 19:16:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:04.270681 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163e62a-8fc4-407f-82cb-3420b90d9744 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:04.279406 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed854e3-fa5b-4a06-aa1b-3927fe5b241c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:04.280190 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed854e3-fa5b-4a06-aa1b-3927fe5b241c None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:04.280391 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed854e3-fa5b-4a06-aa1b-3927fe5b241c None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:04.280641 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed854e3-fa5b-4a06-aa1b-3927fe5b241c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:04.281379 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed854e3-fa5b-4a06-aa1b-3927fe5b241c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:04.282801 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed854e3-fa5b-4a06-aa1b-3927fe5b241c None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:04.339789 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:04.356219 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 468/924] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Jul 21 19:16:04 2022] POST /identity/v3/endpoints => generated 346 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:16:04.357324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed854e3-fa5b-4a06-aa1b-3927fe5b241c None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:04.387002 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163e62a-8fc4-407f-82cb-3420b90d9744 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:04.447453 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff5e21-a154-4dbf-b85e-0dda6a79f3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:04.448905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff5e21-a154-4dbf-b85e-0dda6a79f3c2 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:04.449530 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff5e21-a154-4dbf-b85e-0dda6a79f3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:04.450016 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff5e21-a154-4dbf-b85e-0dda6a79f3c2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:04.462987 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff5e21-a154-4dbf-b85e-0dda6a79f3c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:16:04.472590 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-83ff5e21-a154-4dbf-b85e-0dda6a79f3c2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 19:16:04.472590 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:04.472590 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:04.472590 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:04.472590 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:04.472590 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:04.472590 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:04.472590 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:04.472590 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:04.472590 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:04.472590 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:04.472590 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:04.472590 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:16:04.472590 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:16:04.472590 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:16:04.472590 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:16:04.474064 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:16:04.474064 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:16:04.474064 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:16:04.474064 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:16:04.474064 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:04.474064 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:04.474064 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:04.474064 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:04.474064 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:04.474064 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:04.474064 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:04.474064 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:04.474064 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:04.474064 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:04.474064 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:04.474064 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:04.474920 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:04.474920 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:04.474920 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:04.474920 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:04.474920 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:16:04.474920 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:16:04.474920 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:16:04.474920 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:16:04.474920 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:16:04.474920 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:16:04.474920 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 19:16:04.474920 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:16:04.477918 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 457/925] 10.222.0.60 () {56 vars in 1120 bytes} [Thu Jul 21 19:16:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:16:04.486633 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff5e21-a154-4dbf-b85e-0dda6a79f3c2 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:04.487265 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed854e3-fa5b-4a06-aa1b-3927fe5b241c None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:04.534341 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023c253-93bc-4423-908b-35e5b418a647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:04.535016 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023c253-93bc-4423-908b-35e5b418a647 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:04.535301 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023c253-93bc-4423-908b-35e5b418a647 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:04.535612 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023c253-93bc-4423-908b-35e5b418a647 None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:04.536874 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e023c253-93bc-4423-908b-35e5b418a647 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:04.537666 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e023c253-93bc-4423-908b-35e5b418a647 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:04.539465 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e023c253-93bc-4423-908b-35e5b418a647 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:04.546109 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 469/926] 10.222.0.60 () {56 vars in 1122 bytes} [Thu Jul 21 19:16:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:04.552333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023c253-93bc-4423-908b-35e5b418a647 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:04.584942 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:04.609505 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff5e21-a154-4dbf-b85e-0dda6a79f3c2 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:04.644408 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:04.652847 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324a40b-8b2b-43ce-ab0e-b6690713ccf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:04.653522 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324a40b-8b2b-43ce-ab0e-b6690713ccf5 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:04.653809 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324a40b-8b2b-43ce-ab0e-b6690713ccf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:04.654114 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324a40b-8b2b-43ce-ab0e-b6690713ccf5 None admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:04.654826 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1324a40b-8b2b-43ce-ab0e-b6690713ccf5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:04.655137 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1324a40b-8b2b-43ce-ab0e-b6690713ccf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:04.656588 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1324a40b-8b2b-43ce-ab0e-b6690713ccf5 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:04.665790 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 458/927] 10.222.0.60 () {56 vars in 1115 bytes} [Thu Jul 21 19:16:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:04.667047 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c833e0-fda0-431b-aef1-e6bb1db4b613 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:04.667366 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c833e0-fda0-431b-aef1-e6bb1db4b613 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:04.667651 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c833e0-fda0-431b-aef1-e6bb1db4b613 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:04.672839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 459/928] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:16:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:16:04.672839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c833e0-fda0-431b-aef1-e6bb1db4b613 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:04.686424 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023c253-93bc-4423-908b-35e5b418a647 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:04.724183 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d362e-57a0-460c-befc-b4e3df18a75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:04.724771 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d362e-57a0-460c-befc-b4e3df18a75f None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:04.725058 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d362e-57a0-460c-befc-b4e3df18a75f None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:04.725341 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d362e-57a0-460c-befc-b4e3df18a75f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:04.726238 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d362e-57a0-460c-befc-b4e3df18a75f None admin] RBAC: Adding query filter params (interface=public, service_id=7ac6201f307042eca89604fe91cd76b3, region_id=RegionOne) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:04.726429 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d362e-57a0-460c-befc-b4e3df18a75f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:04.727821 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d362e-57a0-460c-befc-b4e3df18a75f None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:04.735706 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 470/929] 10.222.0.60 () {56 vars in 1251 bytes} [Thu Jul 21 19:16:04 2022] GET /identity/v3/endpoints?service_id=7ac6201f307042eca89604fe91cd76b3&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:16:04.736847 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fb372-0f2b-4fcf-8468-bd8ac9d698e6 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:04.737139 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fb372-0f2b-4fcf-8468-bd8ac9d698e6 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:04.737419 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fb372-0f2b-4fcf-8468-bd8ac9d698e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:04.755199 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-219fb372-0f2b-4fcf-8468-bd8ac9d698e6 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:16:04.756414 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-219fb372-0f2b-4fcf-8468-bd8ac9d698e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:16:04.785054 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c833e0-fda0-431b-aef1-e6bb1db4b613 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:04.823192 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691024d9-da92-4bc3-a695-c9e124f9b49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:04.824328 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691024d9-da92-4bc3-a695-c9e124f9b49b None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:04.824611 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691024d9-da92-4bc3-a695-c9e124f9b49b None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:04.824884 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691024d9-da92-4bc3-a695-c9e124f9b49b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:04.827681 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 471/930] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:16:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:16:04.828578 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219fb372-0f2b-4fcf-8468-bd8ac9d698e6 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:04.843401 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:04.848506 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691024d9-da92-4bc3-a695-c9e124f9b49b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:04.850307 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691024d9-da92-4bc3-a695-c9e124f9b49b None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:04.874299 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-691024d9-da92-4bc3-a695-c9e124f9b49b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:16:04.874299 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:04.874299 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:04.874299 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:04.874299 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:04.874299 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:04.874299 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:04.874299 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:04.874299 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:04.874299 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:04.874299 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:04.874299 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:04.874299 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:16:04.874299 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:16:04.874299 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:16:04.875265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:16:04.875265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:04.875265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:04.875265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:04.875265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:04.875265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:04.875265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:04.875265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:04.875265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:04.875265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:04.875265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:04.875265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:04.875265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:04.875265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:04.875265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:04.875265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:04.875265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:04.876657 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:16:04.876657 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:16:04.876657 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:16:04.876657 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:16:04.876657 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 460/931] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:16:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:16:04.876940 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691024d9-da92-4bc3-a695-c9e124f9b49b None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:04.925985 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:04.941706 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219fb372-0f2b-4fcf-8468-bd8ac9d698e6 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:04.983217 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12257ab-6182-4ce2-bdc1-092cc8341e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:04.983847 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12257ab-6182-4ce2-bdc1-092cc8341e38 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:04.984132 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12257ab-6182-4ce2-bdc1-092cc8341e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:04.984411 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12257ab-6182-4ce2-bdc1-092cc8341e38 None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:04.985097 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12257ab-6182-4ce2-bdc1-092cc8341e38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:04.986469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12257ab-6182-4ce2-bdc1-092cc8341e38 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:04.988716 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691024d9-da92-4bc3-a695-c9e124f9b49b None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:05.003502 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 472/932] 10.222.0.60 () {56 vars in 1087 bytes} [Thu Jul 21 19:16:04 2022] GET /identity/v3/services => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:16:05.003502 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12257ab-6182-4ce2-bdc1-092cc8341e38 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:05.032174 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093ab16-bce8-4820-8f71-02c34f1829b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:05.033177 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093ab16-bce8-4820-8f71-02c34f1829b5 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:05.033555 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093ab16-bce8-4820-8f71-02c34f1829b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:05.034506 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093ab16-bce8-4820-8f71-02c34f1829b5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:05.035284 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7093ab16-bce8-4820-8f71-02c34f1829b5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:05.037357 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7093ab16-bce8-4820-8f71-02c34f1829b5 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:05.054534 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-7093ab16-bce8-4820-8f71-02c34f1829b5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 19:16:05.054534 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:05.054534 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 19:16:05.054534 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 19:16:05.054534 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 19:16:05.054534 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 19:16:05.054534 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 19:16:05.054534 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:16:05.054534 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 19:16:05.054534 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:16:05.054534 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 19:16:05.054534 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:16:05.054534 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:05.054534 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:05.054534 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:05.054534 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:05.055653 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:05.055653 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:05.055653 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:05.055653 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:05.055653 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:05.055653 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:05.055653 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:05.055653 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 19:16:05.055653 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 19:16:05.055653 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 19:16:05.055653 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 19:16:05.055653 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:05.055653 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:05.055653 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:05.055653 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:05.055653 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:05.056514 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:05.056514 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:05.056514 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:05.056514 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:05.056514 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:05.056514 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:05.056514 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:05.056514 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:05.056514 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:05.056514 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:05.056514 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:05.056514 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 19:16:05.056514 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:16:05.056514 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 19:16:05.056514 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:16:05.057611 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 461/933] 10.222.0.60 () {56 vars in 1132 bytes} [Thu Jul 21 19:16:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:16:05.062276 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093ab16-bce8-4820-8f71-02c34f1829b5 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:05.112530 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:05.138863 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12257ab-6182-4ce2-bdc1-092cc8341e38 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:05.186416 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e8456-a7c2-4a5f-9ecd-6dbf59ece590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:05.186848 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e8456-a7c2-4a5f-9ecd-6dbf59ece590 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:05.187164 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e8456-a7c2-4a5f-9ecd-6dbf59ece590 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:05.187464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e8456-a7c2-4a5f-9ecd-6dbf59ece590 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:05.188210 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e8456-a7c2-4a5f-9ecd-6dbf59ece590 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:05.188545 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e8456-a7c2-4a5f-9ecd-6dbf59ece590 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:05.190226 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093ab16-bce8-4820-8f71-02c34f1829b5 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:05.190361 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e8456-a7c2-4a5f-9ecd-6dbf59ece590 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:05.199492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:05.205967 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 473/934] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:05.212285 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e8456-a7c2-4a5f-9ecd-6dbf59ece590 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:05.229257 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945e061-e9ad-42e1-9baf-a22d2bbaba31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:05.229941 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945e061-e9ad-42e1-9baf-a22d2bbaba31 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:05.230245 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945e061-e9ad-42e1-9baf-a22d2bbaba31 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:05.230495 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945e061-e9ad-42e1-9baf-a22d2bbaba31 None admin] PATH_INFO: `/v3/services` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:05.231198 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7945e061-e9ad-42e1-9baf-a22d2bbaba31 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:05.231552 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7945e061-e9ad-42e1-9baf-a22d2bbaba31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:05.232930 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7945e061-e9ad-42e1-9baf-a22d2bbaba31 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:05.238261 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 462/935] 10.222.0.60 () {56 vars in 1126 bytes} [Thu Jul 21 19:16:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:16:05.244472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945e061-e9ad-42e1-9baf-a22d2bbaba31 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:05.346141 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e8456-a7c2-4a5f-9ecd-6dbf59ece590 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:05.358283 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945e061-e9ad-42e1-9baf-a22d2bbaba31 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:05.392488 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baff52a-c16c-40e0-a437-fd6bd7841323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:05.393829 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baff52a-c16c-40e0-a437-fd6bd7841323 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:05.394661 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baff52a-c16c-40e0-a437-fd6bd7841323 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:05.395398 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baff52a-c16c-40e0-a437-fd6bd7841323 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:05.398703 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:05.400949 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f171f-dc54-4b92-8c73-f22dfe2c0546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:05.401880 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f171f-dc54-4b92-8c73-f22dfe2c0546 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:05.402379 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f171f-dc54-4b92-8c73-f22dfe2c0546 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:05.402880 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f171f-dc54-4b92-8c73-f22dfe2c0546 None admin] PATH_INFO: `/v3/services` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:05.403846 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f171f-dc54-4b92-8c73-f22dfe2c0546 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:05.404343 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f171f-dc54-4b92-8c73-f22dfe2c0546 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:05.404479 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baff52a-c16c-40e0-a437-fd6bd7841323 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:05.405880 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baff52a-c16c-40e0-a437-fd6bd7841323 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:05.406242 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f171f-dc54-4b92-8c73-f22dfe2c0546 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:05.418208 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 463/936] 10.222.0.60 () {56 vars in 1126 bytes} [Thu Jul 21 19:16:05 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:05.422790 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-3baff52a-c16c-40e0-a437-fd6bd7841323 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 19:16:05.422790 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:05.422790 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:05.422790 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:05.422790 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:05.422790 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:05.422790 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:05.422790 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:05.422790 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:05.422790 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:05.422790 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:05.422790 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:05.422790 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 19:16:05.422790 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 19:16:05.422790 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 19:16:05.422790 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 19:16:05.424109 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:05.424109 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:05.424109 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 19:16:05.424109 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:16:05.424109 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 19:16:05.424109 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:16:05.424109 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:05.424109 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:05.424109 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:05.424109 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:05.424109 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:05.424109 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:05.424109 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:05.424109 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:05.424109 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:05.424109 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:05.424109 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:05.424109 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:05.425364 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:05.425364 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:05.425364 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 19:16:05.425364 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 19:16:05.425364 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 19:16:05.425364 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 19:16:05.425364 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 19:16:05.425364 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 19:16:05.425364 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 19:16:05.425364 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:05.425364 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 474/937] 10.222.0.60 () {56 vars in 1117 bytes} [Thu Jul 21 19:16:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:16:05.429442 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f171f-dc54-4b92-8c73-f22dfe2c0546 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:05.432873 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baff52a-c16c-40e0-a437-fd6bd7841323 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:05.475851 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:05.551188 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baff52a-c16c-40e0-a437-fd6bd7841323 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:05.562888 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f171f-dc54-4b92-8c73-f22dfe2c0546 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:05.600548 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f5d5e-b2ee-4f5f-b00c-ae330fb5fb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:05.601360 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f5d5e-b2ee-4f5f-b00c-ae330fb5fb2c None admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:05.601718 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f5d5e-b2ee-4f5f-b00c-ae330fb5fb2c None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:05.602052 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f5d5e-b2ee-4f5f-b00c-ae330fb5fb2c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:05.602903 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2f5d5e-b2ee-4f5f-b00c-ae330fb5fb2c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:05.603510 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ecdca-b4bc-4dfc-831a-a62ded005263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:05.604377 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ecdca-b4bc-4dfc-831a-a62ded005263 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:05.604500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2f5d5e-b2ee-4f5f-b00c-ae330fb5fb2c None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:05.604954 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ecdca-b4bc-4dfc-831a-a62ded005263 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:05.605407 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ecdca-b4bc-4dfc-831a-a62ded005263 None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:05.606426 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ecdca-b4bc-4dfc-831a-a62ded005263 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:05.606915 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ecdca-b4bc-4dfc-831a-a62ded005263 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:05.608873 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ecdca-b4bc-4dfc-831a-a62ded005263 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:05.629353 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 475/938] 10.222.0.60 () {56 vars in 1149 bytes} [Thu Jul 21 19:16:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:16:05.643485 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ecdca-b4bc-4dfc-831a-a62ded005263 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:05.693615 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:05.726317 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 464/939] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Jul 21 19:16:05 2022] POST /identity/v3/endpoints => generated 347 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:16:05.749791 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ecdca-b4bc-4dfc-831a-a62ded005263 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:05.798179 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a10968-803a-40cb-93a7-a3388ca67b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:05.798991 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a10968-803a-40cb-93a7-a3388ca67b95 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:05.799285 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a10968-803a-40cb-93a7-a3388ca67b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:05.799636 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a10968-803a-40cb-93a7-a3388ca67b95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:05.812540 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a10968-803a-40cb-93a7-a3388ca67b95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:05.813939 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a10968-803a-40cb-93a7-a3388ca67b95 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:05.833361 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-75a10968-803a-40cb-93a7-a3388ca67b95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:16:05.833361 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:05.833361 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:05.833361 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:05.833361 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:05.833361 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:05.833361 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:05.833361 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:05.833361 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:05.833361 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:05.833361 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:05.833361 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:05.833361 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:16:05.833361 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:16:05.833361 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:16:05.834318 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:16:05.834318 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:05.834318 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:05.834318 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:05.834318 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:05.834318 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:05.834318 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:05.834318 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:05.834318 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:05.834318 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:05.834318 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:05.834318 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:05.834318 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:05.834318 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:05.834318 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:05.834318 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:05.834318 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:05.835226 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:16:05.835226 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:16:05.835226 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:16:05.835226 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:05.835226 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 476/940] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:16:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:16:05.842173 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f5d5e-b2ee-4f5f-b00c-ae330fb5fb2c None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:05.946922 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:05.957053 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f5d5e-b2ee-4f5f-b00c-ae330fb5fb2c None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:05.992889 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d6706-9a34-4e4c-b96c-8efb12755d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:05.993568 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d6706-9a34-4e4c-b96c-8efb12755d33 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:05.993855 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d6706-9a34-4e4c-b96c-8efb12755d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:05.994136 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d6706-9a34-4e4c-b96c-8efb12755d33 None admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:05.994869 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36d6706-9a34-4e4c-b96c-8efb12755d33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:05.995180 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36d6706-9a34-4e4c-b96c-8efb12755d33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:05.996584 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36d6706-9a34-4e4c-b96c-8efb12755d33 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:06.008848 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 465/941] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:16:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:06.014340 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a10968-803a-40cb-93a7-a3388ca67b95 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:06.122687 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a10968-803a-40cb-93a7-a3388ca67b95 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:06.124226 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:06.159903 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b7c80-0664-4f29-81c0-22d7303aed53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:06.161456 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b7c80-0664-4f29-81c0-22d7303aed53 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:06.162138 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b7c80-0664-4f29-81c0-22d7303aed53 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:06.162428 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b7c80-0664-4f29-81c0-22d7303aed53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:06.169846 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b7c80-0664-4f29-81c0-22d7303aed53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:06.171313 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b7c80-0664-4f29-81c0-22d7303aed53 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:06.186363 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-c81b7c80-0664-4f29-81c0-22d7303aed53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:16:06.186363 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:06.186363 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:06.186363 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:06.186363 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:06.186363 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:06.186363 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:06.186363 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:06.186363 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:06.186363 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:06.186363 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:06.186363 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:06.186363 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 19:16:06.186363 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 19:16:06.186363 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 19:16:06.188680 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 19:16:06.188680 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:06.188680 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:06.188680 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:06.188680 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:06.188680 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:06.188680 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:06.188680 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:06.188680 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:06.188680 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:06.188680 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:06.188680 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:06.188680 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:06.188680 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:06.188680 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:06.188680 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:06.188680 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:06.189583 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 19:16:06.189583 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 19:16:06.189583 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 19:16:06.189583 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 19:16:06.189583 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 19:16:06.189583 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 19:16:06.189583 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:16:06.189583 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:06.189583 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 477/942] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:16:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:16:06.197005 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d6706-9a34-4e4c-b96c-8efb12755d33 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:06.304768 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d6706-9a34-4e4c-b96c-8efb12755d33 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:06.340193 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370153dd-d3ba-4eb5-b6dd-22963e59030c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:06.341213 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370153dd-d3ba-4eb5-b6dd-22963e59030c None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:06.341719 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370153dd-d3ba-4eb5-b6dd-22963e59030c None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:06.342208 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370153dd-d3ba-4eb5-b6dd-22963e59030c None admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:06.343186 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370153dd-d3ba-4eb5-b6dd-22963e59030c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:06.343713 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370153dd-d3ba-4eb5-b6dd-22963e59030c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:06.345336 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370153dd-d3ba-4eb5-b6dd-22963e59030c None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:06.358659 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 466/943] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Jul 21 19:16:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:06.364812 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b7c80-0664-4f29-81c0-22d7303aed53 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:06.470482 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b7c80-0664-4f29-81c0-22d7303aed53 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:06.505628 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f83ae-5c54-4907-be79-7c4f4b13e47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:06.506508 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f83ae-5c54-4907-be79-7c4f4b13e47e None admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:06.506786 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f83ae-5c54-4907-be79-7c4f4b13e47e None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:06.507060 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f83ae-5c54-4907-be79-7c4f4b13e47e None admin] PATH_INFO: `/v3/projects/9847b5e8bc0b4483bbce060a48f405f4/users/22d11b8e390e4b9db3b84c419266c4b2/roles/09fd90e2b50d4b809ba2614d2d228a4c` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:06.509263 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292f83ae-5c54-4907-be79-7c4f4b13e47e None admin] RBAC: Authorizing `identity:create_grant(project_id=9847b5e8bc0b4483bbce060a48f405f4, user_id=22d11b8e390e4b9db3b84c419266c4b2, role_id=09fd90e2b50d4b809ba2614d2d228a4c)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:06.510794 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292f83ae-5c54-4907-be79-7c4f4b13e47e None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:06.565999 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f598e5c-9ab2-49b2-9658-15991f17801a None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:06.566999 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f598e5c-9ab2-49b2-9658-15991f17801a None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:06.568068 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f598e5c-9ab2-49b2-9658-15991f17801a None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:06.569995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 467/944] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:16:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:16:06.573753 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 478/945] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Jul 21 19:16:06 2022] PUT /identity/v3/projects/9847b5e8bc0b4483bbce060a48f405f4/users/22d11b8e390e4b9db3b84c419266c4b2/roles/09fd90e2b50d4b809ba2614d2d228a4c => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:16:06.578609 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7475251-ce05-4e07-bfff-8b332dbc470d None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:06.579314 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7475251-ce05-4e07-bfff-8b332dbc470d None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:06.579837 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7475251-ce05-4e07-bfff-8b332dbc470d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:06.600937 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-c7475251-ce05-4e07-bfff-8b332dbc470d None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:16:06.605672 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-c7475251-ce05-4e07-bfff-8b332dbc470d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:16:06.607722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:06.681380 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 468/946] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:16:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:16:06.706057 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f83ae-5c54-4907-be79-7c4f4b13e47e None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:06.734496 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:06.817455 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f83ae-5c54-4907-be79-7c4f4b13e47e None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:06.852747 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79b9b1-e7de-4e5b-b344-455cfa5d820e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:06.853649 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79b9b1-e7de-4e5b-b344-455cfa5d820e None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:06.854107 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79b9b1-e7de-4e5b-b344-455cfa5d820e None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:06.854524 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79b9b1-e7de-4e5b-b344-455cfa5d820e None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:06.855366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79b9b1-e7de-4e5b-b344-455cfa5d820e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:06.856964 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79b9b1-e7de-4e5b-b344-455cfa5d820e None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:06.858536 dv-cinder-749155-9-smb devstack@keystone.service[80338]: WARNING keystone.server.flask.common [None req-ba79b9b1-e7de-4e5b-b344-455cfa5d820e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 21 19:16:06.894013 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.sql.core [None req-ba79b9b1-e7de-4e5b-b344-455cfa5d820e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 21 19:16:06.894013 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 21 19:16:06.894013 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [parameters: {'id': 'b2945511ad2749988f4fb8dc827a1372', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 21 19:16:06.894013 dv-cinder-749155-9-smb devstack@keystone.service[80338]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80338) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 21 19:16:06.903209 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-ba79b9b1-e7de-4e5b-b344-455cfa5d820e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b2945511ad2749988f4fb8dc827a1372.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b2945511ad2749988f4fb8dc827a1372. Jul 21 19:16:06.903209 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:06.903209 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 19:16:06.903209 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 19:16:06.903209 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 19:16:06.903209 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 19:16:06.903209 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 19:16:06.903209 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 19:16:06.903209 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 19:16:06.903209 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application conn.query(q) Jul 21 19:16:06.903209 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 19:16:06.903209 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 19:16:06.903209 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 19:16:06.904189 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application result.read() Jul 21 19:16:06.904189 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 19:16:06.904189 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 19:16:06.904189 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 19:16:06.904189 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 19:16:06.904189 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 19:16:06.904189 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 19:16:06.904189 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 19:16:06.904189 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 19:16:06.904189 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 21 19:16:06.904189 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:06.904189 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 21 19:16:06.904189 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:06.904189 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:06.904189 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 21 19:16:06.904189 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 21 19:16:06.904189 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 21 19:16:06.904189 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 21 19:16:06.905372 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 19:16:06.905372 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application next(self.gen) Jul 21 19:16:06.905372 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 21 19:16:06.905372 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application yield resource Jul 21 19:16:06.905372 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 19:16:06.905372 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application next(self.gen) Jul 21 19:16:06.905372 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 21 19:16:06.905372 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self.session.rollback() Jul 21 19:16:06.905372 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 21 19:16:06.905372 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self.force_reraise() Jul 21 19:16:06.905372 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 21 19:16:06.905372 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise self.value Jul 21 19:16:06.905372 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 21 19:16:06.905372 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 21 19:16:06.905372 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 21 19:16:06.905372 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application session.commit() Jul 21 19:16:06.905372 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 21 19:16:06.906473 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 21 19:16:06.906473 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 21 19:16:06.906473 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._prepare_impl() Jul 21 19:16:06.906473 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 21 19:16:06.906473 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self.session.flush() Jul 21 19:16:06.906473 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 21 19:16:06.906473 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._flush(objects) Jul 21 19:16:06.906473 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 21 19:16:06.906473 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 21 19:16:06.906473 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 21 19:16:06.906473 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application compat.raise_( Jul 21 19:16:06.906473 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 19:16:06.906473 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception Jul 21 19:16:06.906473 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 21 19:16:06.906473 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application flush_context.execute() Jul 21 19:16:06.906473 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 21 19:16:06.906473 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rec.execute(self) Jul 21 19:16:06.907615 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 21 19:16:06.907615 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 21 19:16:06.907615 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 21 19:16:06.907615 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 21 19:16:06.907615 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 21 19:16:06.907615 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 21 19:16:06.907615 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 21 19:16:06.907615 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 21 19:16:06.907615 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 21 19:16:06.907615 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 21 19:16:06.907615 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 21 19:16:06.907615 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 21 19:16:06.907615 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 21 19:16:06.907615 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 21 19:16:06.907615 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 21 19:16:06.908408 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 21 19:16:06.908408 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 19:16:06.908408 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception Jul 21 19:16:06.908408 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 19:16:06.908408 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 19:16:06.908408 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 19:16:06.908408 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 19:16:06.908408 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 19:16:06.908408 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 19:16:06.908408 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 19:16:06.908408 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application conn.query(q) Jul 21 19:16:06.908408 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 19:16:06.908408 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 19:16:06.908408 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 19:16:06.908408 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application result.read() Jul 21 19:16:06.908408 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 19:16:06.908408 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 19:16:06.909331 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 19:16:06.909331 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 19:16:06.909331 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 19:16:06.909331 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 19:16:06.909331 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 19:16:06.909331 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 19:16:06.909331 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 21 19:16:06.909331 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 21 19:16:06.909331 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [parameters: {'id': 'b2945511ad2749988f4fb8dc827a1372', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 21 19:16:06.909331 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 21 19:16:06.909331 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:06.909331 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 19:16:06.909331 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:06.909331 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:06.909331 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 21 19:16:06.910206 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 21 19:16:06.910206 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 21 19:16:06.910206 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 21 19:16:06.910206 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 21 19:16:06.910206 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:06.910206 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 19:16:06.910206 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:06.910206 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:06.910206 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:06.910206 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:06.910206 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:06.910206 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:06.910206 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:06.910206 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:06.910206 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:06.910206 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:06.910206 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:06.911511 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:06.911511 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 21 19:16:06.911511 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 21 19:16:06.911511 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:06.911511 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:06.911511 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 21 19:16:06.911511 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 21 19:16:06.911511 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b2945511ad2749988f4fb8dc827a1372. Jul 21 19:16:06.911511 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:06.913915 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 479/947] 10.222.0.60 () {60 vars in 1140 bytes} [Thu Jul 21 19:16:06 2022] POST /identity/v3/projects => generated 262 bytes in 208 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:16:06.919613 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7475251-ce05-4e07-bfff-8b332dbc470d None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:07.026577 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7475251-ce05-4e07-bfff-8b332dbc470d None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:07.063982 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9382cf-80be-4528-a98b-331e25b2a84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:07.065080 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9382cf-80be-4528-a98b-331e25b2a84e None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:07.065563 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9382cf-80be-4528-a98b-331e25b2a84e None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:07.066029 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9382cf-80be-4528-a98b-331e25b2a84e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:07.073761 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9382cf-80be-4528-a98b-331e25b2a84e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:07.075400 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9382cf-80be-4528-a98b-331e25b2a84e None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:07.078157 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:07.089805 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-bc9382cf-80be-4528-a98b-331e25b2a84e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:16:07.089805 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:07.089805 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:07.089805 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:07.089805 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:07.089805 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:07.089805 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:07.089805 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:07.089805 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:07.089805 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:07.089805 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:07.089805 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:07.089805 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 19:16:07.089805 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 19:16:07.089805 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 19:16:07.090752 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 19:16:07.090752 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:07.090752 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:07.090752 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:07.090752 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:07.090752 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:07.090752 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:07.090752 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:07.090752 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:07.090752 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:07.090752 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:07.090752 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:07.090752 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:07.090752 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:07.090752 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:07.090752 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:07.090752 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:07.091701 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 19:16:07.091701 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 19:16:07.091701 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 19:16:07.091701 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 19:16:07.091701 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 19:16:07.091701 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 19:16:07.091701 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:16:07.091701 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:16:07.091701 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 469/948] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:16:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:16:07.097123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79b9b1-e7de-4e5b-b344-455cfa5d820e None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:07.142959 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cb952-c75f-4279-b799-b65344c5cd47 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:07.143288 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cb952-c75f-4279-b799-b65344c5cd47 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:07.143553 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cb952-c75f-4279-b799-b65344c5cd47 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:07.146250 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 470/949] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:16:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 19:16:07.150421 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a8a34-24a3-45b0-aa4f-67e9e3afc8ee None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:07.150711 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a8a34-24a3-45b0-aa4f-67e9e3afc8ee None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:07.150995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a8a34-24a3-45b0-aa4f-67e9e3afc8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:07.171139 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-0d8a8a34-24a3-45b0-aa4f-67e9e3afc8ee None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:16:07.173115 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-0d8a8a34-24a3-45b0-aa4f-67e9e3afc8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:16:07.185578 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:07.210634 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79b9b1-e7de-4e5b-b344-455cfa5d820e None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:07.245991 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd344e-5303-4fb8-bd9c-751d818372a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:07.246685 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd344e-5303-4fb8-bd9c-751d818372a5 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:07.246973 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd344e-5303-4fb8-bd9c-751d818372a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:07.247252 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd344e-5303-4fb8-bd9c-751d818372a5 None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:07.248040 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcd344e-5303-4fb8-bd9c-751d818372a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:07.248347 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcd344e-5303-4fb8-bd9c-751d818372a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:07.249979 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcd344e-5303-4fb8-bd9c-751d818372a5 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:07.267860 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 471/950] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:16:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 19:16:07.279538 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 480/951] 10.222.0.60 () {56 vars in 1112 bytes} [Thu Jul 21 19:16:07 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:07.291150 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a8a34-24a3-45b0-aa4f-67e9e3afc8ee None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:07.405482 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a8a34-24a3-45b0-aa4f-67e9e3afc8ee None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:07.445551 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:07.451428 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f0961-c418-4c6e-adae-c2e554a0a1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:07.452393 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f0961-c418-4c6e-adae-c2e554a0a1d6 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:07.452776 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f0961-c418-4c6e-adae-c2e554a0a1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:07.453143 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f0961-c418-4c6e-adae-c2e554a0a1d6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:07.453874 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636f0961-c418-4c6e-adae-c2e554a0a1d6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:07.455327 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636f0961-c418-4c6e-adae-c2e554a0a1d6 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:07.468148 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-636f0961-c418-4c6e-adae-c2e554a0a1d6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 19:16:07.468148 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:07.468148 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 19:16:07.468148 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 19:16:07.468148 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 19:16:07.468148 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 19:16:07.468148 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 19:16:07.468148 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:16:07.468148 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 19:16:07.468148 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:16:07.468148 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 19:16:07.468148 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:16:07.468148 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:07.468148 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:07.468148 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:07.468148 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:07.468148 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:07.474915 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:07.474915 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:07.474915 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:07.474915 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:07.474915 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:07.474915 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:07.474915 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 19:16:07.474915 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 19:16:07.474915 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 19:16:07.474915 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 19:16:07.474915 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:07.474915 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:07.474915 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:07.474915 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:07.474915 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:07.474915 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:07.476209 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:07.476209 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:07.476209 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:07.476209 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:07.476209 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:07.476209 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:07.476209 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:07.476209 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:07.476209 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:07.476209 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:07.476209 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 19:16:07.476209 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:16:07.476209 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 19:16:07.476209 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:16:07.476209 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 472/952] 10.222.0.60 () {56 vars in 1126 bytes} [Thu Jul 21 19:16:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:16:07.481179 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd344e-5303-4fb8-bd9c-751d818372a5 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:07.594919 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd344e-5303-4fb8-bd9c-751d818372a5 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:07.632681 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acabbe4-b6e9-4ec7-8e7b-913896798bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:07.633705 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acabbe4-b6e9-4ec7-8e7b-913896798bb3 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:07.634218 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acabbe4-b6e9-4ec7-8e7b-913896798bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:07.634700 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acabbe4-b6e9-4ec7-8e7b-913896798bb3 None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:07.635704 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acabbe4-b6e9-4ec7-8e7b-913896798bb3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:07.636320 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acabbe4-b6e9-4ec7-8e7b-913896798bb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:07.637924 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acabbe4-b6e9-4ec7-8e7b-913896798bb3 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:07.643495 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 481/953] 10.222.0.60 () {56 vars in 1122 bytes} [Thu Jul 21 19:16:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:07.650410 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f0961-c418-4c6e-adae-c2e554a0a1d6 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:07.755744 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f0961-c418-4c6e-adae-c2e554a0a1d6 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:07.791369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73e0e5-a85e-40a7-b836-508af3c156e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:07.792083 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73e0e5-a85e-40a7-b836-508af3c156e0 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:07.792371 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73e0e5-a85e-40a7-b836-508af3c156e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:07.792661 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73e0e5-a85e-40a7-b836-508af3c156e0 None admin] PATH_INFO: `/v3/services` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:07.793394 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc73e0e5-a85e-40a7-b836-508af3c156e0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:07.793682 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc73e0e5-a85e-40a7-b836-508af3c156e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:07.795051 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc73e0e5-a85e-40a7-b836-508af3c156e0 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:07.800524 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 473/954] 10.222.0.60 () {56 vars in 1122 bytes} [Thu Jul 21 19:16:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:07.806863 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acabbe4-b6e9-4ec7-8e7b-913896798bb3 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:07.810217 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:07.922282 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acabbe4-b6e9-4ec7-8e7b-913896798bb3 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:07.929922 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e8659-5e32-498b-83fc-71a3e11be26c None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:07.930570 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e8659-5e32-498b-83fc-71a3e11be26c None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:07.931074 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e8659-5e32-498b-83fc-71a3e11be26c None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:07.933090 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 474/955] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:16:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:16:07.939464 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d627d41-b63d-43ea-a588-2e7aa387acd0 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:07.939464 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d627d41-b63d-43ea-a588-2e7aa387acd0 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:07.939464 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d627d41-b63d-43ea-a588-2e7aa387acd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:07.958200 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-0d627d41-b63d-43ea-a588-2e7aa387acd0 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:16:07.959398 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-0d627d41-b63d-43ea-a588-2e7aa387acd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:16:07.959878 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4163c-3e70-45c7-abdc-f18d614a222d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:07.960546 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4163c-3e70-45c7-abdc-f18d614a222d None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:07.960830 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4163c-3e70-45c7-abdc-f18d614a222d None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:07.961108 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4163c-3e70-45c7-abdc-f18d614a222d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:07.961977 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4163c-3e70-45c7-abdc-f18d614a222d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:07.963470 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4163c-3e70-45c7-abdc-f18d614a222d None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:08.016487 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:08.030079 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 475/956] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:16:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 19:16:08.045346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 482/957] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Jul 21 19:16:07 2022] POST /identity/v3/endpoints => generated 349 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:16:08.061081 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d627d41-b63d-43ea-a588-2e7aa387acd0 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:08.178856 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d627d41-b63d-43ea-a588-2e7aa387acd0 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:08.224918 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43448657-2f74-4c9e-8c7f-ce79b0e440d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:08.226029 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43448657-2f74-4c9e-8c7f-ce79b0e440d1 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:08.226561 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43448657-2f74-4c9e-8c7f-ce79b0e440d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:08.227036 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43448657-2f74-4c9e-8c7f-ce79b0e440d1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:08.227905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43448657-2f74-4c9e-8c7f-ce79b0e440d1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:08.229444 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43448657-2f74-4c9e-8c7f-ce79b0e440d1 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:08.243128 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-43448657-2f74-4c9e-8c7f-ce79b0e440d1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 19:16:08.243128 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:08.243128 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 19:16:08.243128 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 19:16:08.243128 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 19:16:08.243128 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 19:16:08.243128 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 19:16:08.243128 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:16:08.243128 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 19:16:08.243128 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:16:08.243128 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 19:16:08.243128 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:16:08.243128 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:08.243128 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:08.243128 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:08.243128 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:08.243128 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:08.244244 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:08.244244 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:08.244244 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:08.244244 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:08.244244 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:08.244244 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:08.244244 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 19:16:08.244244 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 19:16:08.244244 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 19:16:08.244244 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 19:16:08.244244 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:08.244244 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:08.244244 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:08.244244 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:08.244244 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:08.244244 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:08.245784 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:08.245784 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:08.245784 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:08.245784 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:08.245784 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:08.245784 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:08.245784 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:08.245784 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:08.245784 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:08.245784 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:08.245784 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 19:16:08.245784 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:16:08.245784 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 19:16:08.245784 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:16:08.245784 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 476/958] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:16:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:16:08.250553 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4163c-3e70-45c7-abdc-f18d614a222d None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:08.315266 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:08.359617 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4163c-3e70-45c7-abdc-f18d614a222d None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:08.396857 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bcd4e3-5e23-456d-824b-ef76ee2be013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:08.397619 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bcd4e3-5e23-456d-824b-ef76ee2be013 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:08.397969 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bcd4e3-5e23-456d-824b-ef76ee2be013 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:08.398377 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bcd4e3-5e23-456d-824b-ef76ee2be013 None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:08.399155 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bcd4e3-5e23-456d-824b-ef76ee2be013 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:08.399556 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bcd4e3-5e23-456d-824b-ef76ee2be013 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:08.400995 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bcd4e3-5e23-456d-824b-ef76ee2be013 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:08.406501 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 483/959] 10.222.0.60 () {56 vars in 1112 bytes} [Thu Jul 21 19:16:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:08.412580 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43448657-2f74-4c9e-8c7f-ce79b0e440d1 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:08.468825 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:08.522686 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43448657-2f74-4c9e-8c7f-ce79b0e440d1 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:08.557737 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e6437-d01e-446e-b64f-9d0bc92a31f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:08.558681 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e6437-d01e-446e-b64f-9d0bc92a31f2 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:08.559130 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e6437-d01e-446e-b64f-9d0bc92a31f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:08.559592 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e6437-d01e-446e-b64f-9d0bc92a31f2 None admin] PATH_INFO: `/v3/services` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:08.560472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e6437-d01e-446e-b64f-9d0bc92a31f2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:08.560933 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e6437-d01e-446e-b64f-9d0bc92a31f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:08.562451 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e6437-d01e-446e-b64f-9d0bc92a31f2 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:08.567998 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 477/960] 10.222.0.60 () {56 vars in 1112 bytes} [Thu Jul 21 19:16:08 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:08.762559 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32fb3c-50fc-4e32-a0cd-105874601b46 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:08.763064 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32fb3c-50fc-4e32-a0cd-105874601b46 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:08.763064 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32fb3c-50fc-4e32-a0cd-105874601b46 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:08.764667 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 484/961] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:16:08.769703 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b66c13-3d14-4ec7-a7c7-1e4092e99db1 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:08.770627 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b66c13-3d14-4ec7-a7c7-1e4092e99db1 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:08.770814 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b66c13-3d14-4ec7-a7c7-1e4092e99db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:08.788283 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-00b66c13-3d14-4ec7-a7c7-1e4092e99db1 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:16:08.789463 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-00b66c13-3d14-4ec7-a7c7-1e4092e99db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:16:08.857311 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 478/962] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:16:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:16:08.881735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32fb3c-50fc-4e32-a0cd-105874601b46 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:08.988199 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32fb3c-50fc-4e32-a0cd-105874601b46 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:09.012123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:09.022810 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ac78f4-e113-4fb7-a152-eb5581f45211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:09.023579 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac78f4-e113-4fb7-a152-eb5581f45211 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:09.023861 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac78f4-e113-4fb7-a152-eb5581f45211 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:09.024133 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac78f4-e113-4fb7-a152-eb5581f45211 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:09.035110 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ac78f4-e113-4fb7-a152-eb5581f45211 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:16:09.043860 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-c2ac78f4-e113-4fb7-a152-eb5581f45211 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 19:16:09.043860 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:09.043860 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:09.043860 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:09.043860 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:09.043860 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:09.043860 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:09.043860 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:09.043860 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:09.043860 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:09.043860 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:09.043860 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:09.043860 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:16:09.043860 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:16:09.043860 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:16:09.043860 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:16:09.046027 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:16:09.046027 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:16:09.046027 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:16:09.046027 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:16:09.046027 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:09.046027 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:09.046027 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:09.046027 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:09.046027 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:09.046027 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:09.046027 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:09.046027 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:09.046027 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:09.046027 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:09.046027 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:09.046027 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:09.048191 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:09.048191 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:09.048191 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:09.048191 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:09.048191 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:16:09.048191 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:16:09.048191 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:16:09.048191 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:16:09.048191 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:16:09.048191 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:16:09.048191 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 19:16:09.048191 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:09.048191 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 485/963] 10.222.0.60 () {56 vars in 1120 bytes} [Thu Jul 21 19:16:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:16:09.055481 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b66c13-3d14-4ec7-a7c7-1e4092e99db1 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:09.095757 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:09.162937 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b66c13-3d14-4ec7-a7c7-1e4092e99db1 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:09.198331 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4bf5de-eca9-4db4-a708-4f6fec1bbf3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:09.199277 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4bf5de-eca9-4db4-a708-4f6fec1bbf3c None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:09.199730 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4bf5de-eca9-4db4-a708-4f6fec1bbf3c None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:09.200170 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4bf5de-eca9-4db4-a708-4f6fec1bbf3c None admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:09.201066 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4bf5de-eca9-4db4-a708-4f6fec1bbf3c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:09.201519 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4bf5de-eca9-4db4-a708-4f6fec1bbf3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:09.203018 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4bf5de-eca9-4db4-a708-4f6fec1bbf3c None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:09.212695 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 479/964] 10.222.0.60 () {56 vars in 1115 bytes} [Thu Jul 21 19:16:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:09.218460 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ac78f4-e113-4fb7-a152-eb5581f45211 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:09.325396 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ac78f4-e113-4fb7-a152-eb5581f45211 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:09.363591 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa2630-853a-4416-a31b-de293abc2926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:09.364692 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa2630-853a-4416-a31b-de293abc2926 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:09.365121 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa2630-853a-4416-a31b-de293abc2926 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:09.365559 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa2630-853a-4416-a31b-de293abc2926 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:09.376367 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa2630-853a-4416-a31b-de293abc2926 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:09.377970 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa2630-853a-4416-a31b-de293abc2926 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:09.396443 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-6baa2630-853a-4416-a31b-de293abc2926 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:16:09.396443 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:09.396443 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:09.396443 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:09.396443 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:09.396443 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:09.396443 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:09.396443 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:09.396443 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:09.396443 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:09.396443 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:09.396443 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:09.396443 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:16:09.396443 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:16:09.396443 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:16:09.397584 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:16:09.397584 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:09.397584 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:09.397584 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:09.397584 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:09.397584 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:09.397584 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:09.397584 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:09.397584 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:09.397584 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:09.397584 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:09.397584 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:09.397584 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:09.397584 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:09.397584 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:09.397584 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:09.397584 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:09.398706 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:16:09.398706 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:16:09.398706 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:16:09.398706 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:09.400635 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 486/965] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:16:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:16:09.406319 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4bf5de-eca9-4db4-a708-4f6fec1bbf3c None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:09.511876 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4bf5de-eca9-4db4-a708-4f6fec1bbf3c None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:09.514391 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:09.550968 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca910ba9-2d0f-41be-afe6-9eeb44747e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:09.552199 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca910ba9-2d0f-41be-afe6-9eeb44747e43 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:09.552489 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca910ba9-2d0f-41be-afe6-9eeb44747e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:09.552766 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca910ba9-2d0f-41be-afe6-9eeb44747e43 None admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:09.553755 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca910ba9-2d0f-41be-afe6-9eeb44747e43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:09.554066 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca910ba9-2d0f-41be-afe6-9eeb44747e43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:09.555450 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca910ba9-2d0f-41be-afe6-9eeb44747e43 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:09.561147 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336d067-79b5-4d04-9142-66f5c2242fb9 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:09.561541 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336d067-79b5-4d04-9142-66f5c2242fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:09.561863 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336d067-79b5-4d04-9142-66f5c2242fb9 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:09.563574 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 487/966] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:16:09.568486 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 480/967] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:16:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:09.569479 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b125d5-bf80-48e7-bc99-52d3b5dff176 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:09.569843 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b125d5-bf80-48e7-bc99-52d3b5dff176 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:09.570196 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b125d5-bf80-48e7-bc99-52d3b5dff176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:09.576429 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca910ba9-2d0f-41be-afe6-9eeb44747e43 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:09.591471 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-12b125d5-bf80-48e7-bc99-52d3b5dff176 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:16:09.592997 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-12b125d5-bf80-48e7-bc99-52d3b5dff176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:16:09.626723 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:09.687513 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 488/968] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:16:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 19:16:09.696542 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca910ba9-2d0f-41be-afe6-9eeb44747e43 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:09.716216 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b125d5-bf80-48e7-bc99-52d3b5dff176 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:09.740430 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a8a8e-5713-4003-81e9-9c1f8c7e7283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:09.741825 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a8a8e-5713-4003-81e9-9c1f8c7e7283 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:09.742116 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a8a8e-5713-4003-81e9-9c1f8c7e7283 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:09.742398 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a8a8e-5713-4003-81e9-9c1f8c7e7283 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:09.753541 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904a8a8e-5713-4003-81e9-9c1f8c7e7283 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:09.755582 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904a8a8e-5713-4003-81e9-9c1f8c7e7283 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:09.775266 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-904a8a8e-5713-4003-81e9-9c1f8c7e7283 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 19:16:09.775266 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:09.775266 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:09.775266 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:09.775266 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:09.775266 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:09.775266 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:09.775266 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:09.775266 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:09.775266 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:09.775266 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:09.775266 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:09.775266 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 19:16:09.775266 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 19:16:09.775266 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 19:16:09.775266 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 19:16:09.776839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:09.776839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:09.776839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 19:16:09.776839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:16:09.776839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 19:16:09.776839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:16:09.776839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:09.776839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:09.776839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:09.776839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:09.776839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:09.776839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:09.776839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:09.776839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:09.776839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:09.776839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:09.776839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:09.776839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:09.777766 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:09.777766 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:09.777766 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 19:16:09.777766 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 19:16:09.777766 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 19:16:09.777766 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 19:16:09.777766 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 19:16:09.777766 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 19:16:09.777766 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 19:16:09.777766 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:16:09.777766 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 481/969] 10.222.0.60 () {56 vars in 1117 bytes} [Thu Jul 21 19:16:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:16:09.783938 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a8a8e-5713-4003-81e9-9c1f8c7e7283 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:09.819131 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:09.834440 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b125d5-bf80-48e7-bc99-52d3b5dff176 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:09.874688 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca674e0-f43a-4d0f-b20f-475fe86db609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:09.875751 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca674e0-f43a-4d0f-b20f-475fe86db609 None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:09.876261 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca674e0-f43a-4d0f-b20f-475fe86db609 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:09.876841 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca674e0-f43a-4d0f-b20f-475fe86db609 None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:09.877874 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca674e0-f43a-4d0f-b20f-475fe86db609 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:09.880052 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca674e0-f43a-4d0f-b20f-475fe86db609 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:09.910230 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a8a8e-5713-4003-81e9-9c1f8c7e7283 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:09.932679 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.sql.core [None req-bca674e0-f43a-4d0f-b20f-475fe86db609 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 21 19:16:09.932679 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 21 19:16:09.932679 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [parameters: {'user_id': 'cbcf9af1651a44dab154263b6adab300', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 21 19:16:09.932679 dv-cinder-749155-9-smb devstack@keystone.service[80338]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80338) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 21 19:16:09.944671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-bca674e0-f43a-4d0f-b20f-475fe86db609 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 21 19:16:09.944671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:09.944671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 19:16:09.944671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 19:16:09.944671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 19:16:09.944671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 19:16:09.944671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 19:16:09.944671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 19:16:09.944671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 19:16:09.944671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application conn.query(q) Jul 21 19:16:09.944671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 19:16:09.944671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 19:16:09.944671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 19:16:09.944671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application result.read() Jul 21 19:16:09.944671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 19:16:09.945773 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 19:16:09.945773 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 19:16:09.945773 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 19:16:09.945773 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 19:16:09.945773 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 19:16:09.945773 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 19:16:09.945773 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 19:16:09.945773 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 21 19:16:09.945773 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:09.945773 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 21 19:16:09.945773 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:09.945773 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:09.945773 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 21 19:16:09.945773 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 21 19:16:09.945773 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 21 19:16:09.945773 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 21 19:16:09.945773 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 19:16:09.945773 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application next(self.gen) Jul 21 19:16:09.946952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 21 19:16:09.946952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application yield resource Jul 21 19:16:09.946952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 19:16:09.946952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application next(self.gen) Jul 21 19:16:09.946952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 21 19:16:09.946952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self.session.rollback() Jul 21 19:16:09.946952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 21 19:16:09.946952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self.force_reraise() Jul 21 19:16:09.946952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 21 19:16:09.946952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise self.value Jul 21 19:16:09.946952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 21 19:16:09.946952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 21 19:16:09.946952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 21 19:16:09.946952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application session.commit() Jul 21 19:16:09.946952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 21 19:16:09.946952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 21 19:16:09.946952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 21 19:16:09.948124 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._prepare_impl() Jul 21 19:16:09.948124 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 21 19:16:09.948124 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self.session.flush() Jul 21 19:16:09.948124 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 21 19:16:09.948124 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._flush(objects) Jul 21 19:16:09.948124 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 21 19:16:09.948124 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 21 19:16:09.948124 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 21 19:16:09.948124 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application compat.raise_( Jul 21 19:16:09.948124 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 19:16:09.948124 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception Jul 21 19:16:09.948124 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 21 19:16:09.948124 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application flush_context.execute() Jul 21 19:16:09.948124 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 21 19:16:09.948124 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rec.execute(self) Jul 21 19:16:09.948124 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 21 19:16:09.948124 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 21 19:16:09.949265 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 21 19:16:09.949265 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 21 19:16:09.949265 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 21 19:16:09.949265 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 21 19:16:09.949265 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 21 19:16:09.949265 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 21 19:16:09.949265 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 21 19:16:09.949265 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 21 19:16:09.949265 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 21 19:16:09.949265 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 21 19:16:09.949265 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 21 19:16:09.949265 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 21 19:16:09.949265 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 21 19:16:09.949265 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 21 19:16:09.949265 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 19:16:09.949265 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception Jul 21 19:16:09.950326 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 19:16:09.950326 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 19:16:09.950326 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 19:16:09.950326 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 19:16:09.950326 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 19:16:09.950326 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 19:16:09.950326 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 19:16:09.950326 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application conn.query(q) Jul 21 19:16:09.950326 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 19:16:09.950326 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 19:16:09.950326 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 19:16:09.950326 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application result.read() Jul 21 19:16:09.950326 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 19:16:09.950326 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 19:16:09.950326 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 19:16:09.950326 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 19:16:09.951397 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 19:16:09.951397 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 19:16:09.951397 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 19:16:09.951397 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 19:16:09.951397 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 21 19:16:09.951397 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 21 19:16:09.951397 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [parameters: {'user_id': 'cbcf9af1651a44dab154263b6adab300', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 21 19:16:09.951397 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 21 19:16:09.951397 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:09.951397 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 19:16:09.951397 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:09.951397 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:09.951397 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:09.951397 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:09.951397 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:09.952879 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:09.952879 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:09.952879 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:09.952879 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:09.952879 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:09.952879 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:09.952879 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:09.952879 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 21 19:16:09.952879 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 21 19:16:09.952879 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:09.952879 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:09.952879 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 19:16:09.952879 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:16:09.952879 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 19:16:09.952879 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:16:09.952879 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 21 19:16:09.952879 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 21 19:16:09.954701 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 21 19:16:09.954701 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 21 19:16:09.954701 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 21 19:16:09.954701 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 21 19:16:09.954701 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 21 19:16:09.954701 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:09.958389 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 489/970] 10.222.0.60 () {60 vars in 1131 bytes} [Thu Jul 21 19:16:09 2022] POST /identity/v3/users => generated 160 bytes in 242 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:16:09.959675 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca674e0-f43a-4d0f-b20f-475fe86db609 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:09.959961 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a6144e-1b5d-408d-a960-e2633c5838e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:09.960859 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6144e-1b5d-408d-a960-e2633c5838e6 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:09.961334 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6144e-1b5d-408d-a960-e2633c5838e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:09.961791 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6144e-1b5d-408d-a960-e2633c5838e6 None admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:09.962933 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a6144e-1b5d-408d-a960-e2633c5838e6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:09.963429 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a6144e-1b5d-408d-a960-e2633c5838e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:09.965186 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a6144e-1b5d-408d-a960-e2633c5838e6 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:09.984515 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 482/971] 10.222.0.60 () {56 vars in 1149 bytes} [Thu Jul 21 19:16:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:09.990210 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a6144e-1b5d-408d-a960-e2633c5838e6 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:10.000228 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:10.085917 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:10.096459 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca674e0-f43a-4d0f-b20f-475fe86db609 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:10.105658 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a6144e-1b5d-408d-a960-e2633c5838e6 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:10.133786 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187cf3e-2ca0-4572-ab0d-b8ca364bddd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:10.134681 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187cf3e-2ca0-4572-ab0d-b8ca364bddd8 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:10.135031 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187cf3e-2ca0-4572-ab0d-b8ca364bddd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:10.135374 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187cf3e-2ca0-4572-ab0d-b8ca364bddd8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:10.144873 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b187cf3e-2ca0-4572-ab0d-b8ca364bddd8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:10.146723 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410c37b-ed8e-4d99-a87d-7e648742220f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:10.146860 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b187cf3e-2ca0-4572-ab0d-b8ca364bddd8 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:10.147750 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410c37b-ed8e-4d99-a87d-7e648742220f None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:10.148222 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410c37b-ed8e-4d99-a87d-7e648742220f None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:10.149002 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410c37b-ed8e-4d99-a87d-7e648742220f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:10.163293 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-b187cf3e-2ca0-4572-ab0d-b8ca364bddd8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 19:16:10.163293 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:10.163293 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:10.163293 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:10.163293 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:10.163293 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:10.163293 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:10.163293 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:10.163293 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:10.163293 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:10.163293 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:10.163293 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:10.163293 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 19:16:10.163293 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 19:16:10.163293 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 19:16:10.163293 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 19:16:10.164309 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:10.164309 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:10.164309 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 19:16:10.164309 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:16:10.164309 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 19:16:10.164309 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:16:10.164309 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:10.164309 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:10.164309 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:10.164309 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:10.164309 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:10.164309 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:10.164309 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:10.164309 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:10.164309 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:10.164309 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:10.164309 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:10.164309 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:10.165245 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:10.165245 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:10.165245 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 19:16:10.165245 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 19:16:10.165245 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 19:16:10.165245 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 19:16:10.165245 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 19:16:10.165245 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 19:16:10.165245 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 19:16:10.165245 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:10.169621 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 490/972] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:16:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:16:10.170997 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187cf3e-2ca0-4572-ab0d-b8ca364bddd8 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:10.244313 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7410c37b-ed8e-4d99-a87d-7e648742220f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:10.245930 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7410c37b-ed8e-4d99-a87d-7e648742220f None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:10.279259 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:10.301681 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187cf3e-2ca0-4572-ab0d-b8ca364bddd8 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:10.338836 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:10.350697 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2952e58-7d93-4a2e-8004-d6beb3eecf55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:10.351906 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2952e58-7d93-4a2e-8004-d6beb3eecf55 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:10.352703 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2952e58-7d93-4a2e-8004-d6beb3eecf55 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:10.353317 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2952e58-7d93-4a2e-8004-d6beb3eecf55 None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:10.354399 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2952e58-7d93-4a2e-8004-d6beb3eecf55 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:10.354866 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2952e58-7d93-4a2e-8004-d6beb3eecf55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:10.356600 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2952e58-7d93-4a2e-8004-d6beb3eecf55 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:10.358777 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 483/973] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:16:09 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 19:16:10.361052 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e44dd-c9cd-44ba-9693-b729a879a15f None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:10.361448 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e44dd-c9cd-44ba-9693-b729a879a15f None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:10.361828 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e44dd-c9cd-44ba-9693-b729a879a15f None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:10.367378 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 484/974] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:16:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:16:10.369250 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e44dd-c9cd-44ba-9693-b729a879a15f None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:10.400169 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 491/975] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Jul 21 19:16:10 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:16:10.401569 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ba749-7fbb-4b9b-9617-f1be69d821f1 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:10.401867 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ba749-7fbb-4b9b-9617-f1be69d821f1 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:10.402153 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ba749-7fbb-4b9b-9617-f1be69d821f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:10.432588 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-637ba749-7fbb-4b9b-9617-f1be69d821f1 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:16:10.434185 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-637ba749-7fbb-4b9b-9617-f1be69d821f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:16:10.500090 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e44dd-c9cd-44ba-9693-b729a879a15f None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:10.522305 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 492/976] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:16:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:16:10.538502 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e0066-9836-48ae-89b9-e2148285ccff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:10.539319 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e0066-9836-48ae-89b9-e2148285ccff None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:10.539640 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e0066-9836-48ae-89b9-e2148285ccff None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:10.539922 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e0066-9836-48ae-89b9-e2148285ccff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:10.542339 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ba749-7fbb-4b9b-9617-f1be69d821f1 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:10.551566 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62e0066-9836-48ae-89b9-e2148285ccff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:10.553238 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62e0066-9836-48ae-89b9-e2148285ccff None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:10.573213 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-d62e0066-9836-48ae-89b9-e2148285ccff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:16:10.573213 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:10.573213 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:10.573213 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:10.573213 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:10.573213 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:10.573213 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:10.573213 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:10.573213 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:10.573213 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:10.573213 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:10.573213 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:10.573213 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:16:10.573213 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:16:10.573213 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:16:10.574171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:16:10.574171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:10.574171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:10.574171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:10.574171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:10.574171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:10.574171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:10.574171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:10.574171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:10.574171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:10.574171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:10.574171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:10.574171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:10.574171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:10.574171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:10.574171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:10.574171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:10.575049 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:16:10.575049 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:16:10.575049 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:16:10.575049 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:16:10.575049 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 485/977] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:16:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:16:10.580719 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e0066-9836-48ae-89b9-e2148285ccff None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:10.632033 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:10.633857 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:10.669904 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ba749-7fbb-4b9b-9617-f1be69d821f1 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:10.710625 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39a277-1628-415b-9674-c0cd1fd9c26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:10.711450 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39a277-1628-415b-9674-c0cd1fd9c26d None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:10.711737 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39a277-1628-415b-9674-c0cd1fd9c26d None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:10.712014 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39a277-1628-415b-9674-c0cd1fd9c26d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:10.712672 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39a277-1628-415b-9674-c0cd1fd9c26d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:10.714046 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39a277-1628-415b-9674-c0cd1fd9c26d None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:10.718536 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e0066-9836-48ae-89b9-e2148285ccff None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:10.726239 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-ba39a277-1628-415b-9674-c0cd1fd9c26d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 19:16:10.726239 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:10.726239 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 19:16:10.726239 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 19:16:10.726239 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 19:16:10.726239 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 19:16:10.726239 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 19:16:10.726239 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:16:10.726239 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 19:16:10.726239 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:10.726239 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 19:16:10.726239 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:10.726239 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:10.726239 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:10.726239 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:10.726239 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:10.726239 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:10.727456 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:10.727456 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:10.727456 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:10.727456 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:10.727456 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:10.727456 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:10.727456 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 19:16:10.727456 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 19:16:10.727456 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 19:16:10.727456 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 19:16:10.727456 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:10.727456 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:10.727456 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:10.727456 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:10.727456 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:10.727456 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:10.728314 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:10.728314 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:10.728314 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:10.728314 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:10.728314 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:10.728314 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:10.728314 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:10.728314 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:10.728314 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:10.728314 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:10.728314 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 19:16:10.728314 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:16:10.728314 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 19:16:10.728314 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:10.728314 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 493/978] 10.222.0.60 () {56 vars in 1126 bytes} [Thu Jul 21 19:16:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:16:10.729509 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f676ea-ea1e-41b8-98b8-a68aa7663278 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:10.729509 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f676ea-ea1e-41b8-98b8-a68aa7663278 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:10.729509 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f676ea-ea1e-41b8-98b8-a68aa7663278 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:10.731389 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 494/979] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:16:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:16:10.733836 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f676ea-ea1e-41b8-98b8-a68aa7663278 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:10.758186 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20155921-b8b7-4a72-9a8f-5397a83ea7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:10.758877 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20155921-b8b7-4a72-9a8f-5397a83ea7a1 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:10.759156 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20155921-b8b7-4a72-9a8f-5397a83ea7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:10.759458 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20155921-b8b7-4a72-9a8f-5397a83ea7a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:10.760179 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20155921-b8b7-4a72-9a8f-5397a83ea7a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:10.760483 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20155921-b8b7-4a72-9a8f-5397a83ea7a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:10.761846 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20155921-b8b7-4a72-9a8f-5397a83ea7a1 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:10.772740 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 486/980] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:16:10.773908 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc696e98-f1a6-48ad-b73d-cae9cbdeef0c None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:10.774192 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc696e98-f1a6-48ad-b73d-cae9cbdeef0c None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:10.774467 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc696e98-f1a6-48ad-b73d-cae9cbdeef0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:10.792310 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-cc696e98-f1a6-48ad-b73d-cae9cbdeef0c None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:16:10.793494 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-cc696e98-f1a6-48ad-b73d-cae9cbdeef0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:16:10.840560 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f676ea-ea1e-41b8-98b8-a68aa7663278 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:10.858389 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 487/981] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:16:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:16:10.859005 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc696e98-f1a6-48ad-b73d-cae9cbdeef0c None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:10.874902 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3312936-cd67-4c6d-b2f0-762b7fa7b32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:10.875591 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3312936-cd67-4c6d-b2f0-762b7fa7b32e None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:10.875878 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3312936-cd67-4c6d-b2f0-762b7fa7b32e None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:10.876154 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3312936-cd67-4c6d-b2f0-762b7fa7b32e None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:10.876864 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3312936-cd67-4c6d-b2f0-762b7fa7b32e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:10.877168 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3312936-cd67-4c6d-b2f0-762b7fa7b32e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:10.878564 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3312936-cd67-4c6d-b2f0-762b7fa7b32e None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:10.888472 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 495/982] 10.222.0.60 () {56 vars in 1122 bytes} [Thu Jul 21 19:16:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:10.888472 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3312936-cd67-4c6d-b2f0-762b7fa7b32e None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:10.888472 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:10.888784 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:10.961139 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc696e98-f1a6-48ad-b73d-cae9cbdeef0c None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:10.984539 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3312936-cd67-4c6d-b2f0-762b7fa7b32e None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:10.995828 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227691c6-cd53-45fc-a5ef-b4b0e73085c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:10.996626 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227691c6-cd53-45fc-a5ef-b4b0e73085c8 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:10.996910 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227691c6-cd53-45fc-a5ef-b4b0e73085c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:10.997186 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227691c6-cd53-45fc-a5ef-b4b0e73085c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:11.003652 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227691c6-cd53-45fc-a5ef-b4b0e73085c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:11.005654 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227691c6-cd53-45fc-a5ef-b4b0e73085c8 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:11.021691 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-227691c6-cd53-45fc-a5ef-b4b0e73085c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:16:11.021691 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:11.021691 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:11.021691 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:11.021691 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:11.021691 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:11.021691 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:11.021691 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:11.021691 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:11.021691 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:11.021691 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:11.021691 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:11.021691 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 19:16:11.021691 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 19:16:11.021691 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 19:16:11.022697 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 19:16:11.022697 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:11.022697 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:11.022697 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:11.022697 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:11.022697 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:11.022697 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:11.022697 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:11.022697 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:11.022697 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:11.022697 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:11.022697 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:11.022697 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:11.022697 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:11.022697 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:11.022697 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:11.022697 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:11.023642 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 19:16:11.023642 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 19:16:11.023642 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 19:16:11.023642 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 19:16:11.023642 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 19:16:11.023642 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 19:16:11.023642 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:16:11.023642 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:16:11.024087 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6b828-1331-4164-9898-3cf692b44f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:11.024087 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6b828-1331-4164-9898-3cf692b44f3f None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:11.024087 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6b828-1331-4164-9898-3cf692b44f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:11.024087 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6b828-1331-4164-9898-3cf692b44f3f None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:11.024365 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 488/983] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:16:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:16:11.024444 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f6b828-1331-4164-9898-3cf692b44f3f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:11.024515 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227691c6-cd53-45fc-a5ef-b4b0e73085c8 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:11.025315 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f6b828-1331-4164-9898-3cf692b44f3f None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:11.115471 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 496/984] 10.222.0.60 () {60 vars in 1141 bytes} [Thu Jul 21 19:16:10 2022] POST /identity/v3/services => generated 242 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:16:11.115471 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6b828-1331-4164-9898-3cf692b44f3f None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:11.115796 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:11.132729 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227691c6-cd53-45fc-a5ef-b4b0e73085c8 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:11.175532 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:11.186256 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaaa48a-6008-4222-ba18-e1cf7e58101c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:11.186962 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaaa48a-6008-4222-ba18-e1cf7e58101c None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:11.187252 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaaa48a-6008-4222-ba18-e1cf7e58101c None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:11.187605 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaaa48a-6008-4222-ba18-e1cf7e58101c None admin] PATH_INFO: `/v3/services` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:11.188395 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaaa48a-6008-4222-ba18-e1cf7e58101c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:11.188706 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaaa48a-6008-4222-ba18-e1cf7e58101c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:11.190105 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaaa48a-6008-4222-ba18-e1cf7e58101c None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:11.201755 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 489/985] 10.222.0.60 () {56 vars in 1122 bytes} [Thu Jul 21 19:16:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:11.206853 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaaa48a-6008-4222-ba18-e1cf7e58101c None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:11.225585 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6b828-1331-4164-9898-3cf692b44f3f None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:11.266255 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a35e5-b731-4597-8de2-74871fd6b520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:11.267203 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a35e5-b731-4597-8de2-74871fd6b520 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:11.267641 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a35e5-b731-4597-8de2-74871fd6b520 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:11.267937 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a35e5-b731-4597-8de2-74871fd6b520 None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:11.268730 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2a35e5-b731-4597-8de2-74871fd6b520 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:11.269047 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2a35e5-b731-4597-8de2-74871fd6b520 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:11.270812 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2a35e5-b731-4597-8de2-74871fd6b520 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:11.284597 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 497/986] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Jul 21 19:16:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:11.291698 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a35e5-b731-4597-8de2-74871fd6b520 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:11.319965 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaaa48a-6008-4222-ba18-e1cf7e58101c None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:11.356101 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a8370b-4b4c-4633-a757-6d6dfbacd890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:11.356763 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8370b-4b4c-4633-a757-6d6dfbacd890 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:11.357054 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8370b-4b4c-4633-a757-6d6dfbacd890 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:11.357334 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8370b-4b4c-4633-a757-6d6dfbacd890 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:11.358134 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a8370b-4b4c-4633-a757-6d6dfbacd890 None admin] RBAC: Adding query filter params (interface=admin, service_id=7ac6201f307042eca89604fe91cd76b3, region_id=RegionOne) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:11.358451 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a8370b-4b4c-4633-a757-6d6dfbacd890 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:11.359857 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a8370b-4b4c-4633-a757-6d6dfbacd890 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:11.366176 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 490/987] 10.222.0.60 () {56 vars in 1249 bytes} [Thu Jul 21 19:16:11 2022] GET /identity/v3/endpoints?service_id=7ac6201f307042eca89604fe91cd76b3&interface=admin®ion_id=RegionOne => generated 193 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:11.371626 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a8370b-4b4c-4633-a757-6d6dfbacd890 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:11.384945 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:11.402120 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a35e5-b731-4597-8de2-74871fd6b520 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:11.433747 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:11.446243 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3026fb-a074-4b46-9915-275b88150bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:11.448588 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3026fb-a074-4b46-9915-275b88150bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:11.448588 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3026fb-a074-4b46-9915-275b88150bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:11.448588 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3026fb-a074-4b46-9915-275b88150bc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:11.448588 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3026fb-a074-4b46-9915-275b88150bc7 None admin] RBAC: Adding query filter params (role.id=09fd90e2b50d4b809ba2614d2d228a4c, scope.project.id=9847b5e8bc0b4483bbce060a48f405f4, user.id=22d11b8e390e4b9db3b84c419266c4b2) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:11.448874 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3026fb-a074-4b46-9915-275b88150bc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:11.450405 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3026fb-a074-4b46-9915-275b88150bc7 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:11.463477 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 498/988] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:16:11 2022] GET /identity/v3/role_assignments?user.id=22d11b8e390e4b9db3b84c419266c4b2&scope.project.id=9847b5e8bc0b4483bbce060a48f405f4&role.id=09fd90e2b50d4b809ba2614d2d228a4c => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:16:11.494214 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a8370b-4b4c-4633-a757-6d6dfbacd890 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:11.534334 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b0ff86-ba89-4c35-b6c1-aa6213d49fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:11.535023 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0ff86-ba89-4c35-b6c1-aa6213d49fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:11.535313 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0ff86-ba89-4c35-b6c1-aa6213d49fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:11.535732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0ff86-ba89-4c35-b6c1-aa6213d49fd1 None admin] PATH_INFO: `/v3/services` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:11.537014 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b0ff86-ba89-4c35-b6c1-aa6213d49fd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:11.538487 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b0ff86-ba89-4c35-b6c1-aa6213d49fd1 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:11.547681 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 491/989] 10.222.0.60 () {56 vars in 1087 bytes} [Thu Jul 21 19:16:11 2022] GET /identity/v3/services => generated 1727 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 19:16:13.166560 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319c42e-0d51-4483-ad8d-dd0791c70d86 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:13.167091 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319c42e-0d51-4483-ad8d-dd0791c70d86 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:13.167091 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319c42e-0d51-4483-ad8d-dd0791c70d86 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:13.168796 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 499/990] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:16:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:16:13.173776 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f4aea-a3dc-4290-baf1-835ccd9746ba None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:13.174183 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f4aea-a3dc-4290-baf1-835ccd9746ba None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:13.174366 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f4aea-a3dc-4290-baf1-835ccd9746ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:13.192760 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-f24f4aea-a3dc-4290-baf1-835ccd9746ba None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:16:13.193939 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-f24f4aea-a3dc-4290-baf1-835ccd9746ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:16:13.263586 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 492/991] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:16:13 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:16:13.284231 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319c42e-0d51-4483-ad8d-dd0791c70d86 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:13.387318 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319c42e-0d51-4483-ad8d-dd0791c70d86 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:13.427797 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa042e46-0e11-42da-85fe-9853a629f91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:13.428853 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa042e46-0e11-42da-85fe-9853a629f91c None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:13.429134 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa042e46-0e11-42da-85fe-9853a629f91c None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:13.429409 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa042e46-0e11-42da-85fe-9853a629f91c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:13.430062 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa042e46-0e11-42da-85fe-9853a629f91c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:13.431429 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa042e46-0e11-42da-85fe-9853a629f91c None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:13.443422 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-fa042e46-0e11-42da-85fe-9853a629f91c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 19:16:13.443422 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:13.443422 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 19:16:13.443422 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 19:16:13.443422 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 19:16:13.443422 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 19:16:13.443422 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 19:16:13.443422 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:16:13.443422 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 19:16:13.443422 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:13.443422 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 19:16:13.443422 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:13.443422 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:13.443422 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:13.443422 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:13.443422 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:13.443422 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:13.444422 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:13.444422 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:13.444422 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:13.444422 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:13.444422 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:13.444422 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:13.444422 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 19:16:13.444422 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 19:16:13.444422 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 19:16:13.444422 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 19:16:13.444422 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:13.444422 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:13.444422 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:13.444422 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:13.444422 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:13.444422 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:13.445263 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:13.445263 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:13.445263 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:13.445263 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:13.445263 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:13.445263 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:13.445263 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:13.445263 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:13.445263 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:13.445263 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:13.445263 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 19:16:13.445263 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:16:13.445263 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 19:16:13.445263 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:13.446612 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 500/992] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:16:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:16:13.450528 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f4aea-a3dc-4290-baf1-835ccd9746ba None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:13.452743 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:13.549421 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f4aea-a3dc-4290-baf1-835ccd9746ba None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:13.560979 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb98aba-28e3-49ff-b13d-5722d2286f44 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:13.561375 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb98aba-28e3-49ff-b13d-5722d2286f44 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:13.561729 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb98aba-28e3-49ff-b13d-5722d2286f44 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:13.563511 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 501/993] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:16:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 19:16:13.570015 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139121d0-57ef-4136-bb49-0dbfee4314eb None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:13.570305 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139121d0-57ef-4136-bb49-0dbfee4314eb None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:13.570580 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139121d0-57ef-4136-bb49-0dbfee4314eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:13.587090 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c108f4-c2bc-42da-baac-c2892e1cad43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:13.587789 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c108f4-c2bc-42da-baac-c2892e1cad43 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:13.587892 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-139121d0-57ef-4136-bb49-0dbfee4314eb None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:16:13.588068 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c108f4-c2bc-42da-baac-c2892e1cad43 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:13.588347 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c108f4-c2bc-42da-baac-c2892e1cad43 None admin] PATH_INFO: `/v3/services` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:13.589002 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-139121d0-57ef-4136-bb49-0dbfee4314eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:16:13.589109 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c108f4-c2bc-42da-baac-c2892e1cad43 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:13.589336 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c108f4-c2bc-42da-baac-c2892e1cad43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:13.590695 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c108f4-c2bc-42da-baac-c2892e1cad43 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:13.600477 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 493/994] 10.222.0.60 () {56 vars in 1112 bytes} [Thu Jul 21 19:16:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:13.600477 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638b336-8e52-4e5b-91e2-b3f8231c9517 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:13.600477 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638b336-8e52-4e5b-91e2-b3f8231c9517 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:13.600477 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638b336-8e52-4e5b-91e2-b3f8231c9517 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:13.600477 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 494/995] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:16:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:16:13.601249 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4638b336-8e52-4e5b-91e2-b3f8231c9517 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:13.642063 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:13.662971 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 502/996] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:16:13 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 19:16:13.664542 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8bc1d3-28e0-4f50-a366-a911c1999bac None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:13.664899 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8bc1d3-28e0-4f50-a366-a911c1999bac None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:13.665178 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8bc1d3-28e0-4f50-a366-a911c1999bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:13.667483 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:13.683861 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-5a8bc1d3-28e0-4f50-a366-a911c1999bac None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:16:13.683861 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-5a8bc1d3-28e0-4f50-a366-a911c1999bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:16:13.703357 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4638b336-8e52-4e5b-91e2-b3f8231c9517 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:13.737294 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f3bd3-29eb-41f4-a1f4-adfa67a13ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:13.737950 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f3bd3-29eb-41f4-a1f4-adfa67a13ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:13.738235 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f3bd3-29eb-41f4-a1f4-adfa67a13ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:13.738513 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f3bd3-29eb-41f4-a1f4-adfa67a13ee1 None admin] PATH_INFO: `/v3/services` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:13.740165 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1f3bd3-29eb-41f4-a1f4-adfa67a13ee1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:13.740476 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1f3bd3-29eb-41f4-a1f4-adfa67a13ee1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:13.741850 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1f3bd3-29eb-41f4-a1f4-adfa67a13ee1 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:13.746591 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 495/997] 10.222.0.60 () {56 vars in 1112 bytes} [Thu Jul 21 19:16:13 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:16:13.747451 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f3bd3-29eb-41f4-a1f4-adfa67a13ee1 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:13.751651 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 503/998] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:16:13 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:16:13.752362 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8bc1d3-28e0-4f50-a366-a911c1999bac None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:13.851323 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f3bd3-29eb-41f4-a1f4-adfa67a13ee1 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:13.853617 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8bc1d3-28e0-4f50-a366-a911c1999bac None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:13.864132 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:13.879074 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:13.885412 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b0481c-d0dd-4340-8e23-fd0a42819056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:13.886199 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0481c-d0dd-4340-8e23-fd0a42819056 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:13.886492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0481c-d0dd-4340-8e23-fd0a42819056 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:13.886768 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0481c-d0dd-4340-8e23-fd0a42819056 None admin] PATH_INFO: `/v3/services/image` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:13.887509 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b0481c-d0dd-4340-8e23-fd0a42819056 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:13.887641 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faabd4c-38fa-4e43-bc5e-bc1890371a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:13.888293 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faabd4c-38fa-4e43-bc5e-bc1890371a1b None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:13.888576 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faabd4c-38fa-4e43-bc5e-bc1890371a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:13.888850 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faabd4c-38fa-4e43-bc5e-bc1890371a1b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:13.888954 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b0481c-d0dd-4340-8e23-fd0a42819056 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:13.889635 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faabd4c-38fa-4e43-bc5e-bc1890371a1b None admin] RBAC: Adding query filter params (interface=public, service_id=e06b4a48c9ed44f0907573beab288dec, region_id=RegionOne) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:13.889947 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faabd4c-38fa-4e43-bc5e-bc1890371a1b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:13.891293 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faabd4c-38fa-4e43-bc5e-bc1890371a1b None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:13.896438 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 504/999] 10.222.0.60 () {56 vars in 1251 bytes} [Thu Jul 21 19:16:13 2022] GET /identity/v3/endpoints?service_id=e06b4a48c9ed44f0907573beab288dec&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:13.900280 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faabd4c-38fa-4e43-bc5e-bc1890371a1b None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:13.900472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-83b0481c-d0dd-4340-8e23-fd0a42819056 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 19:16:13.900472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:13.900472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 19:16:13.900472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 19:16:13.900472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 19:16:13.900472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 19:16:13.900472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 19:16:13.900472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:16:13.900472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 19:16:13.900472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:16:13.900472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 19:16:13.900472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:16:13.900472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:13.900472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:13.900472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:13.900472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:13.900472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:13.901760 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:13.901760 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:13.901760 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:13.901760 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:13.901760 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:13.901760 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:13.901760 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 19:16:13.901760 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 19:16:13.901760 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 19:16:13.901760 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 19:16:13.901760 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:13.901760 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:13.901760 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:13.901760 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:13.901760 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:13.901760 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:13.902599 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:13.902599 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:13.902599 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:13.902599 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:13.902599 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:13.902599 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:13.902599 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:13.902599 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:13.902599 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:13.902599 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:13.902599 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 19:16:13.902599 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:16:13.902599 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 19:16:13.902599 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:16:13.902599 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 496/1000] 10.222.0.60 () {56 vars in 1105 bytes} [Thu Jul 21 19:16:13 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:16:13.904046 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b0481c-d0dd-4340-8e23-fd0a42819056 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:14.001369 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faabd4c-38fa-4e43-bc5e-bc1890371a1b None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:14.008065 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b0481c-d0dd-4340-8e23-fd0a42819056 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:14.034759 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15529129-d9a7-4d3c-9d13-7b0f2648082c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:14.035622 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15529129-d9a7-4d3c-9d13-7b0f2648082c None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:14.035912 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15529129-d9a7-4d3c-9d13-7b0f2648082c None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:14.036182 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15529129-d9a7-4d3c-9d13-7b0f2648082c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:14.036838 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15529129-d9a7-4d3c-9d13-7b0f2648082c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:14.038327 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15529129-d9a7-4d3c-9d13-7b0f2648082c None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:14.041529 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d2436-9635-4bd2-a777-228b1d9700ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:14.042197 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d2436-9635-4bd2-a777-228b1d9700ec None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:14.042484 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d2436-9635-4bd2-a777-228b1d9700ec None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:14.042760 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d2436-9635-4bd2-a777-228b1d9700ec None admin] PATH_INFO: `/v3/services` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:14.043797 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d2436-9635-4bd2-a777-228b1d9700ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:14.044818 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d2436-9635-4bd2-a777-228b1d9700ec None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:14.050354 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-15529129-d9a7-4d3c-9d13-7b0f2648082c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 19:16:14.050354 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:14.050354 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 19:16:14.050354 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 19:16:14.050354 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 19:16:14.050354 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 19:16:14.050354 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 19:16:14.050354 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:16:14.050354 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 19:16:14.050354 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:14.050354 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 19:16:14.050354 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:14.050354 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:14.050354 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:14.050354 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:14.050354 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:14.050354 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:14.061298 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:14.061298 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:14.061298 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:14.061298 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:14.061298 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:14.061298 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:14.061298 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 19:16:14.061298 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 19:16:14.061298 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 19:16:14.061298 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 19:16:14.061298 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:14.061298 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:14.061298 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:14.061298 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:14.061298 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:14.061298 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:14.062139 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:14.062139 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:14.062139 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:14.062139 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:14.062139 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:14.062139 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:14.062139 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:14.062139 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:14.062139 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:14.062139 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:14.062139 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 19:16:14.062139 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:16:14.062139 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 19:16:14.062139 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:14.062886 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 497/1001] 10.222.0.60 () {56 vars in 1087 bytes} [Thu Jul 21 19:16:13 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:16:14.062886 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d2436-9635-4bd2-a777-228b1d9700ec None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:14.063042 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 505/1002] 10.222.0.60 () {56 vars in 1126 bytes} [Thu Jul 21 19:16:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:16:14.064803 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15529129-d9a7-4d3c-9d13-7b0f2648082c None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:14.116182 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:14.119946 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:14.165975 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d2436-9635-4bd2-a777-228b1d9700ec None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:14.184722 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15529129-d9a7-4d3c-9d13-7b0f2648082c None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:14.204907 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619601f3-3825-4ec2-bc4a-b316c7aaedf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:14.205943 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619601f3-3825-4ec2-bc4a-b316c7aaedf8 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:14.205943 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619601f3-3825-4ec2-bc4a-b316c7aaedf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:14.206933 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619601f3-3825-4ec2-bc4a-b316c7aaedf8 None admin] PATH_INFO: `/v3/services` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:14.206933 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619601f3-3825-4ec2-bc4a-b316c7aaedf8 None admin] RBAC: Adding query filter params (name=image) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:14.207142 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619601f3-3825-4ec2-bc4a-b316c7aaedf8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:14.208962 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619601f3-3825-4ec2-bc4a-b316c7aaedf8 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:14.214267 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 498/1003] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:16:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:14.220053 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619601f3-3825-4ec2-bc4a-b316c7aaedf8 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:14.224041 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbc7dd-5b61-4643-a6b0-fd53f48130b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:14.224725 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbc7dd-5b61-4643-a6b0-fd53f48130b9 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:14.225017 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbc7dd-5b61-4643-a6b0-fd53f48130b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:14.225296 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbc7dd-5b61-4643-a6b0-fd53f48130b9 None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:14.226015 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbc7dd-5b61-4643-a6b0-fd53f48130b9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:14.227472 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbc7dd-5b61-4643-a6b0-fd53f48130b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:14.227729 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbc7dd-5b61-4643-a6b0-fd53f48130b9 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:14.233139 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 506/1004] 10.222.0.60 () {56 vars in 1122 bytes} [Thu Jul 21 19:16:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:14.240186 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbc7dd-5b61-4643-a6b0-fd53f48130b9 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:14.328992 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619601f3-3825-4ec2-bc4a-b316c7aaedf8 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:14.344584 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbc7dd-5b61-4643-a6b0-fd53f48130b9 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:14.346102 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:14.353981 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:14.365866 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb3694-ec2f-4e9f-a004-71efcbaab8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:14.366542 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb3694-ec2f-4e9f-a004-71efcbaab8dd None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:14.366822 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb3694-ec2f-4e9f-a004-71efcbaab8dd None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:14.367095 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb3694-ec2f-4e9f-a004-71efcbaab8dd None admin] PATH_INFO: `/v3/services` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:14.367832 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb3694-ec2f-4e9f-a004-71efcbaab8dd None admin] RBAC: Adding query filter params (type=image) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:14.368139 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb3694-ec2f-4e9f-a004-71efcbaab8dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:14.369503 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb3694-ec2f-4e9f-a004-71efcbaab8dd None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:14.374020 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 499/1005] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:16:14 2022] GET /identity/v3/services?type=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:16:14.385513 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6223a0-467f-40ee-9869-71f1edc33c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:14.386210 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6223a0-467f-40ee-9869-71f1edc33c0e None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:14.386496 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6223a0-467f-40ee-9869-71f1edc33c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:14.386779 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6223a0-467f-40ee-9869-71f1edc33c0e None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:14.387542 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6223a0-467f-40ee-9869-71f1edc33c0e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:14.387857 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6223a0-467f-40ee-9869-71f1edc33c0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:14.389299 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6223a0-467f-40ee-9869-71f1edc33c0e None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:14.400950 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 507/1006] 10.222.0.60 () {56 vars in 1122 bytes} [Thu Jul 21 19:16:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:16:14.401972 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb3694-ec2f-4e9f-a004-71efcbaab8dd None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:14.519247 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb3694-ec2f-4e9f-a004-71efcbaab8dd None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:14.555989 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4eb07-c6fd-45ab-a9c9-139bef85dcfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:14.556727 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4eb07-c6fd-45ab-a9c9-139bef85dcfc None admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:14.557015 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4eb07-c6fd-45ab-a9c9-139bef85dcfc None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:14.557293 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4eb07-c6fd-45ab-a9c9-139bef85dcfc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:14.558053 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f4eb07-c6fd-45ab-a9c9-139bef85dcfc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:14.559415 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f4eb07-c6fd-45ab-a9c9-139bef85dcfc None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:14.624286 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 500/1007] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Jul 21 19:16:14 2022] POST /identity/v3/endpoints => generated 325 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 19:16:16.115561 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaec794-ffd3-4305-ac67-48a6e4b3054f None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:16.116086 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaec794-ffd3-4305-ac67-48a6e4b3054f None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:16.116168 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaec794-ffd3-4305-ac67-48a6e4b3054f None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:16.117623 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 508/1008] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:16:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:16:16.122734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97dd80-e2b1-4c43-b6a0-29ebd7e8f1fe None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:16.123184 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97dd80-e2b1-4c43-b6a0-29ebd7e8f1fe None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:16.123281 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97dd80-e2b1-4c43-b6a0-29ebd7e8f1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:16.139995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-8b97dd80-e2b1-4c43-b6a0-29ebd7e8f1fe None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:16:16.141166 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-8b97dd80-e2b1-4c43-b6a0-29ebd7e8f1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:16:16.184944 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:16.219953 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 501/1009] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:16:16 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:16:16.239235 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaec794-ffd3-4305-ac67-48a6e4b3054f None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:16.343791 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaec794-ffd3-4305-ac67-48a6e4b3054f None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:16.380955 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c987f7-4a98-49c4-a526-391c1d584fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:16.381664 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c987f7-4a98-49c4-a526-391c1d584fec None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:16.381951 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c987f7-4a98-49c4-a526-391c1d584fec None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:16.382236 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c987f7-4a98-49c4-a526-391c1d584fec None admin] PATH_INFO: `/v3/services/compute` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:16.382886 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c987f7-4a98-49c4-a526-391c1d584fec None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:16.384300 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c987f7-4a98-49c4-a526-391c1d584fec None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:16.395902 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-43c987f7-4a98-49c4-a526-391c1d584fec None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 19:16:16.395902 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:16.395902 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 19:16:16.395902 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 19:16:16.395902 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 19:16:16.395902 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 19:16:16.395902 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 19:16:16.395902 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:16:16.395902 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 19:16:16.395902 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:16.395902 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 19:16:16.395902 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:16.395902 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:16.395902 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:16.395902 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:16.395902 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:16.395902 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:16.396882 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:16.396882 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:16.396882 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:16.396882 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:16.396882 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:16.396882 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:16.396882 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 19:16:16.396882 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 19:16:16.396882 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 19:16:16.396882 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 19:16:16.396882 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:16.396882 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:16.396882 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:16.396882 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:16.396882 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:16.396882 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:16.397734 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:16.397734 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:16.397734 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:16.397734 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:16.397734 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:16.397734 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:16.397734 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:16.397734 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:16.397734 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:16.397734 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:16.397734 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 19:16:16.397734 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:16:16.397734 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 19:16:16.397734 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:16.397734 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 509/1010] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:16:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:16:16.404591 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97dd80-e2b1-4c43-b6a0-29ebd7e8f1fe None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:16.410193 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53507114-dfc6-4fae-8383-bb100d79f416 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:16.411016 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53507114-dfc6-4fae-8383-bb100d79f416 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:16.411296 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53507114-dfc6-4fae-8383-bb100d79f416 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:16.412810 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 510/1011] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:16:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 19:16:16.417809 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768146a0-0079-49a3-8afb-a1ff262a907e None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:16.418104 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768146a0-0079-49a3-8afb-a1ff262a907e None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:16.418388 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768146a0-0079-49a3-8afb-a1ff262a907e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:16.441129 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-768146a0-0079-49a3-8afb-a1ff262a907e None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:16:16.442352 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-768146a0-0079-49a3-8afb-a1ff262a907e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:16:16.467104 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:16.514310 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 511/1012] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:16:16 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 19:16:16.515564 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97dd80-e2b1-4c43-b6a0-29ebd7e8f1fe None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:16.537962 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768146a0-0079-49a3-8afb-a1ff262a907e None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:16.556736 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f5ebc-36ca-45d3-b334-013c1a54ec17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:16.557317 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f5ebc-36ca-45d3-b334-013c1a54ec17 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:16.557601 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f5ebc-36ca-45d3-b334-013c1a54ec17 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:16.557880 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f5ebc-36ca-45d3-b334-013c1a54ec17 None admin] PATH_INFO: `/v3/services` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:16.558578 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f5ebc-36ca-45d3-b334-013c1a54ec17 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:16.558913 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f5ebc-36ca-45d3-b334-013c1a54ec17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:16.560302 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f5ebc-36ca-45d3-b334-013c1a54ec17 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:16.565368 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 502/1013] 10.222.0.60 () {56 vars in 1112 bytes} [Thu Jul 21 19:16:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:16.570834 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f5ebc-36ca-45d3-b334-013c1a54ec17 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:16.608640 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:16.649577 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768146a0-0079-49a3-8afb-a1ff262a907e None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:16.674915 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f5ebc-36ca-45d3-b334-013c1a54ec17 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:16.686542 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d744d3a-cd5f-4f8e-a31b-7cec32f7f308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:16.687210 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d744d3a-cd5f-4f8e-a31b-7cec32f7f308 None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:16.687526 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d744d3a-cd5f-4f8e-a31b-7cec32f7f308 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:16.687803 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d744d3a-cd5f-4f8e-a31b-7cec32f7f308 None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:16.688523 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d744d3a-cd5f-4f8e-a31b-7cec32f7f308 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:16.689919 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d744d3a-cd5f-4f8e-a31b-7cec32f7f308 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:16.710562 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc803015-2caa-424e-84f4-f06130d9488c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:16.712073 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc803015-2caa-424e-84f4-f06130d9488c None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:16.712073 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc803015-2caa-424e-84f4-f06130d9488c None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:16.712073 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc803015-2caa-424e-84f4-f06130d9488c None admin] PATH_INFO: `/v3/services` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:16.712541 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc803015-2caa-424e-84f4-f06130d9488c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:16.712847 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc803015-2caa-424e-84f4-f06130d9488c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:16.714196 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc803015-2caa-424e-84f4-f06130d9488c None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:16.718874 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 503/1014] 10.222.0.60 () {56 vars in 1112 bytes} [Thu Jul 21 19:16:16 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:16:16.720227 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbccf0d6-66d3-4968-a234-37ae0056853f None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:16.720525 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbccf0d6-66d3-4968-a234-37ae0056853f None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:16.720805 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbccf0d6-66d3-4968-a234-37ae0056853f None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:16.722051 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 504/1015] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:16:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:16:16.725123 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbccf0d6-66d3-4968-a234-37ae0056853f None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:16.780558 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 512/1016] 10.222.0.60 () {60 vars in 1141 bytes} [Thu Jul 21 19:16:16 2022] POST /identity/v3/services => generated 242 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:16:16.782049 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ba2f4-0ac3-4f0a-b46f-3209c645a0f3 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:16.782346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ba2f4-0ac3-4f0a-b46f-3209c645a0f3 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:16.782646 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ba2f4-0ac3-4f0a-b46f-3209c645a0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:16.801021 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-992ba2f4-0ac3-4f0a-b46f-3209c645a0f3 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:16:16.802415 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-992ba2f4-0ac3-4f0a-b46f-3209c645a0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:16:16.819314 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:16.834295 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:16.844683 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbccf0d6-66d3-4968-a234-37ae0056853f None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:16.881320 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 513/1017] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:16:16 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:16:16.893354 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e0ba0-f961-4164-ae8c-f0959240d817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:16.894154 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e0ba0-f961-4164-ae8c-f0959240d817 None admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:16.894513 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e0ba0-f961-4164-ae8c-f0959240d817 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:16.895423 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e0ba0-f961-4164-ae8c-f0959240d817 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:16.896299 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e0ba0-f961-4164-ae8c-f0959240d817 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:16.897772 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e0ba0-f961-4164-ae8c-f0959240d817 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:16.906807 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ba2f4-0ac3-4f0a-b46f-3209c645a0f3 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:17.004574 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 505/1018] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Jul 21 19:16:16 2022] POST /identity/v3/endpoints => generated 334 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 19:16:17.007500 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ba2f4-0ac3-4f0a-b46f-3209c645a0f3 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:17.056198 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc862969-b0b7-43e0-98c5-3497b8006c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:17.057021 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc862969-b0b7-43e0-98c5-3497b8006c10 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:17.057361 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc862969-b0b7-43e0-98c5-3497b8006c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:17.057641 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc862969-b0b7-43e0-98c5-3497b8006c10 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:17.058957 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc862969-b0b7-43e0-98c5-3497b8006c10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:17.060501 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc862969-b0b7-43e0-98c5-3497b8006c10 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:17.067729 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 514/1019] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:16:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:17.069402 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e0ba0-f961-4164-ae8c-f0959240d817 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:17.183018 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e0ba0-f961-4164-ae8c-f0959240d817 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:17.219772 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9063cc2-d75b-4333-83c9-5d9dcbb95211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:17.220448 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9063cc2-d75b-4333-83c9-5d9dcbb95211 None admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:17.220736 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9063cc2-d75b-4333-83c9-5d9dcbb95211 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:17.221012 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9063cc2-d75b-4333-83c9-5d9dcbb95211 None admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:17.221763 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9063cc2-d75b-4333-83c9-5d9dcbb95211 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:17.223223 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9063cc2-d75b-4333-83c9-5d9dcbb95211 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:17.311621 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 506/1020] 10.222.0.60 () {60 vars in 1141 bytes} [Thu Jul 21 19:16:17 2022] POST /identity/v3/projects => generated 311 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:16:18.853822 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358e034-6cca-4301-845d-ccbf70be64e0 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:18.854360 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358e034-6cca-4301-845d-ccbf70be64e0 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:18.854360 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358e034-6cca-4301-845d-ccbf70be64e0 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:18.859247 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 515/1021] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:16:18.861221 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063ae86-be1c-44af-a769-666a4dc4eebf None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:18.861638 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063ae86-be1c-44af-a769-666a4dc4eebf None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:18.861801 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063ae86-be1c-44af-a769-666a4dc4eebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:18.867694 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:18.878477 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-6063ae86-be1c-44af-a769-666a4dc4eebf None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:16:18.880625 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-6063ae86-be1c-44af-a769-666a4dc4eebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:16:18.948261 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 507/1022] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:16:18 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:16:18.971052 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358e034-6cca-4301-845d-ccbf70be64e0 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:18.987636 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:19.076612 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358e034-6cca-4301-845d-ccbf70be64e0 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:19.111186 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f88a4b-378e-4fec-9813-6827b8eb2b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:19.111972 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f88a4b-378e-4fec-9813-6827b8eb2b34 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:19.112252 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f88a4b-378e-4fec-9813-6827b8eb2b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:19.112521 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f88a4b-378e-4fec-9813-6827b8eb2b34 None admin] PATH_INFO: `/v3/services/image` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:19.113163 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f88a4b-378e-4fec-9813-6827b8eb2b34 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:19.114641 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f88a4b-378e-4fec-9813-6827b8eb2b34 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:19.126116 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-82f88a4b-378e-4fec-9813-6827b8eb2b34 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 19:16:19.126116 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:19.126116 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 19:16:19.126116 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 19:16:19.126116 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 19:16:19.126116 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 19:16:19.126116 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 19:16:19.126116 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:16:19.126116 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 19:16:19.126116 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:19.126116 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 19:16:19.126116 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:19.126116 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:19.126116 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:19.126116 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:19.126116 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:19.126116 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:19.127123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:19.127123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:19.127123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:19.127123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:19.127123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:19.127123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:19.127123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 19:16:19.127123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 19:16:19.127123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 19:16:19.127123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 19:16:19.127123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:19.127123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:19.127123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:19.127123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:19.127123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:19.127123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:19.128029 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:19.128029 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:19.128029 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:19.128029 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:19.128029 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:19.128029 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:19.128029 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:19.128029 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:19.128029 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:19.128029 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:19.128029 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 19:16:19.128029 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:16:19.128029 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 19:16:19.128029 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:19.131772 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 516/1023] 10.222.0.60 () {56 vars in 1105 bytes} [Thu Jul 21 19:16:18 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:16:19.133377 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063ae86-be1c-44af-a769-666a4dc4eebf None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:19.175969 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f41422-9ce0-4d4e-89b2-706e48b046e2 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:19.176315 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f41422-9ce0-4d4e-89b2-706e48b046e2 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:19.181384 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f41422-9ce0-4d4e-89b2-706e48b046e2 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:19.181384 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 517/1024] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:16:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:16:19.183297 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b124c-1236-427b-aad1-b36f1064c017 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:19.183626 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b124c-1236-427b-aad1-b36f1064c017 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:19.183912 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b124c-1236-427b-aad1-b36f1064c017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:19.201099 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-ab5b124c-1236-427b-aad1-b36f1064c017 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:16:19.202297 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ab5b124c-1236-427b-aad1-b36f1064c017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:16:19.242241 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063ae86-be1c-44af-a769-666a4dc4eebf None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:19.279078 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 518/1025] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:16:19 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 19:16:19.280224 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ffd61-6f8a-459d-b349-a04880e0c784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:19.281106 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ffd61-6f8a-459d-b349-a04880e0c784 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:19.281609 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ffd61-6f8a-459d-b349-a04880e0c784 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:19.282069 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ffd61-6f8a-459d-b349-a04880e0c784 None admin] PATH_INFO: `/v3/services` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:19.282959 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ffd61-6f8a-459d-b349-a04880e0c784 None admin] RBAC: Adding query filter params (name=image) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:19.283474 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ffd61-6f8a-459d-b349-a04880e0c784 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:19.285028 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ffd61-6f8a-459d-b349-a04880e0c784 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:19.287132 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:19.291976 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 508/1026] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:16:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:19.297300 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b124c-1236-427b-aad1-b36f1064c017 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:19.305136 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ffd61-6f8a-459d-b349-a04880e0c784 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:19.308495 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:19.406128 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ffd61-6f8a-459d-b349-a04880e0c784 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:19.406549 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b124c-1236-427b-aad1-b36f1064c017 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:19.439767 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c659f3-45a4-4820-b638-9348d285ebef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:19.440584 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c659f3-45a4-4820-b638-9348d285ebef None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:19.440867 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c659f3-45a4-4820-b638-9348d285ebef None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:19.441145 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c659f3-45a4-4820-b638-9348d285ebef None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:19.442065 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2976125f-cd63-44cc-bfaa-4a09d2fa1b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:19.442720 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976125f-cd63-44cc-bfaa-4a09d2fa1b25 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:19.442999 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976125f-cd63-44cc-bfaa-4a09d2fa1b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:19.443374 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976125f-cd63-44cc-bfaa-4a09d2fa1b25 None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:19.444017 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2976125f-cd63-44cc-bfaa-4a09d2fa1b25 None admin] RBAC: Adding query filter params (type=image) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:19.444325 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2976125f-cd63-44cc-bfaa-4a09d2fa1b25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:19.445690 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2976125f-cd63-44cc-bfaa-4a09d2fa1b25 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:19.450449 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 519/1027] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:16:19 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:19.451662 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a220c8-fabf-4a37-b61a-a278dafc1aae None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:19.451790 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c659f3-45a4-4820-b638-9348d285ebef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:16:19.451959 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a220c8-fabf-4a37-b61a-a278dafc1aae None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:19.452222 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a220c8-fabf-4a37-b61a-a278dafc1aae None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:19.455587 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 520/1028] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:16:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:16:19.456357 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a220c8-fabf-4a37-b61a-a278dafc1aae None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:19.460776 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-a9c659f3-45a4-4820-b638-9348d285ebef None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 19:16:19.460776 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:19.460776 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:19.460776 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:19.460776 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:19.460776 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:19.460776 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:19.460776 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:19.460776 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:19.460776 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:19.460776 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:19.460776 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:19.460776 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:16:19.460776 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:16:19.460776 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:16:19.460776 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:16:19.461823 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:16:19.461823 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:16:19.461823 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:16:19.461823 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:16:19.461823 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:19.461823 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:19.461823 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:19.461823 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:19.461823 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:19.461823 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:19.461823 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:19.461823 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:19.461823 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:19.461823 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:19.461823 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:19.461823 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:19.462710 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:19.462710 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:19.462710 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:19.462710 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:19.462710 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:16:19.462710 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:16:19.462710 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:16:19.462710 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:16:19.462710 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:16:19.462710 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:16:19.462710 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 19:16:19.462710 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:16:19.462710 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 509/1029] 10.222.0.60 () {56 vars in 1120 bytes} [Thu Jul 21 19:16:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:16:19.463861 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa2e6d-a838-456f-a5eb-230e8686bf22 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:19.463861 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa2e6d-a838-456f-a5eb-230e8686bf22 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:19.463861 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa2e6d-a838-456f-a5eb-230e8686bf22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:19.480040 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-bfaa2e6d-a838-456f-a5eb-230e8686bf22 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:16:19.481220 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-bfaa2e6d-a838-456f-a5eb-230e8686bf22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:16:19.530563 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:19.534113 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:19.547004 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 510/1030] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:16:19 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:16:19.547829 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa2e6d-a838-456f-a5eb-230e8686bf22 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:19.561150 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a220c8-fabf-4a37-b61a-a278dafc1aae None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:19.597623 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761ce61-f0e0-4acd-b551-f53488ee85be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:19.598308 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761ce61-f0e0-4acd-b551-f53488ee85be None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:19.598652 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761ce61-f0e0-4acd-b551-f53488ee85be None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:19.598929 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761ce61-f0e0-4acd-b551-f53488ee85be None admin] PATH_INFO: `/v3/endpoints` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:19.599748 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8761ce61-f0e0-4acd-b551-f53488ee85be None admin] RBAC: Adding query filter params (interface=public, service_id=1991ce464f4c4b12bfe09dad470f157a, region_id=RegionOne) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:19.600064 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8761ce61-f0e0-4acd-b551-f53488ee85be None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:19.601441 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8761ce61-f0e0-4acd-b551-f53488ee85be None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:19.606664 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 521/1031] 10.222.0.60 () {56 vars in 1251 bytes} [Thu Jul 21 19:16:19 2022] GET /identity/v3/endpoints?service_id=1991ce464f4c4b12bfe09dad470f157a&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:19.607452 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761ce61-f0e0-4acd-b551-f53488ee85be None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:19.651894 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa2e6d-a838-456f-a5eb-230e8686bf22 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:19.684783 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f0e00-816d-4de5-bb15-bc9e0bbc28b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:19.685381 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f0e00-816d-4de5-bb15-bc9e0bbc28b9 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:19.685661 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f0e00-816d-4de5-bb15-bc9e0bbc28b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:19.685936 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f0e00-816d-4de5-bb15-bc9e0bbc28b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:19.686669 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f0e00-816d-4de5-bb15-bc9e0bbc28b9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:19.686979 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f0e00-816d-4de5-bb15-bc9e0bbc28b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:19.688358 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f0e00-816d-4de5-bb15-bc9e0bbc28b9 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:19.697808 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 511/1032] 10.222.0.60 () {56 vars in 1115 bytes} [Thu Jul 21 19:16:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:19.698657 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f0e00-816d-4de5-bb15-bc9e0bbc28b9 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:19.706784 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761ce61-f0e0-4acd-b551-f53488ee85be None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:19.741228 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59175b26-11c6-4034-a4ec-43b343664cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:19.742008 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59175b26-11c6-4034-a4ec-43b343664cbf None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:19.742290 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59175b26-11c6-4034-a4ec-43b343664cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:19.742565 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59175b26-11c6-4034-a4ec-43b343664cbf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:19.743747 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59175b26-11c6-4034-a4ec-43b343664cbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:19.745164 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59175b26-11c6-4034-a4ec-43b343664cbf None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:19.746756 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 522/1033] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:16:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:19.747526 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59175b26-11c6-4034-a4ec-43b343664cbf None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:19.750759 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:19.752636 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:19.799447 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f0e00-816d-4de5-bb15-bc9e0bbc28b9 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:19.832872 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9ccab-a526-47b1-a6ca-0874ab771c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:19.833534 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9ccab-a526-47b1-a6ca-0874ab771c8a None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:19.833818 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9ccab-a526-47b1-a6ca-0874ab771c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:19.834099 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9ccab-a526-47b1-a6ca-0874ab771c8a None admin] PATH_INFO: `/v3/services` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:19.834775 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace9ccab-a526-47b1-a6ca-0874ab771c8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:19.836165 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace9ccab-a526-47b1-a6ca-0874ab771c8a None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:19.842490 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 512/1034] 10.222.0.60 () {56 vars in 1087 bytes} [Thu Jul 21 19:16:19 2022] GET /identity/v3/services => generated 1957 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:16:19.843237 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9ccab-a526-47b1-a6ca-0874ab771c8a None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:19.847375 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59175b26-11c6-4034-a4ec-43b343664cbf None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:19.887730 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710265d-66ca-4419-9d2f-6c3d52ff2828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:19.888571 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710265d-66ca-4419-9d2f-6c3d52ff2828 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:19.888858 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710265d-66ca-4419-9d2f-6c3d52ff2828 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:19.889137 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710265d-66ca-4419-9d2f-6c3d52ff2828 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:19.901598 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0710265d-66ca-4419-9d2f-6c3d52ff2828 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:19.903071 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0710265d-66ca-4419-9d2f-6c3d52ff2828 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:19.922464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-0710265d-66ca-4419-9d2f-6c3d52ff2828 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:16:19.922464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:19.922464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:19.922464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:19.922464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:19.922464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:19.922464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:19.922464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:19.922464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:19.922464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:19.922464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:19.922464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:19.922464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:16:19.922464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:16:19.922464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:16:19.923537 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:16:19.923537 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:19.923537 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:19.923537 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:19.923537 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:19.923537 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:19.923537 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:19.923537 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:19.923537 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:19.923537 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:19.923537 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:19.923537 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:19.923537 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:19.923537 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:19.923537 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:19.923537 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:19.923537 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:19.924498 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:16:19.924498 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:16:19.924498 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:16:19.924498 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:19.924498 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 523/1035] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:16:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:16:19.930346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710265d-66ca-4419-9d2f-6c3d52ff2828 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:19.971512 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9ccab-a526-47b1-a6ca-0874ab771c8a None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:19.986171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:19.995861 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:20.011547 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6465d-0f56-48de-823b-a7cf48cb0d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:20.012226 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6465d-0f56-48de-823b-a7cf48cb0d78 None admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:20.012508 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6465d-0f56-48de-823b-a7cf48cb0d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:20.012783 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6465d-0f56-48de-823b-a7cf48cb0d78 None admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:20.013500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e6465d-0f56-48de-823b-a7cf48cb0d78 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:20.014949 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e6465d-0f56-48de-823b-a7cf48cb0d78 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:20.044756 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710265d-66ca-4419-9d2f-6c3d52ff2828 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:20.080997 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e1258-43d4-402e-90ae-886cb9b3dc47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:20.081659 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e1258-43d4-402e-90ae-886cb9b3dc47 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:20.081947 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e1258-43d4-402e-90ae-886cb9b3dc47 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:20.082255 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e1258-43d4-402e-90ae-886cb9b3dc47 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:20.082999 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e1258-43d4-402e-90ae-886cb9b3dc47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:20.083313 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e1258-43d4-402e-90ae-886cb9b3dc47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:20.084779 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e1258-43d4-402e-90ae-886cb9b3dc47 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:20.096282 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 524/1036] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:16:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:20.102756 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e1258-43d4-402e-90ae-886cb9b3dc47 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:20.135255 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 513/1037] 10.222.0.60 () {60 vars in 1132 bytes} [Thu Jul 21 19:16:19 2022] POST /identity/v3/users => generated 285 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:16:20.218063 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e1258-43d4-402e-90ae-886cb9b3dc47 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:20.236464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:20.257078 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8fa76-1901-4e11-9a91-72440e803eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:20.257916 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8fa76-1901-4e11-9a91-72440e803eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:20.258208 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8fa76-1901-4e11-9a91-72440e803eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:20.258489 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8fa76-1901-4e11-9a91-72440e803eb9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:20.267191 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8fa76-1901-4e11-9a91-72440e803eb9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:20.268720 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8fa76-1901-4e11-9a91-72440e803eb9 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:20.284732 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-6be8fa76-1901-4e11-9a91-72440e803eb9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 19:16:20.284732 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:20.284732 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:20.284732 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:20.284732 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:20.284732 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:20.284732 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:20.284732 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:20.284732 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:20.284732 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:20.284732 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:20.284732 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:20.284732 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 19:16:20.284732 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 19:16:20.284732 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 19:16:20.284732 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 19:16:20.286687 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:20.286687 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:20.286687 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 19:16:20.286687 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:16:20.286687 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 19:16:20.286687 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:16:20.286687 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:20.286687 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:20.286687 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:20.286687 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:20.286687 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:20.286687 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:20.286687 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:20.286687 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:20.286687 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:20.286687 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:20.286687 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:20.286687 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:20.287775 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:20.287775 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:20.287775 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 19:16:20.287775 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 19:16:20.287775 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 19:16:20.287775 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 19:16:20.287775 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 19:16:20.287775 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 19:16:20.287775 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 19:16:20.287775 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:20.294617 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 525/1038] 10.222.0.60 () {56 vars in 1093 bytes} [Thu Jul 21 19:16:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:16:20.296911 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6465d-0f56-48de-823b-a7cf48cb0d78 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:20.400495 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6465d-0f56-48de-823b-a7cf48cb0d78 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:20.440318 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e0f27-679b-4377-a02c-4ed246beec12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:20.440996 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e0f27-679b-4377-a02c-4ed246beec12 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:20.441280 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e0f27-679b-4377-a02c-4ed246beec12 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:20.441561 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e0f27-679b-4377-a02c-4ed246beec12 None admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:20.442601 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e0f27-679b-4377-a02c-4ed246beec12 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:20.442912 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e0f27-679b-4377-a02c-4ed246beec12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:20.444361 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e0f27-679b-4377-a02c-4ed246beec12 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:20.462584 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 514/1039] 10.222.0.60 () {56 vars in 1133 bytes} [Thu Jul 21 19:16:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:20.468378 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8fa76-1901-4e11-9a91-72440e803eb9 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:20.573632 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8fa76-1901-4e11-9a91-72440e803eb9 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:20.607829 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ce98f-1206-4cf9-a034-9f081ed2526e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:20.608477 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ce98f-1206-4cf9-a034-9f081ed2526e None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:20.608759 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ce98f-1206-4cf9-a034-9f081ed2526e None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:20.609033 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ce98f-1206-4cf9-a034-9f081ed2526e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:20.653781 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:20.678949 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ce98f-1206-4cf9-a034-9f081ed2526e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:20.681715 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ce98f-1206-4cf9-a034-9f081ed2526e None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:20.787083 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 526/1040] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:16:20 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 19:16:20.788697 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e0f27-679b-4377-a02c-4ed246beec12 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:20.817430 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:20.890553 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e0f27-679b-4377-a02c-4ed246beec12 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:20.925552 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefdbd42-cc2e-4f0d-ab1f-21b35eb1c12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:20.926442 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdbd42-cc2e-4f0d-ab1f-21b35eb1c12e None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:20.926728 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdbd42-cc2e-4f0d-ab1f-21b35eb1c12e None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:20.927008 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdbd42-cc2e-4f0d-ab1f-21b35eb1c12e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:20.937628 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefdbd42-cc2e-4f0d-ab1f-21b35eb1c12e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:20.939077 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefdbd42-cc2e-4f0d-ab1f-21b35eb1c12e None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:20.957846 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-aefdbd42-cc2e-4f0d-ab1f-21b35eb1c12e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:16:20.957846 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:20.957846 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:20.957846 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:20.957846 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:20.957846 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:20.957846 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:20.957846 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:20.957846 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:20.957846 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:20.957846 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:20.957846 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:20.957846 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:16:20.957846 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:16:20.957846 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:16:20.958844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:16:20.958844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:20.958844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:20.958844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:20.958844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:20.958844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:20.958844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:20.958844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:20.958844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:20.958844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:20.958844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:20.958844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:20.958844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:20.958844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:20.958844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:20.958844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:20.958844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:20.959793 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:16:20.959793 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:16:20.959793 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:16:20.959793 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:16:20.959793 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 515/1041] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:16:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:16:20.965923 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ce98f-1206-4cf9-a034-9f081ed2526e None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:21.045463 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:21.069918 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ce98f-1206-4cf9-a034-9f081ed2526e None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:21.104909 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b80b67-eb97-4c6e-9d34-51ab31b35caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:21.105575 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b80b67-eb97-4c6e-9d34-51ab31b35caf None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:21.105862 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b80b67-eb97-4c6e-9d34-51ab31b35caf None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:21.106142 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b80b67-eb97-4c6e-9d34-51ab31b35caf None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:21.106865 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b80b67-eb97-4c6e-9d34-51ab31b35caf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:21.107178 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b80b67-eb97-4c6e-9d34-51ab31b35caf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:21.108580 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b80b67-eb97-4c6e-9d34-51ab31b35caf None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:21.124163 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 527/1042] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:16:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:21.125296 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefdbd42-cc2e-4f0d-ab1f-21b35eb1c12e None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:21.206605 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:21.226533 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefdbd42-cc2e-4f0d-ab1f-21b35eb1c12e None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:21.262257 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7251c2-5df0-4ac9-a19b-0d3dddd1a72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:21.263059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7251c2-5df0-4ac9-a19b-0d3dddd1a72b None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:21.263347 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7251c2-5df0-4ac9-a19b-0d3dddd1a72b None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:21.263661 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7251c2-5df0-4ac9-a19b-0d3dddd1a72b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:21.270636 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7251c2-5df0-4ac9-a19b-0d3dddd1a72b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:21.272118 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7251c2-5df0-4ac9-a19b-0d3dddd1a72b None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:21.286132 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-ee7251c2-5df0-4ac9-a19b-0d3dddd1a72b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:16:21.286132 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:21.286132 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:21.286132 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:21.286132 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:21.286132 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:21.286132 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:21.286132 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:21.286132 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:21.286132 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:21.286132 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:21.286132 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:21.286132 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 19:16:21.286132 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 19:16:21.286132 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 19:16:21.287032 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 19:16:21.287032 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:21.287032 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:21.287032 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:21.287032 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:21.287032 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:21.287032 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:21.287032 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:21.287032 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:21.287032 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:21.287032 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:21.287032 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:21.287032 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:21.287032 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:21.287032 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:21.287032 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:21.287032 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:21.292279 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 19:16:21.292279 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 19:16:21.292279 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 19:16:21.292279 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 19:16:21.292279 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 19:16:21.292279 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 19:16:21.292279 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:16:21.292279 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:16:21.292279 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 516/1043] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:16:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:16:21.294514 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b80b67-eb97-4c6e-9d34-51ab31b35caf None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:21.400558 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b80b67-eb97-4c6e-9d34-51ab31b35caf None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:21.442773 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe1e2fb-ad20-41cf-bbd5-07c2161c9d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:21.443678 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1e2fb-ad20-41cf-bbd5-07c2161c9d84 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:21.444127 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1e2fb-ad20-41cf-bbd5-07c2161c9d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:21.444565 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1e2fb-ad20-41cf-bbd5-07c2161c9d84 None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:21.445498 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe1e2fb-ad20-41cf-bbd5-07c2161c9d84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:21.445951 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe1e2fb-ad20-41cf-bbd5-07c2161c9d84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:21.447540 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe1e2fb-ad20-41cf-bbd5-07c2161c9d84 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:21.450834 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:21.466555 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 528/1044] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Jul 21 19:16:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:21.467758 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7251c2-5df0-4ac9-a19b-0d3dddd1a72b None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:21.570218 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7251c2-5df0-4ac9-a19b-0d3dddd1a72b None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:21.603835 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb59d406-829c-4664-9177-4d8fd06489c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:21.604495 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59d406-829c-4664-9177-4d8fd06489c7 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:21.604784 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59d406-829c-4664-9177-4d8fd06489c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:21.605059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59d406-829c-4664-9177-4d8fd06489c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:21.605887 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb59d406-829c-4664-9177-4d8fd06489c7 None admin] RBAC: Adding query filter params (role.id=09fd90e2b50d4b809ba2614d2d228a4c, scope.project.id=9847b5e8bc0b4483bbce060a48f405f4, user.id=6b4d98e967814e5f84f5f0d67ebb3c17) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:21.606201 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb59d406-829c-4664-9177-4d8fd06489c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:21.607684 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb59d406-829c-4664-9177-4d8fd06489c7 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:21.619680 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 517/1045] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:16:21 2022] GET /identity/v3/role_assignments?user.id=6b4d98e967814e5f84f5f0d67ebb3c17&scope.project.id=9847b5e8bc0b4483bbce060a48f405f4&role.id=09fd90e2b50d4b809ba2614d2d228a4c => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:21.908291 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66bd42-ecf7-4cdf-96ca-558c85d1884e None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:21.908661 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66bd42-ecf7-4cdf-96ca-558c85d1884e None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:21.908857 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66bd42-ecf7-4cdf-96ca-558c85d1884e None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:21.910754 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 529/1046] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:16:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:16:21.916225 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc720c57-ad4b-4e2f-b506-41cd4266d763 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:21.916525 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc720c57-ad4b-4e2f-b506-41cd4266d763 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:21.916808 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc720c57-ad4b-4e2f-b506-41cd4266d763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:21.922781 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:21.935213 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-cc720c57-ad4b-4e2f-b506-41cd4266d763 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:16:21.939582 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-cc720c57-ad4b-4e2f-b506-41cd4266d763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:16:22.004962 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 518/1047] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:16:21 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:16:22.028256 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c66bd42-ecf7-4cdf-96ca-558c85d1884e None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:22.135687 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c66bd42-ecf7-4cdf-96ca-558c85d1884e None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:22.171109 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6a724-904e-4642-9c7b-f43f1e1f6d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:22.171858 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6a724-904e-4642-9c7b-f43f1e1f6d3f None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:22.172148 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6a724-904e-4642-9c7b-f43f1e1f6d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:22.172433 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6a724-904e-4642-9c7b-f43f1e1f6d3f None admin] PATH_INFO: `/v3/services/image` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:22.173095 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6a724-904e-4642-9c7b-f43f1e1f6d3f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:22.174521 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6a724-904e-4642-9c7b-f43f1e1f6d3f None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:22.186600 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-9bd6a724-904e-4642-9c7b-f43f1e1f6d3f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 19:16:22.186600 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:22.186600 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 19:16:22.186600 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 19:16:22.186600 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 19:16:22.186600 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 19:16:22.186600 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 19:16:22.186600 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:16:22.186600 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 19:16:22.186600 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:22.186600 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 19:16:22.186600 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:22.186600 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:22.186600 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:22.186600 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:22.186600 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:22.186600 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:22.187660 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:22.187660 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:22.187660 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:22.187660 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:22.187660 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:22.187660 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:22.187660 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 19:16:22.187660 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 19:16:22.187660 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 19:16:22.187660 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 19:16:22.187660 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:22.187660 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:22.187660 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:22.187660 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:22.187660 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:22.187660 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:22.188515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:22.188515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:22.188515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:22.188515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:22.188515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:22.188515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:22.188515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:22.188515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:22.188515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:22.188515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:22.188515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 19:16:22.188515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:16:22.188515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 19:16:22.188515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:22.189865 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 530/1048] 10.222.0.60 () {56 vars in 1105 bytes} [Thu Jul 21 19:16:22 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:16:22.194146 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc720c57-ad4b-4e2f-b506-41cd4266d763 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:22.243863 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318aa4e-cffc-4d65-a52a-696bf1c6934f None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:22.244190 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318aa4e-cffc-4d65-a52a-696bf1c6934f None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:22.244431 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318aa4e-cffc-4d65-a52a-696bf1c6934f None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:22.245817 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 531/1049] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 19:16:22.250913 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f784d-675f-4fd0-ad8c-cc9c0d6eb384 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:22.251230 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f784d-675f-4fd0-ad8c-cc9c0d6eb384 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:22.251516 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f784d-675f-4fd0-ad8c-cc9c0d6eb384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:22.268036 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-215f784d-675f-4fd0-ad8c-cc9c0d6eb384 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:16:22.269228 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-215f784d-675f-4fd0-ad8c-cc9c0d6eb384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:16:22.300948 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc720c57-ad4b-4e2f-b506-41cd4266d763 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:22.332974 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:22.341918 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c7ebb-7930-4a2e-b6e3-d57fa405bb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:22.342642 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c7ebb-7930-4a2e-b6e3-d57fa405bb00 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:22.342932 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c7ebb-7930-4a2e-b6e3-d57fa405bb00 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:22.343212 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c7ebb-7930-4a2e-b6e3-d57fa405bb00 None admin] PATH_INFO: `/v3/services` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:22.345484 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c7ebb-7930-4a2e-b6e3-d57fa405bb00 None admin] RBAC: Adding query filter params (name=image) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:22.345600 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 532/1050] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:16:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 19:16:22.345689 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c7ebb-7930-4a2e-b6e3-d57fa405bb00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:22.345689 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c7ebb-7930-4a2e-b6e3-d57fa405bb00 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:22.346925 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:22.355824 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 519/1051] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:16:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:22.357504 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f784d-675f-4fd0-ad8c-cc9c0d6eb384 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:22.368439 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c7ebb-7930-4a2e-b6e3-d57fa405bb00 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:22.466577 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f784d-675f-4fd0-ad8c-cc9c0d6eb384 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:22.484777 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c7ebb-7930-4a2e-b6e3-d57fa405bb00 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:22.503734 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14110bb2-34b5-4e9e-9601-7afcaa3ecb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:22.504920 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14110bb2-34b5-4e9e-9601-7afcaa3ecb5e None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:22.505363 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14110bb2-34b5-4e9e-9601-7afcaa3ecb5e None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:22.505640 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14110bb2-34b5-4e9e-9601-7afcaa3ecb5e None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:22.506341 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14110bb2-34b5-4e9e-9601-7afcaa3ecb5e None admin] RBAC: Adding query filter params (type=image) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:22.506647 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14110bb2-34b5-4e9e-9601-7afcaa3ecb5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:22.508048 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14110bb2-34b5-4e9e-9601-7afcaa3ecb5e None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:22.512864 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 533/1052] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:16:22 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:22.518295 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14110bb2-34b5-4e9e-9601-7afcaa3ecb5e None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:22.541017 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd550a81-fa30-4d8c-8cca-5fe5c0d767b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:22.541815 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd550a81-fa30-4d8c-8cca-5fe5c0d767b3 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:22.542102 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd550a81-fa30-4d8c-8cca-5fe5c0d767b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:22.542381 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd550a81-fa30-4d8c-8cca-5fe5c0d767b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:22.554088 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd550a81-fa30-4d8c-8cca-5fe5c0d767b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:16:22.562092 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-dd550a81-fa30-4d8c-8cca-5fe5c0d767b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:16:22.562092 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:22.562092 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:22.562092 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:22.562092 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:22.562092 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:22.562092 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:22.562092 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:22.562092 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:22.562092 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:22.562092 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:22.562092 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:22.562092 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:16:22.562092 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:16:22.562092 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:16:22.562092 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:16:22.563223 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:16:22.563223 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:16:22.563223 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:16:22.563223 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:16:22.563223 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:22.563223 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:22.563223 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:22.563223 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:22.563223 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:22.563223 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:22.563223 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:22.563223 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:22.563223 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:22.563223 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:22.563223 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:22.563223 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:22.564520 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:22.564520 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:22.564520 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:22.564520 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:22.564520 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:16:22.564520 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:16:22.564520 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:16:22.564520 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:16:22.564520 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:16:22.564520 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:16:22.564520 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:16:22.564520 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:16:22.564520 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 520/1053] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Jul 21 19:16:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:16:22.569930 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd550a81-fa30-4d8c-8cca-5fe5c0d767b3 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:22.578278 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:22.627234 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14110bb2-34b5-4e9e-9601-7afcaa3ecb5e None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:22.633567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:22.663603 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582a86a-80ea-446a-9ee9-87a38483991a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:22.664379 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582a86a-80ea-446a-9ee9-87a38483991a None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:22.664660 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582a86a-80ea-446a-9ee9-87a38483991a None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:22.664937 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582a86a-80ea-446a-9ee9-87a38483991a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:22.665682 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1582a86a-80ea-446a-9ee9-87a38483991a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:22.667179 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1582a86a-80ea-446a-9ee9-87a38483991a None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:22.680140 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd550a81-fa30-4d8c-8cca-5fe5c0d767b3 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:22.714513 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da98c404-6be6-4370-b11e-853d808a3b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:22.715188 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98c404-6be6-4370-b11e-853d808a3b7d None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:22.715499 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98c404-6be6-4370-b11e-853d808a3b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:22.715775 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98c404-6be6-4370-b11e-853d808a3b7d None admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:22.716525 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da98c404-6be6-4370-b11e-853d808a3b7d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:22.716840 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da98c404-6be6-4370-b11e-853d808a3b7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:22.718241 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da98c404-6be6-4370-b11e-853d808a3b7d None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:22.728193 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 521/1054] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:16:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:16:22.733990 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da98c404-6be6-4370-b11e-853d808a3b7d None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:22.763471 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 534/1055] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Jul 21 19:16:22 2022] POST /identity/v3/endpoints => generated 327 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 19:16:22.856314 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da98c404-6be6-4370-b11e-853d808a3b7d None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:22.878126 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:22.901067 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49bc655-a071-4fe9-8f64-5b2f7ae8b7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:22.901974 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bc655-a071-4fe9-8f64-5b2f7ae8b7ac None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:22.902261 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bc655-a071-4fe9-8f64-5b2f7ae8b7ac None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:22.902540 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bc655-a071-4fe9-8f64-5b2f7ae8b7ac None admin] PATH_INFO: `/v3/users/73c815c11f6d4164a6e0e427e446c283` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:22.920678 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49bc655-a071-4fe9-8f64-5b2f7ae8b7ac None admin] RBAC: Authorizing `identity:get_user(user_id=73c815c11f6d4164a6e0e427e446c283)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:22.922269 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49bc655-a071-4fe9-8f64-5b2f7ae8b7ac None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:22.924418 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 522/1056] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:16:22 2022] GET /identity/v3/users/73c815c11f6d4164a6e0e427e446c283 => generated 285 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:22.930116 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582a86a-80ea-446a-9ee9-87a38483991a None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:23.034943 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582a86a-80ea-446a-9ee9-87a38483991a None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:23.046312 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:23.071024 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ae6d2-7276-4e90-be30-ea88b4fb346a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:23.071974 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ae6d2-7276-4e90-be30-ea88b4fb346a None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:23.072408 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ae6d2-7276-4e90-be30-ea88b4fb346a None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:23.072834 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ae6d2-7276-4e90-be30-ea88b4fb346a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:23.143027 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ae6d2-7276-4e90-be30-ea88b4fb346a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:23.145395 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ae6d2-7276-4e90-be30-ea88b4fb346a None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:23.246398 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 535/1057] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:16:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 19:16:23.252167 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49bc655-a071-4fe9-8f64-5b2f7ae8b7ac None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:23.357749 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49bc655-a071-4fe9-8f64-5b2f7ae8b7ac None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:23.392510 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9ccf0-3a65-4595-8067-98a125d8e474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:23.393369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9ccf0-3a65-4595-8067-98a125d8e474 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:23.393654 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9ccf0-3a65-4595-8067-98a125d8e474 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:23.393933 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9ccf0-3a65-4595-8067-98a125d8e474 None admin] PATH_INFO: `/v3/projects/aa6ff855c9204302b728218d6827fdad` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:23.395906 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c9ccf0-3a65-4595-8067-98a125d8e474 None admin] RBAC: Authorizing `identity:get_project(project_id=aa6ff855c9204302b728218d6827fdad)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:23.397331 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c9ccf0-3a65-4595-8067-98a125d8e474 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:23.399200 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 523/1058] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:16:23 2022] GET /identity/v3/projects/aa6ff855c9204302b728218d6827fdad => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:23.405197 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ae6d2-7276-4e90-be30-ea88b4fb346a None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:23.417525 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:23.511500 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ae6d2-7276-4e90-be30-ea88b4fb346a None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:23.546041 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff80cb-c7d4-4e14-8f51-d6e618ca4754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:23.546702 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff80cb-c7d4-4e14-8f51-d6e618ca4754 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:23.547002 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff80cb-c7d4-4e14-8f51-d6e618ca4754 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:23.547304 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff80cb-c7d4-4e14-8f51-d6e618ca4754 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:23.548163 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff80cb-c7d4-4e14-8f51-d6e618ca4754 None admin] RBAC: Adding query filter params (role.id=685e18230e1744c581baaf842d0fd4ca, scope.project.id=aa6ff855c9204302b728218d6827fdad, user.id=73c815c11f6d4164a6e0e427e446c283) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:23.548476 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff80cb-c7d4-4e14-8f51-d6e618ca4754 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:23.549904 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff80cb-c7d4-4e14-8f51-d6e618ca4754 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:23.563473 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 536/1059] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:16:23 2022] GET /identity/v3/role_assignments?user.id=73c815c11f6d4164a6e0e427e446c283&scope.project.id=aa6ff855c9204302b728218d6827fdad&role.id=685e18230e1744c581baaf842d0fd4ca => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:23.662224 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97fff4-cfdd-45a3-aa0a-ee82f7b20ea2 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:23.662589 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97fff4-cfdd-45a3-aa0a-ee82f7b20ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:23.662766 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97fff4-cfdd-45a3-aa0a-ee82f7b20ea2 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:23.664373 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 524/1060] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:16:23.669805 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c1e6c-b6b0-4d78-8fcd-65732183a100 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:23.670102 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c1e6c-b6b0-4d78-8fcd-65732183a100 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:23.670494 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c1e6c-b6b0-4d78-8fcd-65732183a100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:23.688685 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-f36c1e6c-b6b0-4d78-8fcd-65732183a100 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:16:23.689912 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f36c1e6c-b6b0-4d78-8fcd-65732183a100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:16:23.758629 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 537/1061] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:16:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:16:23.781641 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97fff4-cfdd-45a3-aa0a-ee82f7b20ea2 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:23.826344 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:23.882824 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97fff4-cfdd-45a3-aa0a-ee82f7b20ea2 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:23.917010 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2355fde-ea14-4fb6-95b2-83dedb6b9436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:23.917752 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2355fde-ea14-4fb6-95b2-83dedb6b9436 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:23.918034 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2355fde-ea14-4fb6-95b2-83dedb6b9436 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:23.918306 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2355fde-ea14-4fb6-95b2-83dedb6b9436 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:23.930700 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2355fde-ea14-4fb6-95b2-83dedb6b9436 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:16:23.938797 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-c2355fde-ea14-4fb6-95b2-83dedb6b9436 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 19:16:23.938797 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:23.938797 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:23.938797 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:23.938797 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:23.938797 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:23.938797 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:23.938797 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:23.938797 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:23.938797 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:23.938797 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:23.938797 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:23.938797 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:16:23.938797 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:16:23.938797 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:16:23.938797 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:16:23.939765 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:16:23.939765 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:16:23.939765 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:16:23.939765 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:16:23.939765 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:23.939765 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:23.939765 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:23.939765 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:23.939765 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:23.939765 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:23.939765 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:23.939765 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:23.939765 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:23.939765 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:23.939765 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:23.939765 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:23.940621 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:23.940621 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:23.940621 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:23.940621 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:23.940621 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:16:23.940621 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:16:23.940621 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:16:23.940621 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:16:23.940621 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:16:23.940621 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:16:23.940621 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 19:16:23.940621 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:16:23.940621 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 525/1062] 10.222.0.60 () {56 vars in 1120 bytes} [Thu Jul 21 19:16:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:16:23.948174 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c1e6c-b6b0-4d78-8fcd-65732183a100 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:23.952650 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:24.048305 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c1e6c-b6b0-4d78-8fcd-65732183a100 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:24.083100 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36490f1a-823f-43cd-975b-34411d9a21d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:24.083797 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36490f1a-823f-43cd-975b-34411d9a21d7 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:24.084112 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36490f1a-823f-43cd-975b-34411d9a21d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:24.084349 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36490f1a-823f-43cd-975b-34411d9a21d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:24.085087 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36490f1a-823f-43cd-975b-34411d9a21d7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:24.085391 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36490f1a-823f-43cd-975b-34411d9a21d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:24.086746 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36490f1a-823f-43cd-975b-34411d9a21d7 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:24.094914 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 538/1063] 10.222.0.60 () {56 vars in 1115 bytes} [Thu Jul 21 19:16:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:16:24.101112 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2355fde-ea14-4fb6-95b2-83dedb6b9436 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:24.200457 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2355fde-ea14-4fb6-95b2-83dedb6b9436 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:24.202267 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:24.235767 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b28d1-ccc0-42b1-b46d-b94522c5e258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:24.236630 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b28d1-ccc0-42b1-b46d-b94522c5e258 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:24.236913 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b28d1-ccc0-42b1-b46d-b94522c5e258 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:24.237186 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b28d1-ccc0-42b1-b46d-b94522c5e258 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:24.248053 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b28d1-ccc0-42b1-b46d-b94522c5e258 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:24.253347 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b28d1-ccc0-42b1-b46d-b94522c5e258 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:24.267974 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-705b28d1-ccc0-42b1-b46d-b94522c5e258 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:16:24.267974 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:24.267974 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:24.267974 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:24.267974 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:24.267974 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:24.267974 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:24.267974 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:24.267974 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:24.267974 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:24.267974 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:24.267974 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:24.267974 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:16:24.267974 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:16:24.267974 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:16:24.268879 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:16:24.268879 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:24.268879 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:24.268879 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:24.268879 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:24.268879 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:24.268879 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:24.268879 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:24.268879 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:24.268879 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:24.268879 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:24.268879 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:24.268879 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:24.268879 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:24.268879 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:24.268879 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:24.268879 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:24.270330 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:16:24.270330 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:16:24.270330 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:16:24.270330 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:16:24.271224 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 526/1064] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:16:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:16:24.276655 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36490f1a-823f-43cd-975b-34411d9a21d7 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:24.343330 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:24.378319 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36490f1a-823f-43cd-975b-34411d9a21d7 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:24.413773 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b1f48c-b39b-4f7a-aebf-25649dac26ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:24.414430 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1f48c-b39b-4f7a-aebf-25649dac26ef None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:24.414711 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1f48c-b39b-4f7a-aebf-25649dac26ef None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:24.414981 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1f48c-b39b-4f7a-aebf-25649dac26ef None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:24.415728 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b1f48c-b39b-4f7a-aebf-25649dac26ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:24.416032 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b1f48c-b39b-4f7a-aebf-25649dac26ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:24.417385 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b1f48c-b39b-4f7a-aebf-25649dac26ef None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:24.437720 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 539/1065] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:24.443587 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b28d1-ccc0-42b1-b46d-b94522c5e258 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:24.544353 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b28d1-ccc0-42b1-b46d-b94522c5e258 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:24.578529 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fcb55-3c70-4045-b3f1-2e300613e222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:24.579424 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fcb55-3c70-4045-b3f1-2e300613e222 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:24.579735 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fcb55-3c70-4045-b3f1-2e300613e222 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:24.580009 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fcb55-3c70-4045-b3f1-2e300613e222 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:24.587685 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fcb55-3c70-4045-b3f1-2e300613e222 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:24.589105 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fcb55-3c70-4045-b3f1-2e300613e222 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:24.603246 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-e74fcb55-3c70-4045-b3f1-2e300613e222 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 19:16:24.603246 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:24.603246 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:24.603246 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:24.603246 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:24.603246 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:24.603246 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:24.603246 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:24.603246 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:24.603246 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:24.603246 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:24.603246 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:24.603246 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 19:16:24.603246 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 19:16:24.603246 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 19:16:24.603246 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 19:16:24.604245 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:24.604245 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:24.604245 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 19:16:24.604245 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:16:24.604245 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 19:16:24.604245 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:16:24.604245 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:24.604245 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:24.604245 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:24.604245 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:24.604245 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:24.604245 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:24.604245 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:24.604245 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:24.604245 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:24.604245 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:24.604245 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:24.604245 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:24.605214 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:24.605214 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:24.605214 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 19:16:24.605214 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 19:16:24.605214 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 19:16:24.605214 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 19:16:24.605214 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 19:16:24.605214 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 19:16:24.605214 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 19:16:24.605214 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:16:24.606502 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 527/1066] 10.222.0.60 () {56 vars in 1093 bytes} [Thu Jul 21 19:16:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:16:24.610147 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b1f48c-b39b-4f7a-aebf-25649dac26ef None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:24.716265 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b1f48c-b39b-4f7a-aebf-25649dac26ef None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:24.741935 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:24.750871 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a553bc6-2b2c-41ca-8ccc-98e351b9e19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:24.751567 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a553bc6-2b2c-41ca-8ccc-98e351b9e19e None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:24.751856 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a553bc6-2b2c-41ca-8ccc-98e351b9e19e None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:24.752135 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a553bc6-2b2c-41ca-8ccc-98e351b9e19e None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:24.752966 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a553bc6-2b2c-41ca-8ccc-98e351b9e19e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:24.753277 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a553bc6-2b2c-41ca-8ccc-98e351b9e19e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:24.755985 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a553bc6-2b2c-41ca-8ccc-98e351b9e19e None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:24.776324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 540/1067] 10.222.0.60 () {56 vars in 1133 bytes} [Thu Jul 21 19:16:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:16:24.781913 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fcb55-3c70-4045-b3f1-2e300613e222 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:24.797638 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:24.870352 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea4306-9201-42bf-bfe4-6839027f2cd8 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:24.870703 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea4306-9201-42bf-bfe4-6839027f2cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:24.870920 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea4306-9201-42bf-bfe4-6839027f2cd8 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:24.872573 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 541/1068] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 19:16:24.877299 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19979706-1ce5-4208-a6fe-52d77ca10ea4 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:24.877595 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19979706-1ce5-4208-a6fe-52d77ca10ea4 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:24.877899 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19979706-1ce5-4208-a6fe-52d77ca10ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:24.882933 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fcb55-3c70-4045-b3f1-2e300613e222 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:24.896569 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-19979706-1ce5-4208-a6fe-52d77ca10ea4 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:16:24.897739 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-19979706-1ce5-4208-a6fe-52d77ca10ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:16:24.924338 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f00be-5e48-4d09-ba30-d9c08bf92c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:24.925539 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f00be-5e48-4d09-ba30-d9c08bf92c65 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:24.926078 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f00be-5e48-4d09-ba30-d9c08bf92c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:24.926565 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f00be-5e48-4d09-ba30-d9c08bf92c65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:24.936944 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644f00be-5e48-4d09-ba30-d9c08bf92c65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:24.938384 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644f00be-5e48-4d09-ba30-d9c08bf92c65 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:24.956648 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-644f00be-5e48-4d09-ba30-d9c08bf92c65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:16:24.956648 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:24.956648 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:24.956648 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:24.956648 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:24.956648 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:24.956648 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:24.956648 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:24.956648 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:24.956648 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:24.956648 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:24.956648 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:24.956648 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:16:24.956648 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:16:24.956648 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:16:24.958095 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:16:24.958095 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:24.958095 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:24.958095 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:24.958095 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:24.958095 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:24.958095 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:24.958095 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:24.958095 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:24.958095 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:24.958095 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:24.958095 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:24.958095 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:24.958095 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:24.958095 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:24.958095 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:24.958095 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:24.959008 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:16:24.959008 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:16:24.959008 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:16:24.959008 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:16:24.959008 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 528/1069] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:16:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:16:24.964199 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f00be-5e48-4d09-ba30-d9c08bf92c65 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:24.970742 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 542/1070] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:16:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 19:16:24.993210 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19979706-1ce5-4208-a6fe-52d77ca10ea4 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:25.035089 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:25.076898 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f00be-5e48-4d09-ba30-d9c08bf92c65 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:25.097521 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19979706-1ce5-4208-a6fe-52d77ca10ea4 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:25.111092 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621e8aa-7cd9-4a51-acef-f2d7ea4d6f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:25.111816 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621e8aa-7cd9-4a51-acef-f2d7ea4d6f8f None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:25.112106 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621e8aa-7cd9-4a51-acef-f2d7ea4d6f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:25.112387 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621e8aa-7cd9-4a51-acef-f2d7ea4d6f8f None admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:25.113622 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621e8aa-7cd9-4a51-acef-f2d7ea4d6f8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:25.113829 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:25.113955 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621e8aa-7cd9-4a51-acef-f2d7ea4d6f8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:25.115410 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621e8aa-7cd9-4a51-acef-f2d7ea4d6f8f None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:25.133616 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 529/1071] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:16:25.134952 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621e8aa-7cd9-4a51-acef-f2d7ea4d6f8f None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:25.135428 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122fca5d-caeb-48ee-a603-b7c2e3fc2ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:25.136112 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122fca5d-caeb-48ee-a603-b7c2e3fc2ddf None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:25.136402 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122fca5d-caeb-48ee-a603-b7c2e3fc2ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:25.136681 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122fca5d-caeb-48ee-a603-b7c2e3fc2ddf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:25.212513 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122fca5d-caeb-48ee-a603-b7c2e3fc2ddf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:25.213978 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122fca5d-caeb-48ee-a603-b7c2e3fc2ddf None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:25.247491 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621e8aa-7cd9-4a51-acef-f2d7ea4d6f8f None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:25.277963 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:25.287669 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5939209-d0c7-406e-870e-3bca21a10a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:25.288480 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5939209-d0c7-406e-870e-3bca21a10a4c None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:25.288768 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5939209-d0c7-406e-870e-3bca21a10a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:25.289052 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5939209-d0c7-406e-870e-3bca21a10a4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:25.296356 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5939209-d0c7-406e-870e-3bca21a10a4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:25.297806 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5939209-d0c7-406e-870e-3bca21a10a4c None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:25.313958 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-f5939209-d0c7-406e-870e-3bca21a10a4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:16:25.313958 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:25.313958 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:25.313958 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:25.313958 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:25.313958 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:25.313958 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:25.313958 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:25.313958 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:25.313958 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:25.313958 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:25.313958 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:25.313958 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 19:16:25.313958 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 19:16:25.313958 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 19:16:25.314905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 19:16:25.314905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:25.314905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:25.314905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:25.314905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:25.314905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:25.314905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:25.314905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:25.314905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:25.314905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:25.314905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:25.314905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:25.314905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:25.314905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:25.314905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:25.314905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:25.314905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:25.322060 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 19:16:25.322060 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 19:16:25.322060 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 19:16:25.322060 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 19:16:25.322060 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 19:16:25.322060 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 19:16:25.322060 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:16:25.322060 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:16:25.322060 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 530/1072] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:16:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:16:25.322562 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5939209-d0c7-406e-870e-3bca21a10a4c None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:25.337089 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 543/1073] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:16:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 19:16:25.342409 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122fca5d-caeb-48ee-a603-b7c2e3fc2ddf None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:25.359700 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:25.437921 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5939209-d0c7-406e-870e-3bca21a10a4c None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:25.452364 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122fca5d-caeb-48ee-a603-b7c2e3fc2ddf None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:25.474099 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb005b57-4d13-4a62-966f-c66c7535842b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:25.474856 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb005b57-4d13-4a62-966f-c66c7535842b None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:25.475215 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb005b57-4d13-4a62-966f-c66c7535842b None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:25.475609 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb005b57-4d13-4a62-966f-c66c7535842b None admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:25.476472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb005b57-4d13-4a62-966f-c66c7535842b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:25.476850 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb005b57-4d13-4a62-966f-c66c7535842b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:25.478351 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb005b57-4d13-4a62-966f-c66c7535842b None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:25.489842 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2810a2da-8f30-4c93-80c3-e1f8a84fc9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:25.490628 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810a2da-8f30-4c93-80c3-e1f8a84fc9c4 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:25.490912 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810a2da-8f30-4c93-80c3-e1f8a84fc9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:25.491391 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 531/1074] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Jul 21 19:16:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:25.495633 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810a2da-8f30-4c93-80c3-e1f8a84fc9c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:25.496904 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb005b57-4d13-4a62-966f-c66c7535842b None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:25.508338 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2810a2da-8f30-4c93-80c3-e1f8a84fc9c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:25.510160 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2810a2da-8f30-4c93-80c3-e1f8a84fc9c4 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:25.528573 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-2810a2da-8f30-4c93-80c3-e1f8a84fc9c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:16:25.528573 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:25.528573 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:25.528573 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:25.528573 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:25.528573 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:25.528573 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:25.528573 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:25.528573 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:25.528573 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:25.528573 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:25.528573 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:25.528573 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:16:25.528573 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:16:25.528573 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:16:25.529498 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:16:25.529498 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:25.529498 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:25.529498 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:25.529498 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:25.529498 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:25.529498 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:25.529498 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:25.529498 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:25.529498 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:25.529498 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:25.529498 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:25.529498 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:25.529498 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:25.529498 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:25.529498 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:25.529498 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:25.531134 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:16:25.531134 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:16:25.531134 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:16:25.531134 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:25.531134 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 544/1075] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:16:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:16:25.536754 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2810a2da-8f30-4c93-80c3-e1f8a84fc9c4 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:25.548814 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:25.604712 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:25.610969 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb005b57-4d13-4a62-966f-c66c7535842b None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:25.639750 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2810a2da-8f30-4c93-80c3-e1f8a84fc9c4 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:25.644394 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd52b2-a0cb-4369-8e97-414f63b55c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:25.645297 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd52b2-a0cb-4369-8e97-414f63b55c25 None admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:25.645580 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd52b2-a0cb-4369-8e97-414f63b55c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:25.645861 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd52b2-a0cb-4369-8e97-414f63b55c25 None admin] PATH_INFO: `/v3/projects/9847b5e8bc0b4483bbce060a48f405f4/users/6b4d98e967814e5f84f5f0d67ebb3c17/roles/09fd90e2b50d4b809ba2614d2d228a4c` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:25.648263 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd52b2-a0cb-4369-8e97-414f63b55c25 None admin] RBAC: Authorizing `identity:create_grant(project_id=9847b5e8bc0b4483bbce060a48f405f4, user_id=6b4d98e967814e5f84f5f0d67ebb3c17, role_id=09fd90e2b50d4b809ba2614d2d228a4c)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:25.649878 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd52b2-a0cb-4369-8e97-414f63b55c25 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:25.676566 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c535e-d784-420d-9e7c-4996af050597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:25.677248 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c535e-d784-420d-9e7c-4996af050597 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:25.677526 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c535e-d784-420d-9e7c-4996af050597 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:25.677800 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c535e-d784-420d-9e7c-4996af050597 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:25.678857 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c535e-d784-420d-9e7c-4996af050597 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:25.679166 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c535e-d784-420d-9e7c-4996af050597 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:25.680540 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c535e-d784-420d-9e7c-4996af050597 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:25.691839 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 545/1076] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:16:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:25.693027 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b884e-ee95-495f-a876-08a53e79e58d None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:25.693315 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b884e-ee95-495f-a876-08a53e79e58d None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:25.696174 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b884e-ee95-495f-a876-08a53e79e58d None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:25.696174 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 546/1077] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:16:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:16:25.700758 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f176a13-18ae-4e6a-9fc2-9b628636854e None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:25.701050 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f176a13-18ae-4e6a-9fc2-9b628636854e None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:25.701316 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f176a13-18ae-4e6a-9fc2-9b628636854e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:25.719991 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-5f176a13-18ae-4e6a-9fc2-9b628636854e None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:16:25.721176 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 532/1078] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Jul 21 19:16:25 2022] PUT /identity/v3/projects/9847b5e8bc0b4483bbce060a48f405f4/users/6b4d98e967814e5f84f5f0d67ebb3c17/roles/09fd90e2b50d4b809ba2614d2d228a4c => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:16:25.721300 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-5f176a13-18ae-4e6a-9fc2-9b628636854e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:16:25.803971 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 547/1079] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:16:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 19:16:25.827384 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd52b2-a0cb-4369-8e97-414f63b55c25 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:25.940721 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd52b2-a0cb-4369-8e97-414f63b55c25 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:25.948791 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:25.977319 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08014c2d-e864-4a15-9c19-86d0a08290bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:25.978127 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08014c2d-e864-4a15-9c19-86d0a08290bc None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:25.978416 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08014c2d-e864-4a15-9c19-86d0a08290bc None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:25.978693 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08014c2d-e864-4a15-9c19-86d0a08290bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:25.989400 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08014c2d-e864-4a15-9c19-86d0a08290bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:16:25.997156 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-08014c2d-e864-4a15-9c19-86d0a08290bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:16:25.997156 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:25.997156 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:25.997156 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:25.997156 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:25.997156 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:25.997156 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:25.997156 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:25.997156 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:25.997156 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:25.997156 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:25.997156 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:25.997156 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:16:25.997156 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:16:25.997156 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:16:25.997156 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:16:25.998112 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:16:25.998112 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:16:25.998112 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:16:25.998112 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:16:25.998112 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:25.998112 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:25.998112 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:25.998112 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:25.998112 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:25.998112 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:25.998112 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:25.998112 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:25.998112 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:25.998112 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:25.998112 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:25.998112 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:25.999001 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:25.999001 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:25.999001 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:25.999001 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:25.999001 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:16:25.999001 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:16:25.999001 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:16:25.999001 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:16:25.999001 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:16:25.999001 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:16:25.999001 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:16:25.999001 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:16:25.999001 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 533/1080] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Jul 21 19:16:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:16:26.004896 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f176a13-18ae-4e6a-9fc2-9b628636854e None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:26.063525 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:26.116400 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f176a13-18ae-4e6a-9fc2-9b628636854e None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:26.156574 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6d2b1-1a71-4dcf-8aca-46c15ee38062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:26.157244 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6d2b1-1a71-4dcf-8aca-46c15ee38062 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:26.157528 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6d2b1-1a71-4dcf-8aca-46c15ee38062 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:26.157804 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6d2b1-1a71-4dcf-8aca-46c15ee38062 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:26.158546 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa6d2b1-1a71-4dcf-8aca-46c15ee38062 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:26.158853 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa6d2b1-1a71-4dcf-8aca-46c15ee38062 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:26.160299 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa6d2b1-1a71-4dcf-8aca-46c15ee38062 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:26.168412 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 548/1081] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:16:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:26.174486 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08014c2d-e864-4a15-9c19-86d0a08290bc None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:26.276592 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08014c2d-e864-4a15-9c19-86d0a08290bc None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:26.309053 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec48466-c72e-432f-a0c4-26710dd07095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:26.309914 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec48466-c72e-432f-a0c4-26710dd07095 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:26.310198 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec48466-c72e-432f-a0c4-26710dd07095 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:26.310476 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec48466-c72e-432f-a0c4-26710dd07095 None admin] PATH_INFO: `/v3/users/73c815c11f6d4164a6e0e427e446c283` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:26.311669 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec48466-c72e-432f-a0c4-26710dd07095 None admin] RBAC: Authorizing `identity:get_user(user_id=73c815c11f6d4164a6e0e427e446c283)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:26.313083 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec48466-c72e-432f-a0c4-26710dd07095 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:26.314693 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 534/1082] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:16:26 2022] GET /identity/v3/users/73c815c11f6d4164a6e0e427e446c283 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:16:26.321152 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6d2b1-1a71-4dcf-8aca-46c15ee38062 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:26.431608 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6d2b1-1a71-4dcf-8aca-46c15ee38062 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:26.449108 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:26.471746 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e3541-b8d9-40ba-8e16-39edca8203c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:26.472610 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e3541-b8d9-40ba-8e16-39edca8203c3 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:26.472891 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e3541-b8d9-40ba-8e16-39edca8203c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:26.473166 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e3541-b8d9-40ba-8e16-39edca8203c3 None admin] PATH_INFO: `/v3/projects/aa6ff855c9204302b728218d6827fdad` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:26.474339 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18e3541-b8d9-40ba-8e16-39edca8203c3 None admin] RBAC: Authorizing `identity:get_project(project_id=aa6ff855c9204302b728218d6827fdad)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:26.475791 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18e3541-b8d9-40ba-8e16-39edca8203c3 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:26.477488 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 549/1083] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:16:26 2022] GET /identity/v3/projects/aa6ff855c9204302b728218d6827fdad => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:16:26.483382 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec48466-c72e-432f-a0c4-26710dd07095 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:26.519662 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:26.583190 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec48466-c72e-432f-a0c4-26710dd07095 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:26.615985 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40407400-54c3-4c60-9d5e-46c87009beda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:26.616861 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40407400-54c3-4c60-9d5e-46c87009beda None admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:26.617141 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40407400-54c3-4c60-9d5e-46c87009beda None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:26.617412 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40407400-54c3-4c60-9d5e-46c87009beda None admin] PATH_INFO: `/v3/projects/aa6ff855c9204302b728218d6827fdad/users/73c815c11f6d4164a6e0e427e446c283/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:26.619317 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40407400-54c3-4c60-9d5e-46c87009beda None admin] RBAC: Authorizing `identity:create_grant(project_id=aa6ff855c9204302b728218d6827fdad, user_id=73c815c11f6d4164a6e0e427e446c283, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:26.620764 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40407400-54c3-4c60-9d5e-46c87009beda None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:26.694679 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 535/1084] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Jul 21 19:16:26 2022] PUT /identity/v3/projects/aa6ff855c9204302b728218d6827fdad/users/73c815c11f6d4164a6e0e427e446c283/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:16:27.756224 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a89034-a736-4dde-8599-0c9456decdc9 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:27.756731 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a89034-a736-4dde-8599-0c9456decdc9 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:27.756731 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a89034-a736-4dde-8599-0c9456decdc9 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:27.758049 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 550/1085] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:16:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:16:27.764381 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966e057-22de-46f7-93fc-4888aeca32c6 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:27.764793 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966e057-22de-46f7-93fc-4888aeca32c6 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:27.765057 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966e057-22de-46f7-93fc-4888aeca32c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:27.781403 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-b966e057-22de-46f7-93fc-4888aeca32c6 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:16:27.782573 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-b966e057-22de-46f7-93fc-4888aeca32c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:16:27.850438 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 536/1086] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:16:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:16:27.873830 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a89034-a736-4dde-8599-0c9456decdc9 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:27.975812 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a89034-a736-4dde-8599-0c9456decdc9 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:28.009289 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db609e-35a5-4401-b785-fbabaadb4b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:28.010028 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db609e-35a5-4401-b785-fbabaadb4b9e None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:28.010313 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db609e-35a5-4401-b785-fbabaadb4b9e None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:28.010592 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db609e-35a5-4401-b785-fbabaadb4b9e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:28.021287 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db609e-35a5-4401-b785-fbabaadb4b9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:16:28.029419 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-b7db609e-35a5-4401-b785-fbabaadb4b9e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 19:16:28.029419 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:28.029419 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:28.029419 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:28.029419 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:28.029419 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:28.029419 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:28.029419 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:28.029419 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:28.029419 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:28.029419 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:28.029419 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:28.029419 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:16:28.029419 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:16:28.029419 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:16:28.029419 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:16:28.030508 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:16:28.030508 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:16:28.030508 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:16:28.030508 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:16:28.030508 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:28.030508 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:28.030508 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:28.030508 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:28.030508 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:28.030508 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:28.030508 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:28.030508 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:28.030508 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:28.030508 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:28.030508 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:28.030508 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:28.031495 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:28.031495 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:28.031495 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:28.031495 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:28.031495 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:16:28.031495 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:16:28.031495 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:16:28.031495 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:16:28.031495 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:16:28.031495 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:16:28.031495 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 19:16:28.031495 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:28.031495 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 551/1087] 10.222.0.60 () {56 vars in 1120 bytes} [Thu Jul 21 19:16:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:16:28.037262 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966e057-22de-46f7-93fc-4888aeca32c6 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:28.061545 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:28.147548 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966e057-22de-46f7-93fc-4888aeca32c6 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:28.182685 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436fa788-fb68-43df-9cb5-454fb624daac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:28.183356 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fa788-fb68-43df-9cb5-454fb624daac None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:28.183761 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fa788-fb68-43df-9cb5-454fb624daac None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:28.184055 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fa788-fb68-43df-9cb5-454fb624daac None admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:28.184999 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436fa788-fb68-43df-9cb5-454fb624daac None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:28.185468 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436fa788-fb68-43df-9cb5-454fb624daac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:28.187513 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436fa788-fb68-43df-9cb5-454fb624daac None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:28.195749 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 537/1088] 10.222.0.60 () {56 vars in 1115 bytes} [Thu Jul 21 19:16:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:28.201462 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db609e-35a5-4401-b785-fbabaadb4b9e None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:28.250307 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:28.305348 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db609e-35a5-4401-b785-fbabaadb4b9e None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:28.339563 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fe9fc-4434-45b2-a333-c68f46bbbf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:28.340345 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fe9fc-4434-45b2-a333-c68f46bbbf9b None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:28.340631 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fe9fc-4434-45b2-a333-c68f46bbbf9b None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:28.340912 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fe9fc-4434-45b2-a333-c68f46bbbf9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:28.351800 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fe9fc-4434-45b2-a333-c68f46bbbf9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:28.353240 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fe9fc-4434-45b2-a333-c68f46bbbf9b None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:28.372832 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-a97fe9fc-4434-45b2-a333-c68f46bbbf9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:16:28.372832 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:28.372832 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:28.372832 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:28.372832 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:28.372832 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:28.372832 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:28.372832 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:28.372832 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:28.372832 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:28.372832 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:28.372832 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:28.372832 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:16:28.372832 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:16:28.372832 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:16:28.373940 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:16:28.373940 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:28.373940 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:28.373940 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:28.373940 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:28.373940 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:28.373940 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:28.373940 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:28.373940 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:28.373940 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:28.373940 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:28.373940 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:28.373940 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:28.373940 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:28.373940 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:28.373940 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:28.373940 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:28.374916 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:16:28.374916 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:16:28.374916 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:16:28.374916 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:28.374916 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 552/1089] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:16:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:16:28.380299 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436fa788-fb68-43df-9cb5-454fb624daac None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:28.469719 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:28.485629 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436fa788-fb68-43df-9cb5-454fb624daac None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:28.519882 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d9da83-a42c-4252-ba7b-56a868eccf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:28.520901 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9da83-a42c-4252-ba7b-56a868eccf00 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:28.521188 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9da83-a42c-4252-ba7b-56a868eccf00 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:28.521464 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9da83-a42c-4252-ba7b-56a868eccf00 None admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:28.522183 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d9da83-a42c-4252-ba7b-56a868eccf00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:28.522493 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d9da83-a42c-4252-ba7b-56a868eccf00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:28.523895 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d9da83-a42c-4252-ba7b-56a868eccf00 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:28.536309 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 538/1090] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:28.541896 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fe9fc-4434-45b2-a333-c68f46bbbf9b None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:28.638267 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:28.642139 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fe9fc-4434-45b2-a333-c68f46bbbf9b None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:28.677159 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975ff88-b36a-454b-baca-ac1462fd59a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:28.678234 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975ff88-b36a-454b-baca-ac1462fd59a7 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:28.678524 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975ff88-b36a-454b-baca-ac1462fd59a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:28.678798 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975ff88-b36a-454b-baca-ac1462fd59a7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:28.685826 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4975ff88-b36a-454b-baca-ac1462fd59a7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:28.687252 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4975ff88-b36a-454b-baca-ac1462fd59a7 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:28.701287 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-4975ff88-b36a-454b-baca-ac1462fd59a7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 19:16:28.701287 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:28.701287 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:28.701287 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:28.701287 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:28.701287 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:28.701287 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:28.701287 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:28.701287 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:28.701287 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:28.701287 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:28.701287 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:28.701287 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 19:16:28.701287 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 19:16:28.701287 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 19:16:28.701287 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 19:16:28.702459 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:28.702459 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:28.702459 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 19:16:28.702459 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:16:28.702459 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 19:16:28.702459 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:16:28.702459 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:28.702459 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:28.702459 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:28.702459 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:28.702459 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:28.702459 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:28.702459 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:28.702459 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:28.702459 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:28.702459 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:28.702459 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:28.702459 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:28.708891 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:28.708891 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:28.708891 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 19:16:28.708891 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 19:16:28.708891 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 19:16:28.708891 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 19:16:28.708891 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 19:16:28.708891 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 19:16:28.708891 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 19:16:28.708891 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:28.708891 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 553/1091] 10.222.0.60 () {56 vars in 1093 bytes} [Thu Jul 21 19:16:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:16:28.709894 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d9da83-a42c-4252-ba7b-56a868eccf00 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:28.732492 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fc9fa-ed80-46c9-85d0-c337c30ab61c None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:28.732779 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fc9fa-ed80-46c9-85d0-c337c30ab61c None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:28.733057 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fc9fa-ed80-46c9-85d0-c337c30ab61c None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:28.734432 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 554/1092] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 19:16:28.739271 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e3ff4-2e8e-43fd-bb36-9f2d6cd32b05 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:28.739584 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e3ff4-2e8e-43fd-bb36-9f2d6cd32b05 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:28.739864 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e3ff4-2e8e-43fd-bb36-9f2d6cd32b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:28.756720 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-e90e3ff4-2e8e-43fd-bb36-9f2d6cd32b05 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:16:28.757936 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-e90e3ff4-2e8e-43fd-bb36-9f2d6cd32b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:16:28.811871 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d9da83-a42c-4252-ba7b-56a868eccf00 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:28.826844 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 555/1093] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:16:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 19:16:28.844780 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146518a-554b-441e-bdc7-cdfc1320ec0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:28.845442 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146518a-554b-441e-bdc7-cdfc1320ec0f None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:28.845723 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146518a-554b-441e-bdc7-cdfc1320ec0f None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:28.845995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146518a-554b-441e-bdc7-cdfc1320ec0f None admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:28.846853 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146518a-554b-441e-bdc7-cdfc1320ec0f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:28.847160 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146518a-554b-441e-bdc7-cdfc1320ec0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:28.848644 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146518a-554b-441e-bdc7-cdfc1320ec0f None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:28.850918 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e3ff4-2e8e-43fd-bb36-9f2d6cd32b05 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:28.867303 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 539/1094] 10.222.0.60 () {56 vars in 1133 bytes} [Thu Jul 21 19:16:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:28.872944 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146518a-554b-441e-bdc7-cdfc1320ec0f None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:28.876377 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:28.938742 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:28.951624 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e3ff4-2e8e-43fd-bb36-9f2d6cd32b05 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:28.973515 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146518a-554b-441e-bdc7-cdfc1320ec0f None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:28.986092 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb27257-8651-4cff-a837-73bdcf127036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:28.986905 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb27257-8651-4cff-a837-73bdcf127036 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:28.987192 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb27257-8651-4cff-a837-73bdcf127036 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:28.987501 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb27257-8651-4cff-a837-73bdcf127036 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:28.997589 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb27257-8651-4cff-a837-73bdcf127036 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:16:29.005741 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-bcb27257-8651-4cff-a837-73bdcf127036 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:16:29.005741 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:29.005741 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:29.005741 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:29.005741 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:29.005741 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:29.005741 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:29.005741 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:29.005741 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:29.005741 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:29.005741 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:29.005741 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:29.005741 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:16:29.005741 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:16:29.005741 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:16:29.005741 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:16:29.006735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:16:29.006735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:16:29.006735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:16:29.006735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:16:29.006735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:29.006735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:29.006735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:29.006735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:29.006735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:29.006735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:29.006735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:29.006735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:29.006735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:29.006735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:29.006735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:29.006735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:29.007637 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:29.007637 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:29.007637 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:29.007637 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:29.007637 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:16:29.007637 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:16:29.007637 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:16:29.007637 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:16:29.007637 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:16:29.007637 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:16:29.007637 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:16:29.007637 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:29.008321 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b2a43-efe7-42b9-ace1-1659121052c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:29.008321 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b2a43-efe7-42b9-ace1-1659121052c0 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:29.008491 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 556/1095] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Jul 21 19:16:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:16:29.008567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b2a43-efe7-42b9-ace1-1659121052c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:29.008567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b2a43-efe7-42b9-ace1-1659121052c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:29.012953 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb27257-8651-4cff-a837-73bdcf127036 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:29.073411 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b2a43-efe7-42b9-ace1-1659121052c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:29.074871 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b2a43-efe7-42b9-ace1-1659121052c0 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:29.077483 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:29.111948 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb27257-8651-4cff-a837-73bdcf127036 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:29.146571 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b599c-156a-4eae-a19c-39637d717d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:29.147228 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b599c-156a-4eae-a19c-39637d717d1d None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:29.147546 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b599c-156a-4eae-a19c-39637d717d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:29.147827 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b599c-156a-4eae-a19c-39637d717d1d None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:29.148567 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b599c-156a-4eae-a19c-39637d717d1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:29.148875 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b599c-156a-4eae-a19c-39637d717d1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:29.150246 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b599c-156a-4eae-a19c-39637d717d1d None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:29.158459 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 557/1096] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:16:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:16:29.164425 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b599c-156a-4eae-a19c-39637d717d1d None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:29.176916 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:29.177561 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 540/1097] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:16:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 19:16:29.183585 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b2a43-efe7-42b9-ace1-1659121052c0 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:29.264307 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b599c-156a-4eae-a19c-39637d717d1d None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:29.279843 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b2a43-efe7-42b9-ace1-1659121052c0 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:29.282073 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:29.297170 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756ea10-f371-44c8-8dc1-9951f1f08f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:29.298038 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756ea10-f371-44c8-8dc1-9951f1f08f7f None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:29.298324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756ea10-f371-44c8-8dc1-9951f1f08f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:29.298599 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756ea10-f371-44c8-8dc1-9951f1f08f7f None admin] PATH_INFO: `/v3/users/73c815c11f6d4164a6e0e427e446c283` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:29.299838 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4756ea10-f371-44c8-8dc1-9951f1f08f7f None admin] RBAC: Authorizing `identity:get_user(user_id=73c815c11f6d4164a6e0e427e446c283)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:29.301792 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4756ea10-f371-44c8-8dc1-9951f1f08f7f None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:29.303735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 558/1098] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:16:29 2022] GET /identity/v3/users/73c815c11f6d4164a6e0e427e446c283 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:16:29.309456 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756ea10-f371-44c8-8dc1-9951f1f08f7f None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:29.313125 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b7c44-56eb-41a6-9fa0-e5540c6327c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:29.313971 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b7c44-56eb-41a6-9fa0-e5540c6327c9 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:29.314451 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b7c44-56eb-41a6-9fa0-e5540c6327c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:29.314951 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b7c44-56eb-41a6-9fa0-e5540c6327c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:29.325182 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b7c44-56eb-41a6-9fa0-e5540c6327c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:29.326607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b7c44-56eb-41a6-9fa0-e5540c6327c9 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:29.344047 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-3c5b7c44-56eb-41a6-9fa0-e5540c6327c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:16:29.344047 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:29.344047 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:29.344047 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:29.344047 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:29.344047 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:29.344047 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:29.344047 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:29.344047 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:29.344047 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:29.344047 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:29.344047 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:29.344047 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:16:29.344047 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:16:29.344047 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:16:29.345121 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:16:29.345121 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:29.345121 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:29.345121 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:29.345121 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:29.345121 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:29.345121 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:29.345121 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:29.345121 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:29.345121 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:29.345121 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:29.345121 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:29.345121 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:29.345121 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:29.345121 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:29.345121 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:29.345121 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:29.346235 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:16:29.346235 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:16:29.346235 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:16:29.346235 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:16:29.346235 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 541/1099] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:16:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:16:29.351397 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b7c44-56eb-41a6-9fa0-e5540c6327c9 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:29.390924 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:29.413670 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756ea10-f371-44c8-8dc1-9951f1f08f7f None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:29.453291 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad537d-03fc-4134-b635-afe6d764fe11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:29.453614 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b7c44-56eb-41a6-9fa0-e5540c6327c9 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:29.453945 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad537d-03fc-4134-b635-afe6d764fe11 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:29.454234 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad537d-03fc-4134-b635-afe6d764fe11 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:29.454521 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad537d-03fc-4134-b635-afe6d764fe11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:29.487406 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e7185-4476-4096-8dc1-f0fa4c4f7acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:29.488237 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e7185-4476-4096-8dc1-f0fa4c4f7acd None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:29.488599 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e7185-4476-4096-8dc1-f0fa4c4f7acd None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:29.488884 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e7185-4476-4096-8dc1-f0fa4c4f7acd None admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:29.489597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e7185-4476-4096-8dc1-f0fa4c4f7acd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:29.489908 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e7185-4476-4096-8dc1-f0fa4c4f7acd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:29.491269 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e7185-4476-4096-8dc1-f0fa4c4f7acd None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:29.502321 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 542/1100] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:16:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:16:29.508597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e7185-4476-4096-8dc1-f0fa4c4f7acd None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:29.526364 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:29.532803 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad537d-03fc-4134-b635-afe6d764fe11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:29.534256 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad537d-03fc-4134-b635-afe6d764fe11 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:29.605639 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e7185-4476-4096-8dc1-f0fa4c4f7acd None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:29.609688 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:29.632157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 559/1101] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:16:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 19:16:29.637918 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad537d-03fc-4134-b635-afe6d764fe11 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:29.638502 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b1fbc5-86a6-4bdd-95e8-0b6386cc8f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:29.639295 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1fbc5-86a6-4bdd-95e8-0b6386cc8f42 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:29.639608 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1fbc5-86a6-4bdd-95e8-0b6386cc8f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:29.639891 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1fbc5-86a6-4bdd-95e8-0b6386cc8f42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:29.647656 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b1fbc5-86a6-4bdd-95e8-0b6386cc8f42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:29.649097 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b1fbc5-86a6-4bdd-95e8-0b6386cc8f42 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:29.662685 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-83b1fbc5-86a6-4bdd-95e8-0b6386cc8f42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:16:29.662685 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:29.662685 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:29.662685 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:29.662685 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:29.662685 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:29.662685 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:29.662685 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:29.662685 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:29.662685 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:29.662685 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:29.662685 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:29.662685 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 19:16:29.662685 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 19:16:29.662685 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 19:16:29.663684 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 19:16:29.663684 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:29.663684 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:29.663684 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:29.663684 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:29.663684 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:29.663684 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:29.663684 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:29.663684 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:29.663684 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:29.663684 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:29.663684 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:29.663684 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:29.663684 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:29.663684 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:29.663684 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:29.663684 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:29.664721 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 19:16:29.664721 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 19:16:29.664721 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 19:16:29.664721 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 19:16:29.664721 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 19:16:29.664721 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 19:16:29.664721 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:16:29.664721 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:16:29.664721 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 543/1102] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:16:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:16:29.669500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b1fbc5-86a6-4bdd-95e8-0b6386cc8f42 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:29.737618 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad537d-03fc-4134-b635-afe6d764fe11 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:29.747250 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:29.771549 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b1fbc5-86a6-4bdd-95e8-0b6386cc8f42 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:29.777141 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ae881-e9f1-4ff9-9dad-31b76542975b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:29.777947 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ae881-e9f1-4ff9-9dad-31b76542975b None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:29.778233 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ae881-e9f1-4ff9-9dad-31b76542975b None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:29.778513 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ae881-e9f1-4ff9-9dad-31b76542975b None admin] PATH_INFO: `/v3/projects/aa6ff855c9204302b728218d6827fdad` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:29.779715 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181ae881-e9f1-4ff9-9dad-31b76542975b None admin] RBAC: Authorizing `identity:get_project(project_id=aa6ff855c9204302b728218d6827fdad)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:29.781159 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181ae881-e9f1-4ff9-9dad-31b76542975b None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:29.782873 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 560/1103] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:16:29 2022] GET /identity/v3/projects/aa6ff855c9204302b728218d6827fdad => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:16:29.789170 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ae881-e9f1-4ff9-9dad-31b76542975b None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:29.807032 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa0c63-3532-459f-bb13-b670e47b8e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:29.807728 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa0c63-3532-459f-bb13-b670e47b8e3c None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:29.808011 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa0c63-3532-459f-bb13-b670e47b8e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:29.808287 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa0c63-3532-459f-bb13-b670e47b8e3c None admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:29.809063 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfa0c63-3532-459f-bb13-b670e47b8e3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:29.809370 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfa0c63-3532-459f-bb13-b670e47b8e3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:29.810811 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfa0c63-3532-459f-bb13-b670e47b8e3c None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:29.822992 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 544/1104] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Jul 21 19:16:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:16:29.828882 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa0c63-3532-459f-bb13-b670e47b8e3c None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:29.836967 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:29.890799 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ae881-e9f1-4ff9-9dad-31b76542975b None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:29.924196 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490cff3-09fe-4ecf-880c-4539f1e94b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:29.924852 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490cff3-09fe-4ecf-880c-4539f1e94b74 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:29.925072 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa0c63-3532-459f-bb13-b670e47b8e3c None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:29.925194 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490cff3-09fe-4ecf-880c-4539f1e94b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:29.925407 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490cff3-09fe-4ecf-880c-4539f1e94b74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:29.926868 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490cff3-09fe-4ecf-880c-4539f1e94b74 None admin] RBAC: Adding query filter params (role.id=685e18230e1744c581baaf842d0fd4ca, scope.project.id=aa6ff855c9204302b728218d6827fdad, user.id=73c815c11f6d4164a6e0e427e446c283) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:29.927186 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490cff3-09fe-4ecf-880c-4539f1e94b74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:29.928917 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490cff3-09fe-4ecf-880c-4539f1e94b74 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:29.934745 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 561/1105] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:16:29 2022] GET /identity/v3/role_assignments?user.id=73c815c11f6d4164a6e0e427e446c283&scope.project.id=aa6ff855c9204302b728218d6827fdad&role.id=685e18230e1744c581baaf842d0fd4ca => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:16:29.965629 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf058c0-4e13-469f-9516-66fd2f0a2968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:29.966307 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf058c0-4e13-469f-9516-66fd2f0a2968 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:29.966593 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf058c0-4e13-469f-9516-66fd2f0a2968 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:29.966870 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf058c0-4e13-469f-9516-66fd2f0a2968 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:29.967754 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf058c0-4e13-469f-9516-66fd2f0a2968 None admin] RBAC: Adding query filter params (role.id=09fd90e2b50d4b809ba2614d2d228a4c, scope.project.id=9847b5e8bc0b4483bbce060a48f405f4, user.id=6b4d98e967814e5f84f5f0d67ebb3c17) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:29.968068 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf058c0-4e13-469f-9516-66fd2f0a2968 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:29.969540 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf058c0-4e13-469f-9516-66fd2f0a2968 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:29.973484 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:29.977264 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 545/1106] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:16:29 2022] GET /identity/v3/role_assignments?user.id=6b4d98e967814e5f84f5f0d67ebb3c17&scope.project.id=9847b5e8bc0b4483bbce060a48f405f4&role.id=09fd90e2b50d4b809ba2614d2d228a4c => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:16:31.993572 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a240e74-e996-4fcd-8587-b6c68394aebe None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:31.994100 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a240e74-e996-4fcd-8587-b6c68394aebe None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:31.994100 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a240e74-e996-4fcd-8587-b6c68394aebe None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:31.995490 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 562/1107] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:16:32.000575 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fcdb5-5c63-438f-a6d1-772e6e414730 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:32.000991 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fcdb5-5c63-438f-a6d1-772e6e414730 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:32.001139 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fcdb5-5c63-438f-a6d1-772e6e414730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:32.017416 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-916fcdb5-5c63-438f-a6d1-772e6e414730 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:16:32.018592 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-916fcdb5-5c63-438f-a6d1-772e6e414730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:16:32.082978 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 546/1108] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:16:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:16:32.107423 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a240e74-e996-4fcd-8587-b6c68394aebe None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:32.208154 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a240e74-e996-4fcd-8587-b6c68394aebe None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:32.218608 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:32.242175 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aeb27c-e84f-4255-b294-7c3bf509bb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:32.242949 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aeb27c-e84f-4255-b294-7c3bf509bb2b None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:32.243233 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aeb27c-e84f-4255-b294-7c3bf509bb2b None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:32.243558 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aeb27c-e84f-4255-b294-7c3bf509bb2b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:32.244808 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aeb27c-e84f-4255-b294-7c3bf509bb2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:32.246194 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aeb27c-e84f-4255-b294-7c3bf509bb2b None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:32.247823 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 563/1109] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:16:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:32.253628 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916fcdb5-5c63-438f-a6d1-772e6e414730 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:32.350651 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916fcdb5-5c63-438f-a6d1-772e6e414730 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:32.377928 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:32.383867 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441738c-1229-4cf7-870e-3655abae786c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:32.384536 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441738c-1229-4cf7-870e-3655abae786c None admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:32.384822 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441738c-1229-4cf7-870e-3655abae786c None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:32.385098 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441738c-1229-4cf7-870e-3655abae786c None admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:32.385805 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8441738c-1229-4cf7-870e-3655abae786c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:32.387226 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8441738c-1229-4cf7-870e-3655abae786c None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:32.470913 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 547/1110] 10.222.0.60 () {60 vars in 1132 bytes} [Thu Jul 21 19:16:32 2022] POST /identity/v3/users => generated 286 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:16:34.517184 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe502e-3c09-4512-8b5b-6694d1e0ecb4 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:34.517695 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe502e-3c09-4512-8b5b-6694d1e0ecb4 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:34.517813 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe502e-3c09-4512-8b5b-6694d1e0ecb4 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:34.519664 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 564/1111] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:16:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:16:34.524728 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8303d13-f9f5-48e6-b627-8785ec95b130 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:34.525145 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8303d13-f9f5-48e6-b627-8785ec95b130 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:34.525289 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8303d13-f9f5-48e6-b627-8785ec95b130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:34.542134 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-f8303d13-f9f5-48e6-b627-8785ec95b130 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:16:34.543292 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-f8303d13-f9f5-48e6-b627-8785ec95b130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:16:34.607492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 548/1112] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:16:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:16:34.630371 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe502e-3c09-4512-8b5b-6694d1e0ecb4 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:34.729409 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe502e-3c09-4512-8b5b-6694d1e0ecb4 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:34.762312 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084bfa3-7d4d-4b7b-952e-a370ce355f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:34.763139 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084bfa3-7d4d-4b7b-952e-a370ce355f4a None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:34.763418 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084bfa3-7d4d-4b7b-952e-a370ce355f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:34.763724 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084bfa3-7d4d-4b7b-952e-a370ce355f4a None admin] PATH_INFO: `/v3/roles/3ad609555dec437d92e5c7291b1c939a` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:34.765176 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f084bfa3-7d4d-4b7b-952e-a370ce355f4a None admin] RBAC: Authorizing `identity:get_role(role_id=3ad609555dec437d92e5c7291b1c939a)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:34.766536 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f084bfa3-7d4d-4b7b-952e-a370ce355f4a None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:34.767902 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 565/1113] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:16:34 2022] GET /identity/v3/roles/3ad609555dec437d92e5c7291b1c939a => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:34.774130 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8303d13-f9f5-48e6-b627-8785ec95b130 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:34.867307 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8303d13-f9f5-48e6-b627-8785ec95b130 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:34.883946 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:34.901137 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1128dfd-8e4e-4dc3-a40e-5645b600e7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:34.905228 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1128dfd-8e4e-4dc3-a40e-5645b600e7d1 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:34.905228 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1128dfd-8e4e-4dc3-a40e-5645b600e7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:34.905228 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1128dfd-8e4e-4dc3-a40e-5645b600e7d1 None admin] PATH_INFO: `/v3/users/39f9b2d2ae7244ffbcf79adfe093b0c0` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:34.915108 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1128dfd-8e4e-4dc3-a40e-5645b600e7d1 None admin] RBAC: Authorizing `identity:get_user(user_id=39f9b2d2ae7244ffbcf79adfe093b0c0)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:34.916563 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1128dfd-8e4e-4dc3-a40e-5645b600e7d1 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:34.918162 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 549/1114] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:16:34 2022] GET /identity/v3/users/39f9b2d2ae7244ffbcf79adfe093b0c0 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:34.923822 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084bfa3-7d4d-4b7b-952e-a370ce355f4a None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:34.970190 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:35.020874 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084bfa3-7d4d-4b7b-952e-a370ce355f4a None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:35.052531 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb21c9-27ed-4929-9a61-23416ecf8183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:35.053412 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb21c9-27ed-4929-9a61-23416ecf8183 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:35.053695 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb21c9-27ed-4929-9a61-23416ecf8183 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:35.053969 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb21c9-27ed-4929-9a61-23416ecf8183 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:35.118971 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb21c9-27ed-4929-9a61-23416ecf8183 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:35.120430 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb21c9-27ed-4929-9a61-23416ecf8183 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:35.162842 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:35.215836 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 566/1115] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:16:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 19:16:35.221715 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1128dfd-8e4e-4dc3-a40e-5645b600e7d1 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:35.318674 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1128dfd-8e4e-4dc3-a40e-5645b600e7d1 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:35.350874 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a752b-08ae-4e38-b892-0883bcb8031e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:35.351752 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a752b-08ae-4e38-b892-0883bcb8031e None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:35.352040 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a752b-08ae-4e38-b892-0883bcb8031e None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:35.352317 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a752b-08ae-4e38-b892-0883bcb8031e None admin] PATH_INFO: `/v3/projects/aa6ff855c9204302b728218d6827fdad` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:35.353477 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85a752b-08ae-4e38-b892-0883bcb8031e None admin] RBAC: Authorizing `identity:get_project(project_id=aa6ff855c9204302b728218d6827fdad)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:35.354897 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85a752b-08ae-4e38-b892-0883bcb8031e None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:35.356589 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 550/1116] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:16:35 2022] GET /identity/v3/projects/aa6ff855c9204302b728218d6827fdad => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:35.362537 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb21c9-27ed-4929-9a61-23416ecf8183 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:35.459848 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb21c9-27ed-4929-9a61-23416ecf8183 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:35.493727 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd45da7-cbd3-4c63-bf91-2d6866e11dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:35.494376 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd45da7-cbd3-4c63-bf91-2d6866e11dac None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:35.494662 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd45da7-cbd3-4c63-bf91-2d6866e11dac None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:35.494941 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd45da7-cbd3-4c63-bf91-2d6866e11dac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:35.495792 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd45da7-cbd3-4c63-bf91-2d6866e11dac None admin] RBAC: Adding query filter params (role.id=3ad609555dec437d92e5c7291b1c939a, scope.project.id=aa6ff855c9204302b728218d6827fdad, user.id=39f9b2d2ae7244ffbcf79adfe093b0c0) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:35.496103 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd45da7-cbd3-4c63-bf91-2d6866e11dac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:35.497524 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd45da7-cbd3-4c63-bf91-2d6866e11dac None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:35.502890 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 567/1117] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:16:35 2022] GET /identity/v3/role_assignments?user.id=39f9b2d2ae7244ffbcf79adfe093b0c0&scope.project.id=aa6ff855c9204302b728218d6827fdad&role.id=3ad609555dec437d92e5c7291b1c939a => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:37.527773 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801e4a3-e12b-48fe-9ea1-d2a098c9db9f None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:37.528313 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801e4a3-e12b-48fe-9ea1-d2a098c9db9f None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:37.528313 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801e4a3-e12b-48fe-9ea1-d2a098c9db9f None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:37.529667 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 551/1118] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:16:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:16:37.534765 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17675e2b-7dbc-444c-93e6-a8e0eed06185 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:37.535184 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17675e2b-7dbc-444c-93e6-a8e0eed06185 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:37.535324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17675e2b-7dbc-444c-93e6-a8e0eed06185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:37.552277 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-17675e2b-7dbc-444c-93e6-a8e0eed06185 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:16:37.553710 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-17675e2b-7dbc-444c-93e6-a8e0eed06185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:16:37.556447 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:37.619109 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 568/1119] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:16:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:16:37.641980 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801e4a3-e12b-48fe-9ea1-d2a098c9db9f None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:37.684989 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:37.739832 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801e4a3-e12b-48fe-9ea1-d2a098c9db9f None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:37.771513 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a015e-87d6-4bc7-8ff4-c8280367972e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:37.772353 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a015e-87d6-4bc7-8ff4-c8280367972e None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:37.772637 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a015e-87d6-4bc7-8ff4-c8280367972e None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:37.772914 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a015e-87d6-4bc7-8ff4-c8280367972e None admin] PATH_INFO: `/v3/roles/3ad609555dec437d92e5c7291b1c939a` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:37.774369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a015e-87d6-4bc7-8ff4-c8280367972e None admin] RBAC: Authorizing `identity:get_role(role_id=3ad609555dec437d92e5c7291b1c939a)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:37.775756 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a015e-87d6-4bc7-8ff4-c8280367972e None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:37.777095 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 552/1120] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:16:37 2022] GET /identity/v3/roles/3ad609555dec437d92e5c7291b1c939a => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:37.782819 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17675e2b-7dbc-444c-93e6-a8e0eed06185 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:37.879936 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17675e2b-7dbc-444c-93e6-a8e0eed06185 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:37.913033 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2693e-0ddf-4b53-a259-a84a0497cb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:37.913912 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2693e-0ddf-4b53-a259-a84a0497cb13 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:37.914198 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2693e-0ddf-4b53-a259-a84a0497cb13 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:37.914476 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2693e-0ddf-4b53-a259-a84a0497cb13 None admin] PATH_INFO: `/v3/users/39f9b2d2ae7244ffbcf79adfe093b0c0` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:37.915681 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e2693e-0ddf-4b53-a259-a84a0497cb13 None admin] RBAC: Authorizing `identity:get_user(user_id=39f9b2d2ae7244ffbcf79adfe093b0c0)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:37.917113 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e2693e-0ddf-4b53-a259-a84a0497cb13 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:37.918728 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 569/1121] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:16:37 2022] GET /identity/v3/users/39f9b2d2ae7244ffbcf79adfe093b0c0 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:37.924291 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a015e-87d6-4bc7-8ff4-c8280367972e None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:38.020211 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a015e-87d6-4bc7-8ff4-c8280367972e None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:38.030413 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:38.054398 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ce707-077c-430a-91ab-d0cae6b17001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:38.055244 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ce707-077c-430a-91ab-d0cae6b17001 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:38.055558 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ce707-077c-430a-91ab-d0cae6b17001 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:38.055837 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ce707-077c-430a-91ab-d0cae6b17001 None admin] PATH_INFO: `/v3/projects/aa6ff855c9204302b728218d6827fdad` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:38.057007 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804ce707-077c-430a-91ab-d0cae6b17001 None admin] RBAC: Authorizing `identity:get_project(project_id=aa6ff855c9204302b728218d6827fdad)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:38.058420 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804ce707-077c-430a-91ab-d0cae6b17001 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:38.060109 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 553/1122] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:16:37 2022] GET /identity/v3/projects/aa6ff855c9204302b728218d6827fdad => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:38.066407 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2693e-0ddf-4b53-a259-a84a0497cb13 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:38.077290 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:38.166179 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2693e-0ddf-4b53-a259-a84a0497cb13 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:38.199309 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d56dc62-9f16-46e9-948d-157b892b8d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:38.200322 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56dc62-9f16-46e9-948d-157b892b8d77 None admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:38.200608 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56dc62-9f16-46e9-948d-157b892b8d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:38.200884 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56dc62-9f16-46e9-948d-157b892b8d77 None admin] PATH_INFO: `/v3/projects/aa6ff855c9204302b728218d6827fdad/users/39f9b2d2ae7244ffbcf79adfe093b0c0/roles/3ad609555dec437d92e5c7291b1c939a` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:38.203175 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d56dc62-9f16-46e9-948d-157b892b8d77 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa6ff855c9204302b728218d6827fdad, user_id=39f9b2d2ae7244ffbcf79adfe093b0c0, role_id=3ad609555dec437d92e5c7291b1c939a)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:38.204629 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d56dc62-9f16-46e9-948d-157b892b8d77 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:38.293509 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 570/1123] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Jul 21 19:16:38 2022] PUT /identity/v3/projects/aa6ff855c9204302b728218d6827fdad/users/39f9b2d2ae7244ffbcf79adfe093b0c0/roles/3ad609555dec437d92e5c7291b1c939a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:16:40.334280 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6446dde-fe95-4184-8357-9e7f15c9aacd None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:40.334867 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6446dde-fe95-4184-8357-9e7f15c9aacd None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:40.334867 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6446dde-fe95-4184-8357-9e7f15c9aacd None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:40.336296 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 554/1124] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:16:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:16:40.341524 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9663e96-07e3-4d89-a523-478622145a8a None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:40.341942 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9663e96-07e3-4d89-a523-478622145a8a None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:40.342058 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9663e96-07e3-4d89-a523-478622145a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:40.358810 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-a9663e96-07e3-4d89-a523-478622145a8a None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:16:40.360021 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-a9663e96-07e3-4d89-a523-478622145a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:16:40.420159 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:40.425352 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 571/1125] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:16:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:16:40.449679 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6446dde-fe95-4184-8357-9e7f15c9aacd None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:40.547383 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6446dde-fe95-4184-8357-9e7f15c9aacd None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:40.579795 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8a57a-abf9-477d-aee4-bf04a659cbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:40.580629 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8a57a-abf9-477d-aee4-bf04a659cbdf None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:40.580907 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8a57a-abf9-477d-aee4-bf04a659cbdf None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:40.581177 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8a57a-abf9-477d-aee4-bf04a659cbdf None admin] PATH_INFO: `/v3/roles/3ad609555dec437d92e5c7291b1c939a` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:40.583425 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8a57a-abf9-477d-aee4-bf04a659cbdf None admin] RBAC: Authorizing `identity:get_role(role_id=3ad609555dec437d92e5c7291b1c939a)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:40.584859 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8a57a-abf9-477d-aee4-bf04a659cbdf None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:40.586142 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 555/1126] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:16:40 2022] GET /identity/v3/roles/3ad609555dec437d92e5c7291b1c939a => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:40.592092 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9663e96-07e3-4d89-a523-478622145a8a None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:40.688931 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9663e96-07e3-4d89-a523-478622145a8a None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:40.721657 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb4395-4a23-4cca-b9a2-9963f7a655f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:40.723163 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb4395-4a23-4cca-b9a2-9963f7a655f4 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:40.723463 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb4395-4a23-4cca-b9a2-9963f7a655f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:40.723749 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb4395-4a23-4cca-b9a2-9963f7a655f4 None admin] PATH_INFO: `/v3/users/39f9b2d2ae7244ffbcf79adfe093b0c0` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:40.724930 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb4395-4a23-4cca-b9a2-9963f7a655f4 None admin] RBAC: Authorizing `identity:get_user(user_id=39f9b2d2ae7244ffbcf79adfe093b0c0)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:40.726348 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb4395-4a23-4cca-b9a2-9963f7a655f4 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:40.727988 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 572/1127] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:16:40 2022] GET /identity/v3/users/39f9b2d2ae7244ffbcf79adfe093b0c0 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:40.733535 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8a57a-abf9-477d-aee4-bf04a659cbdf None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:40.778640 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:40.829380 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8a57a-abf9-477d-aee4-bf04a659cbdf None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:40.861193 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13bf6b0-4b57-45b9-99fa-d7bc5e535972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:40.861761 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bf6b0-4b57-45b9-99fa-d7bc5e535972 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:40.862045 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bf6b0-4b57-45b9-99fa-d7bc5e535972 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:40.862319 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bf6b0-4b57-45b9-99fa-d7bc5e535972 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:40.926450 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13bf6b0-4b57-45b9-99fa-d7bc5e535972 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:40.927907 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13bf6b0-4b57-45b9-99fa-d7bc5e535972 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:40.970381 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:41.021408 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 556/1128] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:16:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 19:16:41.027351 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb4395-4a23-4cca-b9a2-9963f7a655f4 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:41.090631 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:41.122931 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb4395-4a23-4cca-b9a2-9963f7a655f4 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:41.156079 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1dcc4-d6d0-40dd-8b6c-b2cc9c45268d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:41.156922 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1dcc4-d6d0-40dd-8b6c-b2cc9c45268d None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:41.157202 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1dcc4-d6d0-40dd-8b6c-b2cc9c45268d None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:41.157474 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1dcc4-d6d0-40dd-8b6c-b2cc9c45268d None admin] PATH_INFO: `/v3/projects/aa6ff855c9204302b728218d6827fdad` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:41.158644 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c1dcc4-d6d0-40dd-8b6c-b2cc9c45268d None admin] RBAC: Authorizing `identity:get_project(project_id=aa6ff855c9204302b728218d6827fdad)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:41.160295 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c1dcc4-d6d0-40dd-8b6c-b2cc9c45268d None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:41.161959 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 573/1129] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:16:41 2022] GET /identity/v3/projects/aa6ff855c9204302b728218d6827fdad => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:41.168012 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13bf6b0-4b57-45b9-99fa-d7bc5e535972 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:41.265162 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13bf6b0-4b57-45b9-99fa-d7bc5e535972 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:41.297705 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25af234-491b-4514-aaa0-71b7046b2952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:41.298376 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25af234-491b-4514-aaa0-71b7046b2952 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:41.298661 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25af234-491b-4514-aaa0-71b7046b2952 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:41.298938 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25af234-491b-4514-aaa0-71b7046b2952 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:41.299792 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25af234-491b-4514-aaa0-71b7046b2952 None admin] RBAC: Adding query filter params (role.id=3ad609555dec437d92e5c7291b1c939a, scope.project.id=aa6ff855c9204302b728218d6827fdad, user.id=39f9b2d2ae7244ffbcf79adfe093b0c0) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:41.300640 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25af234-491b-4514-aaa0-71b7046b2952 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:41.302139 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25af234-491b-4514-aaa0-71b7046b2952 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:41.308098 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 557/1130] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:16:41 2022] GET /identity/v3/role_assignments?user.id=39f9b2d2ae7244ffbcf79adfe093b0c0&scope.project.id=aa6ff855c9204302b728218d6827fdad&role.id=3ad609555dec437d92e5c7291b1c939a => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:43.339884 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83d2e4-a7ba-477a-a3eb-0e5b396035b3 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:43.340419 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83d2e4-a7ba-477a-a3eb-0e5b396035b3 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:43.340419 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83d2e4-a7ba-477a-a3eb-0e5b396035b3 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:43.341778 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 574/1131] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:16:43.347322 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1618eaa-2e92-4a15-ae91-9aea06755ceb None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:43.347893 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1618eaa-2e92-4a15-ae91-9aea06755ceb None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:43.347982 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1618eaa-2e92-4a15-ae91-9aea06755ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:43.364750 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-e1618eaa-2e92-4a15-ae91-9aea06755ceb None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:16:43.365926 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-e1618eaa-2e92-4a15-ae91-9aea06755ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:16:43.368600 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:43.430399 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 558/1132] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:16:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:16:43.453221 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b83d2e4-a7ba-477a-a3eb-0e5b396035b3 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:43.567742 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b83d2e4-a7ba-477a-a3eb-0e5b396035b3 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:43.601513 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e5e07-a130-405e-ad3b-040d53f2e020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:43.602221 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e5e07-a130-405e-ad3b-040d53f2e020 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:43.602505 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e5e07-a130-405e-ad3b-040d53f2e020 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:43.602778 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e5e07-a130-405e-ad3b-040d53f2e020 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:43.603953 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e5e07-a130-405e-ad3b-040d53f2e020 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:43.605376 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e5e07-a130-405e-ad3b-040d53f2e020 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:43.606971 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 575/1133] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:16:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:43.612733 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1618eaa-2e92-4a15-ae91-9aea06755ceb None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:43.706941 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1618eaa-2e92-4a15-ae91-9aea06755ceb None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:43.739349 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93588dde-5a7e-49ba-8190-b4001b2f5f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:43.740022 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93588dde-5a7e-49ba-8190-b4001b2f5f94 None admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:43.740307 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93588dde-5a7e-49ba-8190-b4001b2f5f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:43.740584 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93588dde-5a7e-49ba-8190-b4001b2f5f94 None admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:43.741281 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93588dde-5a7e-49ba-8190-b4001b2f5f94 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:43.742694 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93588dde-5a7e-49ba-8190-b4001b2f5f94 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:43.751894 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:43.829087 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 559/1134] 10.222.0.60 () {60 vars in 1141 bytes} [Thu Jul 21 19:16:43 2022] POST /identity/v3/projects => generated 311 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:16:45.868957 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7f2b2-8f42-46f2-9abc-15a006689afa None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:45.869459 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7f2b2-8f42-46f2-9abc-15a006689afa None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:45.869459 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7f2b2-8f42-46f2-9abc-15a006689afa None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:45.870826 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 576/1135] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:16:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:16:45.876029 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4df8a-7f82-44bd-b404-20a6d0749f08 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:45.876469 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4df8a-7f82-44bd-b404-20a6d0749f08 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:45.876572 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4df8a-7f82-44bd-b404-20a6d0749f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:45.893708 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-a6b4df8a-7f82-44bd-b404-20a6d0749f08 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:16:45.894879 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-a6b4df8a-7f82-44bd-b404-20a6d0749f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:16:45.958225 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 560/1136] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:16:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:16:45.982923 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7f2b2-8f42-46f2-9abc-15a006689afa None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:45.985828 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:46.083756 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7f2b2-8f42-46f2-9abc-15a006689afa None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:46.117485 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a26eec-6e4a-4050-b6fd-b9c57b6d5671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:46.118257 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a26eec-6e4a-4050-b6fd-b9c57b6d5671 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:46.118545 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a26eec-6e4a-4050-b6fd-b9c57b6d5671 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:46.118823 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a26eec-6e4a-4050-b6fd-b9c57b6d5671 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:46.120068 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a26eec-6e4a-4050-b6fd-b9c57b6d5671 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:46.121446 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a26eec-6e4a-4050-b6fd-b9c57b6d5671 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:46.123042 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 577/1137] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:16:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:46.128754 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b4df8a-7f82-44bd-b404-20a6d0749f08 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:46.230388 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b4df8a-7f82-44bd-b404-20a6d0749f08 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:46.254504 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:46.266567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba39a4-6022-443a-a4a6-4dfd40844c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:46.269029 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba39a4-6022-443a-a4a6-4dfd40844c74 None admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:46.269029 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba39a4-6022-443a-a4a6-4dfd40844c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:46.269029 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba39a4-6022-443a-a4a6-4dfd40844c74 None admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:46.269029 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ba39a4-6022-443a-a4a6-4dfd40844c74 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:46.269953 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ba39a4-6022-443a-a4a6-4dfd40844c74 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:46.399136 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 561/1138] 10.222.0.60 () {60 vars in 1132 bytes} [Thu Jul 21 19:16:46 2022] POST /identity/v3/users => generated 286 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:16:48.437568 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25dfda-291f-4384-a070-9bc260a23f2e None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:48.438046 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25dfda-291f-4384-a070-9bc260a23f2e None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:48.438155 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25dfda-291f-4384-a070-9bc260a23f2e None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:48.439487 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 578/1139] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:16:48.445232 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0c46e-83d8-49cb-b0e3-40113acdee81 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:48.445625 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0c46e-83d8-49cb-b0e3-40113acdee81 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:48.445800 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0c46e-83d8-49cb-b0e3-40113acdee81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:48.462764 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-59e0c46e-83d8-49cb-b0e3-40113acdee81 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:16:48.463985 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-59e0c46e-83d8-49cb-b0e3-40113acdee81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:16:48.527992 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 562/1140] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:16:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:16:48.551299 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25dfda-291f-4384-a070-9bc260a23f2e None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:48.620448 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:48.650054 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25dfda-291f-4384-a070-9bc260a23f2e None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:48.683838 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a882a-f4e5-470d-95ef-29467c8dbc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:48.684546 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a882a-f4e5-470d-95ef-29467c8dbc4b None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:48.684828 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a882a-f4e5-470d-95ef-29467c8dbc4b None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:48.685102 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a882a-f4e5-470d-95ef-29467c8dbc4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:48.696138 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a882a-f4e5-470d-95ef-29467c8dbc4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:16:48.703563 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-226a882a-f4e5-470d-95ef-29467c8dbc4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:16:48.703563 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:48.703563 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:48.703563 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:48.703563 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:48.703563 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:48.703563 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:48.703563 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:48.703563 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:48.703563 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:48.703563 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:48.703563 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:48.703563 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:16:48.703563 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:16:48.703563 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:16:48.703563 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:16:48.704671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:16:48.704671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:16:48.704671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:16:48.704671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:16:48.704671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:48.704671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:48.704671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:48.704671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:48.704671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:48.704671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:48.704671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:48.704671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:48.704671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:48.704671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:48.704671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:48.704671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:48.705898 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:48.705898 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:48.705898 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:48.705898 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:48.705898 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:16:48.705898 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:16:48.705898 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:16:48.705898 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:16:48.705898 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:16:48.705898 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:16:48.705898 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:16:48.705898 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:48.705898 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 579/1141] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Jul 21 19:16:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:16:48.711025 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0c46e-83d8-49cb-b0e3-40113acdee81 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:48.804891 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0c46e-83d8-49cb-b0e3-40113acdee81 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:48.813610 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:48.837430 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201914e-3b2e-4ab8-b2ae-28d3f246bca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:48.838090 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201914e-3b2e-4ab8-b2ae-28d3f246bca8 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:48.838372 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201914e-3b2e-4ab8-b2ae-28d3f246bca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:48.838645 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201914e-3b2e-4ab8-b2ae-28d3f246bca8 None admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:48.839379 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1201914e-3b2e-4ab8-b2ae-28d3f246bca8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:48.839712 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1201914e-3b2e-4ab8-b2ae-28d3f246bca8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:48.841063 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1201914e-3b2e-4ab8-b2ae-28d3f246bca8 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:48.849607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 563/1142] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:16:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:48.855246 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a882a-f4e5-470d-95ef-29467c8dbc4b None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:48.956452 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a882a-f4e5-470d-95ef-29467c8dbc4b None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:48.983785 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:48.989959 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95306151-914d-42d6-89ec-68d03500a8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:48.990808 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95306151-914d-42d6-89ec-68d03500a8a7 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:48.991089 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95306151-914d-42d6-89ec-68d03500a8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:48.994862 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95306151-914d-42d6-89ec-68d03500a8a7 None admin] PATH_INFO: `/v3/users/5b4cddbfff0643bba4ff57f6bc10c0ab` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:49.004258 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95306151-914d-42d6-89ec-68d03500a8a7 None admin] RBAC: Authorizing `identity:get_user(user_id=5b4cddbfff0643bba4ff57f6bc10c0ab)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:49.005679 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95306151-914d-42d6-89ec-68d03500a8a7 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:49.007359 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 580/1143] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:16:48 2022] GET /identity/v3/users/5b4cddbfff0643bba4ff57f6bc10c0ab => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:49.013140 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201914e-3b2e-4ab8-b2ae-28d3f246bca8 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:49.109251 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201914e-3b2e-4ab8-b2ae-28d3f246bca8 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:49.141504 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261403ed-11d1-43bf-a4d0-c35991ac737d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:49.142138 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261403ed-11d1-43bf-a4d0-c35991ac737d None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:49.142424 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261403ed-11d1-43bf-a4d0-c35991ac737d None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:49.142704 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261403ed-11d1-43bf-a4d0-c35991ac737d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:49.180407 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:49.207745 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261403ed-11d1-43bf-a4d0-c35991ac737d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:49.209123 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261403ed-11d1-43bf-a4d0-c35991ac737d None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:49.303699 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 564/1144] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:16:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 19:16:49.309545 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95306151-914d-42d6-89ec-68d03500a8a7 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:49.405585 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95306151-914d-42d6-89ec-68d03500a8a7 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:49.441404 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80c113-932f-4c75-a7dc-3738d3a88603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:49.442246 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80c113-932f-4c75-a7dc-3738d3a88603 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:49.442526 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80c113-932f-4c75-a7dc-3738d3a88603 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:49.442800 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80c113-932f-4c75-a7dc-3738d3a88603 None admin] PATH_INFO: `/v3/projects/f4a2597c329c4409823816f954188cb0` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:49.443977 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb80c113-932f-4c75-a7dc-3738d3a88603 None admin] RBAC: Authorizing `identity:get_project(project_id=f4a2597c329c4409823816f954188cb0)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:49.445394 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb80c113-932f-4c75-a7dc-3738d3a88603 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:49.447057 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 581/1145] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:16:49 2022] GET /identity/v3/projects/f4a2597c329c4409823816f954188cb0 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:49.453070 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261403ed-11d1-43bf-a4d0-c35991ac737d None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:49.518068 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:49.547120 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261403ed-11d1-43bf-a4d0-c35991ac737d None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:49.578645 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f57bd-7e76-4c0f-b84e-cb6e86d58d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:49.579283 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f57bd-7e76-4c0f-b84e-cb6e86d58d20 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:49.579592 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f57bd-7e76-4c0f-b84e-cb6e86d58d20 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:49.579868 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f57bd-7e76-4c0f-b84e-cb6e86d58d20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:49.580688 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f57bd-7e76-4c0f-b84e-cb6e86d58d20 None admin] RBAC: Adding query filter params (role.id=685e18230e1744c581baaf842d0fd4ca, scope.project.id=f4a2597c329c4409823816f954188cb0, user.id=5b4cddbfff0643bba4ff57f6bc10c0ab) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:49.581521 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f57bd-7e76-4c0f-b84e-cb6e86d58d20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:49.583159 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f57bd-7e76-4c0f-b84e-cb6e86d58d20 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:49.588406 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 565/1146] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:16:49 2022] GET /identity/v3/role_assignments?user.id=5b4cddbfff0643bba4ff57f6bc10c0ab&scope.project.id=f4a2597c329c4409823816f954188cb0&role.id=685e18230e1744c581baaf842d0fd4ca => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:51.559147 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7cbbe-0814-4c5b-ab9d-3a5f61fd6b0e None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:51.559693 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7cbbe-0814-4c5b-ab9d-3a5f61fd6b0e None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:51.559780 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7cbbe-0814-4c5b-ab9d-3a5f61fd6b0e None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:51.561097 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 582/1147] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:16:51.566760 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18076a6b-5568-4e58-9e23-a16e428c1c4c None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:51.567199 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18076a6b-5568-4e58-9e23-a16e428c1c4c None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:51.567322 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18076a6b-5568-4e58-9e23-a16e428c1c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:51.585214 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-18076a6b-5568-4e58-9e23-a16e428c1c4c None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:16:51.586395 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-18076a6b-5568-4e58-9e23-a16e428c1c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:16:51.649666 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 566/1148] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:16:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:16:51.671232 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7cbbe-0814-4c5b-ab9d-3a5f61fd6b0e None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:51.727640 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:51.771426 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7cbbe-0814-4c5b-ab9d-3a5f61fd6b0e None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:51.804367 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85058ac-cad9-4b2c-82bc-17b9112547d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:51.805140 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85058ac-cad9-4b2c-82bc-17b9112547d8 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:51.805448 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85058ac-cad9-4b2c-82bc-17b9112547d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:51.805725 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85058ac-cad9-4b2c-82bc-17b9112547d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:51.816214 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85058ac-cad9-4b2c-82bc-17b9112547d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:16:51.823767 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-f85058ac-cad9-4b2c-82bc-17b9112547d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:16:51.823767 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:51.823767 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:51.823767 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:51.823767 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:51.823767 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:51.823767 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:51.823767 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:51.823767 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:51.823767 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:51.823767 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:51.823767 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:51.823767 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:16:51.823767 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:16:51.823767 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:16:51.823767 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:16:51.824848 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:16:51.824848 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:16:51.824848 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:16:51.824848 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:16:51.824848 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:51.824848 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:51.824848 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:51.824848 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:51.824848 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:51.824848 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:51.824848 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:51.824848 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:51.824848 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:51.824848 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:51.824848 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:51.824848 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:51.825864 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:51.825864 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:51.825864 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:51.825864 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:51.825864 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:16:51.825864 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:16:51.825864 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:16:51.825864 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:16:51.825864 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:16:51.825864 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:16:51.825864 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:16:51.825864 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:51.825864 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 583/1149] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Jul 21 19:16:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:16:51.831044 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18076a6b-5568-4e58-9e23-a16e428c1c4c None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:51.890364 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:51.927240 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18076a6b-5568-4e58-9e23-a16e428c1c4c None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:51.959972 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece25c1-1318-4d34-9e45-8039f8a024d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:51.960624 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece25c1-1318-4d34-9e45-8039f8a024d1 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:51.960908 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece25c1-1318-4d34-9e45-8039f8a024d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:51.961185 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece25c1-1318-4d34-9e45-8039f8a024d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:51.961915 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece25c1-1318-4d34-9e45-8039f8a024d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:51.962221 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece25c1-1318-4d34-9e45-8039f8a024d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:51.963621 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece25c1-1318-4d34-9e45-8039f8a024d1 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:51.972276 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 567/1150] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:16:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:51.978279 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85058ac-cad9-4b2c-82bc-17b9112547d8 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:52.076299 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85058ac-cad9-4b2c-82bc-17b9112547d8 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:52.091697 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:52.109218 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f5e9d-cff1-418c-a4bb-4df9a7d74cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:52.110072 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f5e9d-cff1-418c-a4bb-4df9a7d74cca None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:52.110357 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f5e9d-cff1-418c-a4bb-4df9a7d74cca None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:52.110638 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f5e9d-cff1-418c-a4bb-4df9a7d74cca None admin] PATH_INFO: `/v3/users/5b4cddbfff0643bba4ff57f6bc10c0ab` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:52.111844 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0f5e9d-cff1-418c-a4bb-4df9a7d74cca None admin] RBAC: Authorizing `identity:get_user(user_id=5b4cddbfff0643bba4ff57f6bc10c0ab)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:52.113936 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0f5e9d-cff1-418c-a4bb-4df9a7d74cca None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:52.115598 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 584/1151] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:16:51 2022] GET /identity/v3/users/5b4cddbfff0643bba4ff57f6bc10c0ab => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:52.121343 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece25c1-1318-4d34-9e45-8039f8a024d1 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:52.214407 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece25c1-1318-4d34-9e45-8039f8a024d1 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:52.240179 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:52.248476 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a7c07-4e5a-4a68-af5b-50ef32276053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:52.249328 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a7c07-4e5a-4a68-af5b-50ef32276053 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:52.252175 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a7c07-4e5a-4a68-af5b-50ef32276053 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:52.252175 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a7c07-4e5a-4a68-af5b-50ef32276053 None admin] PATH_INFO: `/v3/projects/f4a2597c329c4409823816f954188cb0` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:52.252175 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8a7c07-4e5a-4a68-af5b-50ef32276053 None admin] RBAC: Authorizing `identity:get_project(project_id=f4a2597c329c4409823816f954188cb0)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:52.252500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8a7c07-4e5a-4a68-af5b-50ef32276053 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:52.254421 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 568/1152] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:16:52 2022] GET /identity/v3/projects/f4a2597c329c4409823816f954188cb0 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:52.260192 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f5e9d-cff1-418c-a4bb-4df9a7d74cca None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:52.358858 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f5e9d-cff1-418c-a4bb-4df9a7d74cca None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:52.391326 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa522182-bdff-491b-91c9-219e86003a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:52.392223 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa522182-bdff-491b-91c9-219e86003a36 None admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:52.392508 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa522182-bdff-491b-91c9-219e86003a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:52.392783 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa522182-bdff-491b-91c9-219e86003a36 None admin] PATH_INFO: `/v3/projects/f4a2597c329c4409823816f954188cb0/users/5b4cddbfff0643bba4ff57f6bc10c0ab/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:52.395262 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa522182-bdff-491b-91c9-219e86003a36 None admin] RBAC: Authorizing `identity:create_grant(project_id=f4a2597c329c4409823816f954188cb0, user_id=5b4cddbfff0643bba4ff57f6bc10c0ab, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:52.396717 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa522182-bdff-491b-91c9-219e86003a36 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:52.493761 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 585/1153] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Jul 21 19:16:52 2022] PUT /identity/v3/projects/f4a2597c329c4409823816f954188cb0/users/5b4cddbfff0643bba4ff57f6bc10c0ab/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:16:54.482614 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b058e-e3ed-4257-86a6-d7b5954d9565 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:54.483089 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b058e-e3ed-4257-86a6-d7b5954d9565 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:54.483179 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b058e-e3ed-4257-86a6-d7b5954d9565 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:54.484561 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 569/1154] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:16:54.490080 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97752266-d468-48c0-9552-243c66526500 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:54.490490 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97752266-d468-48c0-9552-243c66526500 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:54.490634 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97752266-d468-48c0-9552-243c66526500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:54.507440 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-97752266-d468-48c0-9552-243c66526500 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:16:54.508627 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-97752266-d468-48c0-9552-243c66526500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:16:54.546371 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:54.572393 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 586/1155] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:16:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 19:16:54.596495 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b058e-e3ed-4257-86a6-d7b5954d9565 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:54.694808 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b058e-e3ed-4257-86a6-d7b5954d9565 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:54.726590 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de0ce3-e077-436d-930b-a486984e14dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:54.727373 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de0ce3-e077-436d-930b-a486984e14dd None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:54.727669 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de0ce3-e077-436d-930b-a486984e14dd None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:54.727942 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de0ce3-e077-436d-930b-a486984e14dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:54.738096 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58de0ce3-e077-436d-930b-a486984e14dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:16:54.745643 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-58de0ce3-e077-436d-930b-a486984e14dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:16:54.745643 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:54.745643 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:54.745643 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:54.745643 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:54.745643 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:54.745643 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:54.745643 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:54.745643 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:54.745643 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:54.745643 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:54.745643 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:54.745643 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:16:54.745643 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:16:54.745643 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:16:54.745643 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:16:54.746746 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:16:54.746746 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:16:54.746746 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:16:54.746746 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:16:54.746746 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:54.746746 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:54.746746 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:54.746746 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:54.746746 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:54.746746 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:54.746746 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:54.746746 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:54.746746 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:54.746746 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:54.746746 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:54.746746 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:54.747794 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:54.747794 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:54.747794 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:54.747794 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:54.747794 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:16:54.747794 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:16:54.747794 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:16:54.747794 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:16:54.747794 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:16:54.747794 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:16:54.747794 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:16:54.747794 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:16:54.747794 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 570/1156] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Jul 21 19:16:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:16:54.753528 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97752266-d468-48c0-9552-243c66526500 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:54.848885 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97752266-d468-48c0-9552-243c66526500 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:54.882370 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd7bf6-83b9-4de1-957b-dd0e382b8d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:54.883024 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd7bf6-83b9-4de1-957b-dd0e382b8d12 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:54.883310 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd7bf6-83b9-4de1-957b-dd0e382b8d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:54.883617 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd7bf6-83b9-4de1-957b-dd0e382b8d12 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:54.884356 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd7bf6-83b9-4de1-957b-dd0e382b8d12 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:54.884665 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd7bf6-83b9-4de1-957b-dd0e382b8d12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:54.886030 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd7bf6-83b9-4de1-957b-dd0e382b8d12 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:54.893861 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 587/1157] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:16:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:54.899759 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de0ce3-e077-436d-930b-a486984e14dd None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:54.953383 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:55.005938 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de0ce3-e077-436d-930b-a486984e14dd None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:55.039334 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d0784-b72b-4b84-8e49-be80adeceec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:55.040225 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d0784-b72b-4b84-8e49-be80adeceec3 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:55.040509 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d0784-b72b-4b84-8e49-be80adeceec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:55.040783 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d0784-b72b-4b84-8e49-be80adeceec3 None admin] PATH_INFO: `/v3/users/5b4cddbfff0643bba4ff57f6bc10c0ab` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:55.041937 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d0784-b72b-4b84-8e49-be80adeceec3 None admin] RBAC: Authorizing `identity:get_user(user_id=5b4cddbfff0643bba4ff57f6bc10c0ab)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:55.043355 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d0784-b72b-4b84-8e49-be80adeceec3 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:55.044972 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 571/1158] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:16:54 2022] GET /identity/v3/users/5b4cddbfff0643bba4ff57f6bc10c0ab => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:55.051548 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd7bf6-83b9-4de1-957b-dd0e382b8d12 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:55.087119 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:55.150841 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd7bf6-83b9-4de1-957b-dd0e382b8d12 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:55.184625 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f660e2a-b816-482d-b71e-d1d66306b39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:55.185266 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f660e2a-b816-482d-b71e-d1d66306b39c None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:55.185548 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f660e2a-b816-482d-b71e-d1d66306b39c None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:55.185821 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f660e2a-b816-482d-b71e-d1d66306b39c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:55.256835 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f660e2a-b816-482d-b71e-d1d66306b39c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:55.258264 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f660e2a-b816-482d-b71e-d1d66306b39c None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:55.291860 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:55.366885 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 588/1159] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:16:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 19:16:55.372903 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d0784-b72b-4b84-8e49-be80adeceec3 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:55.475018 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d0784-b72b-4b84-8e49-be80adeceec3 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:55.496248 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:55.508300 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50000567-48e2-46df-b5b9-95cb35a32379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:55.509083 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50000567-48e2-46df-b5b9-95cb35a32379 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:55.509363 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50000567-48e2-46df-b5b9-95cb35a32379 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:55.509636 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50000567-48e2-46df-b5b9-95cb35a32379 None admin] PATH_INFO: `/v3/projects/f4a2597c329c4409823816f954188cb0` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:55.510795 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50000567-48e2-46df-b5b9-95cb35a32379 None admin] RBAC: Authorizing `identity:get_project(project_id=f4a2597c329c4409823816f954188cb0)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:55.512242 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50000567-48e2-46df-b5b9-95cb35a32379 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:55.513986 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 572/1160] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:16:55 2022] GET /identity/v3/projects/f4a2597c329c4409823816f954188cb0 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:55.521306 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f660e2a-b816-482d-b71e-d1d66306b39c None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:55.622207 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f660e2a-b816-482d-b71e-d1d66306b39c None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:55.661502 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d8241-78d8-4434-80e0-e0d5b857c1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:55.662152 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d8241-78d8-4434-80e0-e0d5b857c1f2 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:55.662433 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d8241-78d8-4434-80e0-e0d5b857c1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:55.662706 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d8241-78d8-4434-80e0-e0d5b857c1f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:55.663722 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d8241-78d8-4434-80e0-e0d5b857c1f2 None admin] RBAC: Adding query filter params (role.id=685e18230e1744c581baaf842d0fd4ca, scope.project.id=f4a2597c329c4409823816f954188cb0, user.id=5b4cddbfff0643bba4ff57f6bc10c0ab) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:55.664052 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d8241-78d8-4434-80e0-e0d5b857c1f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:55.665484 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d8241-78d8-4434-80e0-e0d5b857c1f2 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:55.668350 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:55.672293 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 589/1161] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:16:55 2022] GET /identity/v3/role_assignments?user.id=5b4cddbfff0643bba4ff57f6bc10c0ab&scope.project.id=f4a2597c329c4409823816f954188cb0&role.id=685e18230e1744c581baaf842d0fd4ca => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:16:57.731851 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0ea79-6e54-495e-8ea3-621ca2f45cac None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:57.732352 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0ea79-6e54-495e-8ea3-621ca2f45cac None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:57.732352 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0ea79-6e54-495e-8ea3-621ca2f45cac None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:57.733657 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 573/1162] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:16:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:16:57.739054 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cc2e9-ca47-49a6-afc1-50e51f8b2f80 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:57.739530 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cc2e9-ca47-49a6-afc1-50e51f8b2f80 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:57.739654 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cc2e9-ca47-49a6-afc1-50e51f8b2f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:57.756759 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-237cc2e9-ca47-49a6-afc1-50e51f8b2f80 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:16:57.757942 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-237cc2e9-ca47-49a6-afc1-50e51f8b2f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:16:57.823721 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 590/1163] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:16:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:16:57.846909 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b0ea79-6e54-495e-8ea3-621ca2f45cac None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:57.944033 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b0ea79-6e54-495e-8ea3-621ca2f45cac None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:57.976629 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef2be8-3548-4da9-9c2a-d6e8cf005f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:57.977256 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef2be8-3548-4da9-9c2a-d6e8cf005f3d None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:57.977539 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef2be8-3548-4da9-9c2a-d6e8cf005f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:57.977816 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef2be8-3548-4da9-9c2a-d6e8cf005f3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:58.032067 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:58.041915 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef2be8-3548-4da9-9c2a-d6e8cf005f3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:58.043680 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef2be8-3548-4da9-9c2a-d6e8cf005f3d None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:58.137146 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 574/1164] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:16:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 19:16:58.143006 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237cc2e9-ca47-49a6-afc1-50e51f8b2f80 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:58.238782 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237cc2e9-ca47-49a6-afc1-50e51f8b2f80 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:58.266175 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:58.272335 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e72fcc-1016-4130-b44a-307c060b0453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:58.273117 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e72fcc-1016-4130-b44a-307c060b0453 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:58.277909 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e72fcc-1016-4130-b44a-307c060b0453 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:58.277909 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e72fcc-1016-4130-b44a-307c060b0453 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:58.280197 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e72fcc-1016-4130-b44a-307c060b0453 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:58.281623 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e72fcc-1016-4130-b44a-307c060b0453 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:58.295783 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-95e72fcc-1016-4130-b44a-307c060b0453 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 21 19:16:58.295783 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:58.295783 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 21 19:16:58.295783 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 21 19:16:58.295783 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 19:16:58.295783 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 19:16:58.295783 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 19:16:58.295783 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 19:16:58.295783 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 21 19:16:58.295783 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:58.295783 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 19:16:58.295783 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:58.295783 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:16:58.295783 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:16:58.295783 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:16:58.295783 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:16:58.295783 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:16:58.296882 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:16:58.296882 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:16:58.296882 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:16:58.296882 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:16:58.296882 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:16:58.296882 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:16:58.296882 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:16:58.296882 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:16:58.296882 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:16:58.296882 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:16:58.296882 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:16:58.296882 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:16:58.296882 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:16:58.296882 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:16:58.296882 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:16:58.296882 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:16:58.297739 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:16:58.297739 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:16:58.297739 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:16:58.297739 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:16:58.297739 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:16:58.297739 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:16:58.297739 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:16:58.297739 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:16:58.297739 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:16:58.297739 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:16:58.297739 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 21 19:16:58.297739 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:16:58.297739 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 21 19:16:58.297739 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:16:58.298497 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 591/1165] 10.222.0.60 () {56 vars in 1117 bytes} [Thu Jul 21 19:16:58 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:16:58.302893 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef2be8-3548-4da9-9c2a-d6e8cf005f3d None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:16:58.389227 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:16:58.398479 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef2be8-3548-4da9-9c2a-d6e8cf005f3d None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:16:58.432283 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df31c39b-3fec-48ae-9c68-4e11af333fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:16:58.432947 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31c39b-3fec-48ae-9c68-4e11af333fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:16:58.433233 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31c39b-3fec-48ae-9c68-4e11af333fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:16:58.433518 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31c39b-3fec-48ae-9c68-4e11af333fe1 None admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:16:58.434235 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df31c39b-3fec-48ae-9c68-4e11af333fe1 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:16:58.434550 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df31c39b-3fec-48ae-9c68-4e11af333fe1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:16:58.435953 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df31c39b-3fec-48ae-9c68-4e11af333fe1 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:16:58.443642 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 575/1166] 10.222.0.60 () {56 vars in 1115 bytes} [Thu Jul 21 19:16:58 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:17:00.497805 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a8054-c51f-4b0e-8c45-044f05a13463 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:17:00.498331 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a8054-c51f-4b0e-8c45-044f05a13463 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:17:00.498433 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a8054-c51f-4b0e-8c45-044f05a13463 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:17:00.499836 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 592/1167] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:17:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:17:00.505462 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685273a6-a6b5-46cf-b143-db6e96302ce4 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:17:00.505905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685273a6-a6b5-46cf-b143-db6e96302ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:17:00.506046 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685273a6-a6b5-46cf-b143-db6e96302ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:17:00.522862 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-685273a6-a6b5-46cf-b143-db6e96302ce4 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:17:00.524067 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-685273a6-a6b5-46cf-b143-db6e96302ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:17:00.587563 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 576/1168] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:17:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:17:00.609748 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a8054-c51f-4b0e-8c45-044f05a13463 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:17:00.708659 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a8054-c51f-4b0e-8c45-044f05a13463 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:17:00.740884 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e4eb9-590d-41d9-926d-afcbe55876de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:17:00.741516 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e4eb9-590d-41d9-926d-afcbe55876de None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:17:00.741799 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e4eb9-590d-41d9-926d-afcbe55876de None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:17:00.742071 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e4eb9-590d-41d9-926d-afcbe55876de None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:17:00.742802 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e4eb9-590d-41d9-926d-afcbe55876de None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:17:00.744179 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e4eb9-590d-41d9-926d-afcbe55876de None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:17:00.835549 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 593/1169] 10.222.0.60 () {60 vars in 1138 bytes} [Thu Jul 21 19:17:00 2022] POST /identity/v3/domains => generated 267 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:17:02.859487 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796926cd-3cfd-44f5-87b5-651af1860a66 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:17:02.860014 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796926cd-3cfd-44f5-87b5-651af1860a66 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:17:02.860014 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796926cd-3cfd-44f5-87b5-651af1860a66 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:17:02.861336 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 577/1170] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:17:02.867178 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98efff7-09e5-4bd0-985b-96fbe603e1ae None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:17:02.867642 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98efff7-09e5-4bd0-985b-96fbe603e1ae None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:17:02.867742 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98efff7-09e5-4bd0-985b-96fbe603e1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:17:02.884251 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-f98efff7-09e5-4bd0-985b-96fbe603e1ae None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:17:02.885540 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f98efff7-09e5-4bd0-985b-96fbe603e1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:17:02.931441 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:17:02.951694 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 594/1171] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:17:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:17:02.975685 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796926cd-3cfd-44f5-87b5-651af1860a66 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:17:03.057967 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:17:03.073801 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796926cd-3cfd-44f5-87b5-651af1860a66 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:17:03.109019 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157de2a7-b898-4d9d-a410-29c88e13b44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:17:03.109923 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157de2a7-b898-4d9d-a410-29c88e13b44e None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:17:03.110160 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157de2a7-b898-4d9d-a410-29c88e13b44e None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:17:03.110436 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157de2a7-b898-4d9d-a410-29c88e13b44e None admin] PATH_INFO: `/v3/domains/0c39856808e9438a8979e99c565e7953` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:17:03.125019 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157de2a7-b898-4d9d-a410-29c88e13b44e None admin] RBAC: Authorizing `identity:get_domain(domain_id=0c39856808e9438a8979e99c565e7953)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:17:03.126467 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157de2a7-b898-4d9d-a410-29c88e13b44e None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:17:03.128531 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 578/1172] 10.222.0.60 () {56 vars in 1183 bytes} [Thu Jul 21 19:17:02 2022] GET /identity/v3/domains/0c39856808e9438a8979e99c565e7953 => generated 267 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:17:03.134463 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98efff7-09e5-4bd0-985b-96fbe603e1ae None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:17:03.233482 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98efff7-09e5-4bd0-985b-96fbe603e1ae None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:17:03.267390 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22057eaf-dcf4-4231-b73b-5321ceec2c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:17:03.268812 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22057eaf-dcf4-4231-b73b-5321ceec2c1e None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:17:03.269191 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22057eaf-dcf4-4231-b73b-5321ceec2c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:17:03.269477 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22057eaf-dcf4-4231-b73b-5321ceec2c1e None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:17:03.270236 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22057eaf-dcf4-4231-b73b-5321ceec2c1e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:17:03.271694 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22057eaf-dcf4-4231-b73b-5321ceec2c1e None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:17:03.350952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 595/1173] 10.222.0.60 () {60 vars in 1141 bytes} [Thu Jul 21 19:17:03 2022] POST /identity/v3/projects => generated 361 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:17:05.397146 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d8316-d69b-4b1c-b2b8-49a7aa279544 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:17:05.397674 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d8316-d69b-4b1c-b2b8-49a7aa279544 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:17:05.397768 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d8316-d69b-4b1c-b2b8-49a7aa279544 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:17:05.399051 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 579/1174] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:17:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:17:05.404274 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ba3ad-ac28-4034-8bc8-316ba36cb3e4 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:17:05.404687 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ba3ad-ac28-4034-8bc8-316ba36cb3e4 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:17:05.404841 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ba3ad-ac28-4034-8bc8-316ba36cb3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:17:05.421829 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-721ba3ad-ac28-4034-8bc8-316ba36cb3e4 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:17:05.423015 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-721ba3ad-ac28-4034-8bc8-316ba36cb3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:17:05.449763 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:17:05.490242 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 596/1175] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:17:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:17:05.515590 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d8316-d69b-4b1c-b2b8-49a7aa279544 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:17:05.614511 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d8316-d69b-4b1c-b2b8-49a7aa279544 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:17:05.647401 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111c41d-0133-498b-8996-5d927fc25b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:17:05.648225 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111c41d-0133-498b-8996-5d927fc25b86 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:17:05.648511 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111c41d-0133-498b-8996-5d927fc25b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:17:05.648787 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111c41d-0133-498b-8996-5d927fc25b86 None admin] PATH_INFO: `/v3/domains/0c39856808e9438a8979e99c565e7953` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:17:05.649956 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c111c41d-0133-498b-8996-5d927fc25b86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=0c39856808e9438a8979e99c565e7953)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:17:05.651391 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c111c41d-0133-498b-8996-5d927fc25b86 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:17:05.653004 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 580/1176] 10.222.0.60 () {56 vars in 1183 bytes} [Thu Jul 21 19:17:05 2022] GET /identity/v3/domains/0c39856808e9438a8979e99c565e7953 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:17:05.658721 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ba3ad-ac28-4034-8bc8-316ba36cb3e4 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:17:05.754145 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ba3ad-ac28-4034-8bc8-316ba36cb3e4 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:17:05.786743 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6cdbcd-a580-45c5-b208-5878fdff7489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:17:05.787391 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6cdbcd-a580-45c5-b208-5878fdff7489 None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:17:05.787702 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6cdbcd-a580-45c5-b208-5878fdff7489 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:17:05.787979 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6cdbcd-a580-45c5-b208-5878fdff7489 None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:17:05.788686 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6cdbcd-a580-45c5-b208-5878fdff7489 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:17:05.790108 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6cdbcd-a580-45c5-b208-5878fdff7489 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:17:05.870106 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 597/1177] 10.222.0.60 () {60 vars in 1132 bytes} [Thu Jul 21 19:17:05 2022] POST /identity/v3/users => generated 311 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:17:07.935053 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240fd4e-1890-4ce4-ab08-1888f35d56d6 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:17:07.935623 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240fd4e-1890-4ce4-ab08-1888f35d56d6 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:17:07.935742 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240fd4e-1890-4ce4-ab08-1888f35d56d6 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:17:07.937023 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 581/1178] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:17:07.942169 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d029c5-3e10-44b5-aa21-da903e59015d None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:17:07.942544 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d029c5-3e10-44b5-aa21-da903e59015d None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:17:07.942729 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d029c5-3e10-44b5-aa21-da903e59015d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:17:07.959044 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-09d029c5-3e10-44b5-aa21-da903e59015d None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:17:07.960258 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-09d029c5-3e10-44b5-aa21-da903e59015d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:17:07.973688 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:17:08.025780 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 598/1179] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:17:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:17:08.050006 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240fd4e-1890-4ce4-ab08-1888f35d56d6 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:17:08.064700 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:17:08.147989 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240fd4e-1890-4ce4-ab08-1888f35d56d6 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:17:08.180530 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add96681-283d-48f8-af01-0b75f3ae7c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:17:08.181305 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add96681-283d-48f8-af01-0b75f3ae7c75 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:17:08.181592 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add96681-283d-48f8-af01-0b75f3ae7c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:17:08.181869 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add96681-283d-48f8-af01-0b75f3ae7c75 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:17:08.191762 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add96681-283d-48f8-af01-0b75f3ae7c75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:17:08.199243 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-add96681-283d-48f8-af01-0b75f3ae7c75 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:17:08.199243 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:17:08.199243 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:17:08.199243 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:17:08.199243 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:17:08.199243 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:17:08.199243 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:17:08.199243 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:17:08.199243 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:17:08.199243 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:17:08.199243 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:17:08.199243 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:17:08.199243 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:17:08.199243 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:17:08.199243 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:17:08.199243 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:17:08.200632 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:17:08.200632 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:17:08.200632 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:17:08.200632 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:17:08.200632 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:17:08.200632 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:17:08.200632 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:17:08.200632 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:17:08.200632 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:17:08.200632 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:17:08.200632 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:17:08.200632 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:17:08.200632 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:17:08.200632 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:17:08.200632 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:17:08.200632 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:17:08.201865 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:17:08.201865 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:17:08.201865 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:17:08.201865 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:17:08.201865 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:17:08.201865 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:17:08.201865 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:17:08.201865 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:17:08.201865 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:17:08.201865 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:17:08.201865 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:17:08.201865 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:17:08.201865 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 582/1180] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Jul 21 19:17:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:17:08.206888 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d029c5-3e10-44b5-aa21-da903e59015d None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:17:08.304216 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d029c5-3e10-44b5-aa21-da903e59015d None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:17:08.345747 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e677f2ca-abf8-449d-88ae-c2bcdcb208df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:17:08.347050 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677f2ca-abf8-449d-88ae-c2bcdcb208df None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:17:08.347342 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677f2ca-abf8-449d-88ae-c2bcdcb208df None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:17:08.347660 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677f2ca-abf8-449d-88ae-c2bcdcb208df None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:17:08.348419 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e677f2ca-abf8-449d-88ae-c2bcdcb208df None admin] RBAC: Adding query filter params (name=admin) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:17:08.348734 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e677f2ca-abf8-449d-88ae-c2bcdcb208df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:17:08.350116 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e677f2ca-abf8-449d-88ae-c2bcdcb208df None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:17:08.358221 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 599/1181] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:17:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:17:08.364119 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add96681-283d-48f8-af01-0b75f3ae7c75 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:17:08.433325 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:17:08.462695 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add96681-283d-48f8-af01-0b75f3ae7c75 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:17:08.495914 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b85feb-0077-431a-a12b-09453a5a515a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:17:08.496779 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b85feb-0077-431a-a12b-09453a5a515a None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:17:08.497066 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b85feb-0077-431a-a12b-09453a5a515a None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:17:08.497346 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b85feb-0077-431a-a12b-09453a5a515a None admin] PATH_INFO: `/v3/users/556435bd4df942b9971ed74453627b1d` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:17:08.510495 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b85feb-0077-431a-a12b-09453a5a515a None admin] RBAC: Authorizing `identity:get_user(user_id=556435bd4df942b9971ed74453627b1d)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:17:08.511975 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b85feb-0077-431a-a12b-09453a5a515a None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:17:08.513602 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 583/1182] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:17:08 2022] GET /identity/v3/users/556435bd4df942b9971ed74453627b1d => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:17:08.520186 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e677f2ca-abf8-449d-88ae-c2bcdcb208df None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:17:08.532614 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:17:08.617340 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e677f2ca-abf8-449d-88ae-c2bcdcb208df None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:17:08.650578 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ea4f3-d5a9-4d03-82fe-1cbf9b2df2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:17:08.651205 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ea4f3-d5a9-4d03-82fe-1cbf9b2df2f2 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:17:08.651513 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ea4f3-d5a9-4d03-82fe-1cbf9b2df2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:17:08.651794 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ea4f3-d5a9-4d03-82fe-1cbf9b2df2f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:17:08.716526 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83ea4f3-d5a9-4d03-82fe-1cbf9b2df2f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:17:08.717894 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83ea4f3-d5a9-4d03-82fe-1cbf9b2df2f2 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:17:08.728442 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:17:08.813977 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 600/1183] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:17:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 19:17:08.819933 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b85feb-0077-431a-a12b-09453a5a515a None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:17:08.915848 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b85feb-0077-431a-a12b-09453a5a515a None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:17:08.942481 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:17:08.947963 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34575be5-4761-4c26-817c-56ddeb6d32f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:17:08.948804 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34575be5-4761-4c26-817c-56ddeb6d32f6 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:17:08.949083 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34575be5-4761-4c26-817c-56ddeb6d32f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:17:08.949353 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34575be5-4761-4c26-817c-56ddeb6d32f6 None admin] PATH_INFO: `/v3/projects/ebe8dadd06ad440db5d7ded03e8f4ecd` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:17:08.950496 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34575be5-4761-4c26-817c-56ddeb6d32f6 None admin] RBAC: Authorizing `identity:get_project(project_id=ebe8dadd06ad440db5d7ded03e8f4ecd)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:17:08.951944 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34575be5-4761-4c26-817c-56ddeb6d32f6 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:17:08.953595 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 584/1184] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:17:08 2022] GET /identity/v3/projects/ebe8dadd06ad440db5d7ded03e8f4ecd => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:17:08.960229 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ea4f3-d5a9-4d03-82fe-1cbf9b2df2f2 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:17:09.059632 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ea4f3-d5a9-4d03-82fe-1cbf9b2df2f2 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:17:09.069836 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:17:09.092539 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd41efa8-9066-4239-9ad5-3ae80d04c0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:17:09.093185 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41efa8-9066-4239-9ad5-3ae80d04c0cc None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:17:09.093471 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41efa8-9066-4239-9ad5-3ae80d04c0cc None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:17:09.093750 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41efa8-9066-4239-9ad5-3ae80d04c0cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:17:09.094571 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd41efa8-9066-4239-9ad5-3ae80d04c0cc None admin] RBAC: Adding query filter params (role.id=685e18230e1744c581baaf842d0fd4ca, scope.project.id=ebe8dadd06ad440db5d7ded03e8f4ecd, user.id=556435bd4df942b9971ed74453627b1d) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:17:09.094886 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd41efa8-9066-4239-9ad5-3ae80d04c0cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:17:09.096934 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd41efa8-9066-4239-9ad5-3ae80d04c0cc None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:17:09.102476 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 601/1185] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:17:08 2022] GET /identity/v3/role_assignments?user.id=556435bd4df942b9971ed74453627b1d&scope.project.id=ebe8dadd06ad440db5d7ded03e8f4ecd&role.id=685e18230e1744c581baaf842d0fd4ca => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:17:11.103491 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48775d8-1713-455d-a834-9442e6cb0f42 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:17:11.104044 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48775d8-1713-455d-a834-9442e6cb0f42 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:17:11.104044 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48775d8-1713-455d-a834-9442e6cb0f42 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:17:11.105395 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 585/1186] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:17:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:17:11.110686 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a8d61-53ac-4239-a287-9c4df066edad None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:17:11.111078 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a8d61-53ac-4239-a287-9c4df066edad None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:17:11.111242 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a8d61-53ac-4239-a287-9c4df066edad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:17:11.128431 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-5b6a8d61-53ac-4239-a287-9c4df066edad None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:17:11.129600 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-5b6a8d61-53ac-4239-a287-9c4df066edad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:17:11.194416 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 602/1187] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:17:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:17:11.217152 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48775d8-1713-455d-a834-9442e6cb0f42 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:17:11.313897 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48775d8-1713-455d-a834-9442e6cb0f42 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:17:11.347058 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6ec68-45e2-4958-baa8-61d961709aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:17:11.347858 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6ec68-45e2-4958-baa8-61d961709aef None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:17:11.348142 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6ec68-45e2-4958-baa8-61d961709aef None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:17:11.348414 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6ec68-45e2-4958-baa8-61d961709aef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:17:11.358025 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6ec68-45e2-4958-baa8-61d961709aef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:17:11.365553 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-88a6ec68-45e2-4958-baa8-61d961709aef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:17:11.365553 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:17:11.365553 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:17:11.365553 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:17:11.365553 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:17:11.365553 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:17:11.365553 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:17:11.365553 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:17:11.365553 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:17:11.365553 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:17:11.365553 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:17:11.365553 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:17:11.365553 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:17:11.365553 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:17:11.365553 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:17:11.365553 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:17:11.366656 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:17:11.366656 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:17:11.366656 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:17:11.366656 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:17:11.366656 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:17:11.366656 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:17:11.366656 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:17:11.366656 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:17:11.366656 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:17:11.366656 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:17:11.366656 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:17:11.366656 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:17:11.366656 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:17:11.366656 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:17:11.366656 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:17:11.366656 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:17:11.367567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:17:11.367567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:17:11.367567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:17:11.367567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:17:11.367567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:17:11.367567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:17:11.367567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:17:11.367567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:17:11.367567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:17:11.367567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:17:11.367567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:17:11.367567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:17:11.367567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 586/1188] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Jul 21 19:17:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:17:11.372584 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a8d61-53ac-4239-a287-9c4df066edad None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:17:11.471464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a8d61-53ac-4239-a287-9c4df066edad None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:17:11.473809 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:17:11.504598 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc03f4-fd50-41fa-8701-5e745fadf721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:17:11.505257 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc03f4-fd50-41fa-8701-5e745fadf721 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:17:11.505539 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc03f4-fd50-41fa-8701-5e745fadf721 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:17:11.505815 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc03f4-fd50-41fa-8701-5e745fadf721 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:17:11.506554 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc03f4-fd50-41fa-8701-5e745fadf721 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:17:11.506862 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc03f4-fd50-41fa-8701-5e745fadf721 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:17:11.508255 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc03f4-fd50-41fa-8701-5e745fadf721 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:17:11.516084 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 603/1189] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:17:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:17:11.522746 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6ec68-45e2-4958-baa8-61d961709aef None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:17:11.579051 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:17:11.620118 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6ec68-45e2-4958-baa8-61d961709aef None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:17:11.652950 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa440535-026d-48fd-8f7c-187190fa400b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:17:11.653807 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa440535-026d-48fd-8f7c-187190fa400b None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:17:11.654092 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa440535-026d-48fd-8f7c-187190fa400b None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:17:11.654369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa440535-026d-48fd-8f7c-187190fa400b None admin] PATH_INFO: `/v3/users/556435bd4df942b9971ed74453627b1d` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:17:11.655561 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa440535-026d-48fd-8f7c-187190fa400b None admin] RBAC: Authorizing `identity:get_user(user_id=556435bd4df942b9971ed74453627b1d)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:17:11.656988 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa440535-026d-48fd-8f7c-187190fa400b None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:17:11.658620 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 587/1190] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:17:11 2022] GET /identity/v3/users/556435bd4df942b9971ed74453627b1d => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:17:11.664401 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc03f4-fd50-41fa-8701-5e745fadf721 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:17:11.761521 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc03f4-fd50-41fa-8701-5e745fadf721 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:17:11.794208 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53fa1b7-b8b1-459d-b3d2-7650d22d28b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:17:11.795053 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fa1b7-b8b1-459d-b3d2-7650d22d28b8 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:17:11.795333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fa1b7-b8b1-459d-b3d2-7650d22d28b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:17:11.795639 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fa1b7-b8b1-459d-b3d2-7650d22d28b8 None admin] PATH_INFO: `/v3/projects/ebe8dadd06ad440db5d7ded03e8f4ecd` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:17:11.796793 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53fa1b7-b8b1-459d-b3d2-7650d22d28b8 None admin] RBAC: Authorizing `identity:get_project(project_id=ebe8dadd06ad440db5d7ded03e8f4ecd)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:17:11.798209 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53fa1b7-b8b1-459d-b3d2-7650d22d28b8 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:17:11.800200 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 604/1191] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:17:11 2022] GET /identity/v3/projects/ebe8dadd06ad440db5d7ded03e8f4ecd => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:17:11.806329 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa440535-026d-48fd-8f7c-187190fa400b None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:17:11.902833 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa440535-026d-48fd-8f7c-187190fa400b None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:17:11.926928 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:17:11.935462 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf3bad-3007-49c6-9ffe-d8da79f75780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:17:11.938002 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf3bad-3007-49c6-9ffe-d8da79f75780 None admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:17:11.938002 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf3bad-3007-49c6-9ffe-d8da79f75780 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:17:11.938002 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf3bad-3007-49c6-9ffe-d8da79f75780 None admin] PATH_INFO: `/v3/projects/ebe8dadd06ad440db5d7ded03e8f4ecd/users/556435bd4df942b9971ed74453627b1d/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:17:11.938871 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf3bad-3007-49c6-9ffe-d8da79f75780 None admin] RBAC: Authorizing `identity:create_grant(project_id=ebe8dadd06ad440db5d7ded03e8f4ecd, user_id=556435bd4df942b9971ed74453627b1d, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:17:11.940917 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf3bad-3007-49c6-9ffe-d8da79f75780 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:17:12.012487 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 588/1192] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Jul 21 19:17:11 2022] PUT /identity/v3/projects/ebe8dadd06ad440db5d7ded03e8f4ecd/users/556435bd4df942b9971ed74453627b1d/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:17:13.995325 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831eda74-7bf4-488a-be3c-654ae3e2f407 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:17:13.995907 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831eda74-7bf4-488a-be3c-654ae3e2f407 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:17:13.995907 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831eda74-7bf4-488a-be3c-654ae3e2f407 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:17:13.997288 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 605/1193] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:17:14.003200 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf61645-6034-4b29-bc85-5d4513b8f3b4 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:17:14.003605 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf61645-6034-4b29-bc85-5d4513b8f3b4 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:17:14.003795 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf61645-6034-4b29-bc85-5d4513b8f3b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:17:14.020581 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-8cf61645-6034-4b29-bc85-5d4513b8f3b4 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:17:14.021759 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-8cf61645-6034-4b29-bc85-5d4513b8f3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:17:14.087180 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 589/1194] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:17:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:17:14.110249 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831eda74-7bf4-488a-be3c-654ae3e2f407 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:17:14.146019 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:17:14.211344 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831eda74-7bf4-488a-be3c-654ae3e2f407 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:17:14.243974 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884d71d-bfef-444a-a833-944baa924f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:17:14.244755 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884d71d-bfef-444a-a833-944baa924f9d None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:17:14.245038 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884d71d-bfef-444a-a833-944baa924f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:17:14.245315 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884d71d-bfef-444a-a833-944baa924f9d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:17:14.256258 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b884d71d-bfef-444a-a833-944baa924f9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:17:14.263675 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-b884d71d-bfef-444a-a833-944baa924f9d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:17:14.263675 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:17:14.263675 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:17:14.263675 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:17:14.263675 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:17:14.263675 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:17:14.263675 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:17:14.263675 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:17:14.263675 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:17:14.263675 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:17:14.263675 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:17:14.263675 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:17:14.263675 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:17:14.263675 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:17:14.263675 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:17:14.263675 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:17:14.264775 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:17:14.264775 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:17:14.264775 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:17:14.264775 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:17:14.264775 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:17:14.264775 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:17:14.264775 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:17:14.264775 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:17:14.264775 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:17:14.264775 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:17:14.264775 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:17:14.264775 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:17:14.264775 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:17:14.264775 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:17:14.264775 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:17:14.264775 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:17:14.265902 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:17:14.265902 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:17:14.265902 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:17:14.265902 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:17:14.265902 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:17:14.265902 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:17:14.265902 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:17:14.265902 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:17:14.265902 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:17:14.265902 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:17:14.265902 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:17:14.265902 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:17:14.265902 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 606/1195] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Jul 21 19:17:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:17:14.270831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf61645-6034-4b29-bc85-5d4513b8f3b4 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:17:14.365670 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf61645-6034-4b29-bc85-5d4513b8f3b4 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:17:14.381569 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:17:14.398323 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5db34-8d8c-400b-b617-7b2600571fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:17:14.398975 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5db34-8d8c-400b-b617-7b2600571fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:17:14.399257 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5db34-8d8c-400b-b617-7b2600571fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:17:14.399560 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5db34-8d8c-400b-b617-7b2600571fa0 None admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:17:14.400359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba5db34-8d8c-400b-b617-7b2600571fa0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:17:14.400663 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba5db34-8d8c-400b-b617-7b2600571fa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:17:14.402006 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba5db34-8d8c-400b-b617-7b2600571fa0 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:17:14.409832 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 590/1196] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:17:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:17:14.415583 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884d71d-bfef-444a-a833-944baa924f9d None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:17:14.507250 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:17:14.513539 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884d71d-bfef-444a-a833-944baa924f9d None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:17:14.547144 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529cd634-0a18-4cc6-8100-794085d1395d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:17:14.548022 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529cd634-0a18-4cc6-8100-794085d1395d None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:17:14.548303 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529cd634-0a18-4cc6-8100-794085d1395d None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:17:14.548578 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529cd634-0a18-4cc6-8100-794085d1395d None admin] PATH_INFO: `/v3/users/556435bd4df942b9971ed74453627b1d` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:17:14.550492 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529cd634-0a18-4cc6-8100-794085d1395d None admin] RBAC: Authorizing `identity:get_user(user_id=556435bd4df942b9971ed74453627b1d)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:17:14.551976 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529cd634-0a18-4cc6-8100-794085d1395d None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:17:14.553837 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 607/1197] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Jul 21 19:17:14 2022] GET /identity/v3/users/556435bd4df942b9971ed74453627b1d => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:17:14.559618 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5db34-8d8c-400b-b617-7b2600571fa0 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:17:14.653960 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5db34-8d8c-400b-b617-7b2600571fa0 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:17:14.686848 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa41bf-2b8a-4e35-ad47-d551a1ab4d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:17:14.687506 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa41bf-2b8a-4e35-ad47-d551a1ab4d5a None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:17:14.687792 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa41bf-2b8a-4e35-ad47-d551a1ab4d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:17:14.688069 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa41bf-2b8a-4e35-ad47-d551a1ab4d5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:17:14.730982 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:17:14.752047 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aa41bf-2b8a-4e35-ad47-d551a1ab4d5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:17:14.753482 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aa41bf-2b8a-4e35-ad47-d551a1ab4d5a None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:17:14.848574 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 591/1198] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:17:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 19:17:14.854290 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529cd634-0a18-4cc6-8100-794085d1395d None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:17:14.954657 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529cd634-0a18-4cc6-8100-794085d1395d None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:17:14.989111 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ec7b2-13c1-4329-b7fa-4714645abd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:17:14.989957 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ec7b2-13c1-4329-b7fa-4714645abd6f None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:17:14.990242 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ec7b2-13c1-4329-b7fa-4714645abd6f None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:17:14.990520 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ec7b2-13c1-4329-b7fa-4714645abd6f None admin] PATH_INFO: `/v3/projects/ebe8dadd06ad440db5d7ded03e8f4ecd` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:17:14.991714 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ec7b2-13c1-4329-b7fa-4714645abd6f None admin] RBAC: Authorizing `identity:get_project(project_id=ebe8dadd06ad440db5d7ded03e8f4ecd)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:17:14.993146 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ec7b2-13c1-4329-b7fa-4714645abd6f None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:17:14.994825 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 608/1199] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Jul 21 19:17:14 2022] GET /identity/v3/projects/ebe8dadd06ad440db5d7ded03e8f4ecd => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:17:15.000867 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa41bf-2b8a-4e35-ad47-d551a1ab4d5a None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:17:15.076133 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:17:15.098002 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa41bf-2b8a-4e35-ad47-d551a1ab4d5a None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:17:15.130730 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c0e04c-8a98-47dd-b1ca-2c97a4d3beb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:17:15.131320 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0e04c-8a98-47dd-b1ca-2c97a4d3beb6 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:17:15.131766 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0e04c-8a98-47dd-b1ca-2c97a4d3beb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:17:15.132048 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0e04c-8a98-47dd-b1ca-2c97a4d3beb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:17:15.132870 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c0e04c-8a98-47dd-b1ca-2c97a4d3beb6 None admin] RBAC: Adding query filter params (role.id=685e18230e1744c581baaf842d0fd4ca, scope.project.id=ebe8dadd06ad440db5d7ded03e8f4ecd, user.id=556435bd4df942b9971ed74453627b1d) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:17:15.133185 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c0e04c-8a98-47dd-b1ca-2c97a4d3beb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:17:15.134604 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c0e04c-8a98-47dd-b1ca-2c97a4d3beb6 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:17:15.140214 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 592/1200] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:17:14 2022] GET /identity/v3/role_assignments?user.id=556435bd4df942b9971ed74453627b1d&scope.project.id=ebe8dadd06ad440db5d7ded03e8f4ecd&role.id=685e18230e1744c581baaf842d0fd4ca => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:17:24.984859 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=85 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:17:25.137599 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=29 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:27.793236 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f5e69-87f9-4ce6-9ff0-8c807bc1cb70 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:27.793826 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f5e69-87f9-4ce6-9ff0-8c807bc1cb70 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:27.793826 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f5e69-87f9-4ce6-9ff0-8c807bc1cb70 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:27.795171 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 609/1201] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:18:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:18:27.800486 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72740533-b557-42ff-958a-531fbd04464c None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:27.800940 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72740533-b557-42ff-958a-531fbd04464c None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:27.801051 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72740533-b557-42ff-958a-531fbd04464c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:27.818206 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-72740533-b557-42ff-958a-531fbd04464c None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:18:27.819384 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-72740533-b557-42ff-958a-531fbd04464c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:18:27.884388 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 593/1202] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:18:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:18:27.910248 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f5e69-87f9-4ce6-9ff0-8c807bc1cb70 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:28.011482 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f5e69-87f9-4ce6-9ff0-8c807bc1cb70 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:28.050187 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52d6a4-cbf5-4fae-b1e8-418b19795d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:28.050187 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52d6a4-cbf5-4fae-b1e8-418b19795d53 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:28.050187 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52d6a4-cbf5-4fae-b1e8-418b19795d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:28.050187 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52d6a4-cbf5-4fae-b1e8-418b19795d53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:28.056172 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e52d6a4-cbf5-4fae-b1e8-418b19795d53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:28.057658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e52d6a4-cbf5-4fae-b1e8-418b19795d53 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:28.075268 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-0e52d6a4-cbf5-4fae-b1e8-418b19795d53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:18:28.075268 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:18:28.075268 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:18:28.075268 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:18:28.075268 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:18:28.075268 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:18:28.075268 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:18:28.075268 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:18:28.075268 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:18:28.075268 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:18:28.075268 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:18:28.075268 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:18:28.075268 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:18:28.075268 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:18:28.075268 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:18:28.080204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:18:28.080204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:18:28.080204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:18:28.080204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:18:28.080204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:18:28.080204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:18:28.080204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:18:28.080204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:18:28.080204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:18:28.080204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:18:28.080204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:18:28.080204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:18:28.080204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:18:28.080204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:18:28.080204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:18:28.080204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:18:28.080204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:18:28.081421 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:18:28.081421 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:18:28.081421 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:18:28.081421 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:18:28.081421 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 610/1203] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:18:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:18:28.083487 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72740533-b557-42ff-958a-531fbd04464c None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:28.178361 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72740533-b557-42ff-958a-531fbd04464c None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:28.207177 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:28.212722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6b570-75cd-4204-a1bf-916decb26d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:28.213391 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6b570-75cd-4204-a1bf-916decb26d58 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:28.213679 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6b570-75cd-4204-a1bf-916decb26d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:28.213958 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6b570-75cd-4204-a1bf-916decb26d58 None admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:28.214685 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e6b570-75cd-4204-a1bf-916decb26d58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:18:28.214995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e6b570-75cd-4204-a1bf-916decb26d58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:28.216426 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e6b570-75cd-4204-a1bf-916decb26d58 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:28.227934 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 594/1204] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:18:28.233584 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52d6a4-cbf5-4fae-b1e8-418b19795d53 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:28.287605 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:28.334842 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52d6a4-cbf5-4fae-b1e8-418b19795d53 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:28.368721 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246be19-5f18-4e7e-998f-dc7229f9a5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:28.369386 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246be19-5f18-4e7e-998f-dc7229f9a5c4 None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:28.369688 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246be19-5f18-4e7e-998f-dc7229f9a5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:28.369964 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246be19-5f18-4e7e-998f-dc7229f9a5c4 None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:28.370670 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0246be19-5f18-4e7e-998f-dc7229f9a5c4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:28.372197 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0246be19-5f18-4e7e-998f-dc7229f9a5c4 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:28.514359 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 611/1205] 10.222.0.60 () {60 vars in 1132 bytes} [Thu Jul 21 19:18:28 2022] POST /identity/v3/users => generated 251 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:18:30.581731 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b15a3-9192-41e6-a33a-2392efe02b9c None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:30.582272 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b15a3-9192-41e6-a33a-2392efe02b9c None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:30.582272 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b15a3-9192-41e6-a33a-2392efe02b9c None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:30.583684 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 595/1206] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:18:30.589063 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39a291-c630-4434-9046-2846915ba4c0 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:30.589470 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39a291-c630-4434-9046-2846915ba4c0 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:30.589621 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39a291-c630-4434-9046-2846915ba4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:30.606713 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-4c39a291-c630-4434-9046-2846915ba4c0 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:18:30.607922 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-4c39a291-c630-4434-9046-2846915ba4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:18:30.673991 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 612/1207] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:18:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:18:30.701827 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b15a3-9192-41e6-a33a-2392efe02b9c None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:30.798259 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b15a3-9192-41e6-a33a-2392efe02b9c None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:30.831129 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73379169-69d9-4278-862e-9ecb9d765df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:30.831942 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73379169-69d9-4278-862e-9ecb9d765df5 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:30.832225 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73379169-69d9-4278-862e-9ecb9d765df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:30.832498 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73379169-69d9-4278-862e-9ecb9d765df5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:30.842464 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73379169-69d9-4278-862e-9ecb9d765df5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:18:30.850641 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-73379169-69d9-4278-862e-9ecb9d765df5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 19:18:30.850641 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:18:30.850641 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:18:30.850641 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:18:30.850641 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:18:30.850641 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:18:30.850641 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:18:30.850641 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:18:30.850641 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:18:30.850641 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:18:30.850641 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:18:30.850641 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:18:30.850641 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:18:30.850641 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:18:30.850641 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:18:30.850641 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:18:30.853220 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:18:30.853220 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:18:30.853220 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:18:30.853220 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:18:30.853220 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:18:30.853220 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:18:30.853220 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:18:30.853220 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:18:30.853220 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:18:30.853220 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:18:30.853220 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:18:30.853220 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:18:30.853220 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:18:30.853220 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:18:30.853220 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:18:30.853220 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:18:30.854272 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:18:30.854272 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:18:30.854272 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:18:30.854272 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:18:30.854272 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:18:30.854272 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:18:30.854272 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:18:30.854272 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:18:30.854272 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:18:30.854272 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:18:30.854272 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 19:18:30.854272 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:18:30.854272 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 596/1208] 10.222.0.60 () {56 vars in 1102 bytes} [Thu Jul 21 19:18:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:18:30.858045 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39a291-c630-4434-9046-2846915ba4c0 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:30.897265 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:30.958796 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39a291-c630-4434-9046-2846915ba4c0 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:30.993625 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3eedf8-f807-4194-a6cf-6cef5bfd30c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:30.994332 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3eedf8-f807-4194-a6cf-6cef5bfd30c5 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:30.994619 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3eedf8-f807-4194-a6cf-6cef5bfd30c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:30.994900 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3eedf8-f807-4194-a6cf-6cef5bfd30c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:30.995673 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3eedf8-f807-4194-a6cf-6cef5bfd30c5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:18:30.995986 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3eedf8-f807-4194-a6cf-6cef5bfd30c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:30.997415 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3eedf8-f807-4194-a6cf-6cef5bfd30c5 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:31.005966 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 613/1209] 10.222.0.60 () {56 vars in 1103 bytes} [Thu Jul 21 19:18:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:18:31.011758 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73379169-69d9-4278-862e-9ecb9d765df5 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:31.061300 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:31.109279 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73379169-69d9-4278-862e-9ecb9d765df5 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:31.141952 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6882b795-0f7a-42da-b7d1-458f0d591f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:31.142730 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882b795-0f7a-42da-b7d1-458f0d591f4d None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:31.143015 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882b795-0f7a-42da-b7d1-458f0d591f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:31.143288 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882b795-0f7a-42da-b7d1-458f0d591f4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:31.152913 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6882b795-0f7a-42da-b7d1-458f0d591f4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:31.157769 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6882b795-0f7a-42da-b7d1-458f0d591f4d None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:31.171520 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-6882b795-0f7a-42da-b7d1-458f0d591f4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:18:31.171520 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:18:31.171520 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:18:31.171520 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:18:31.171520 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:18:31.171520 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:18:31.171520 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:18:31.171520 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:18:31.171520 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:18:31.171520 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:18:31.171520 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:18:31.171520 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:18:31.171520 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:18:31.171520 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:18:31.171520 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:18:31.172980 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:18:31.172980 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:18:31.172980 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:18:31.172980 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:18:31.172980 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:18:31.172980 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:18:31.172980 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:18:31.172980 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:18:31.172980 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:18:31.172980 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:18:31.172980 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:18:31.172980 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:18:31.172980 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:18:31.172980 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:18:31.172980 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:18:31.172980 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:18:31.172980 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:18:31.174223 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:18:31.174223 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:18:31.174223 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:18:31.174223 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:18:31.174223 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 597/1210] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:18:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:18:31.178641 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3eedf8-f807-4194-a6cf-6cef5bfd30c5 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:31.277984 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:31.280845 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3eedf8-f807-4194-a6cf-6cef5bfd30c5 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:31.313890 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eafe74-991f-46bb-be31-5fc29165fb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:31.314546 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eafe74-991f-46bb-be31-5fc29165fb4b None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:31.314826 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eafe74-991f-46bb-be31-5fc29165fb4b None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:31.315096 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eafe74-991f-46bb-be31-5fc29165fb4b None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:31.315831 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eafe74-991f-46bb-be31-5fc29165fb4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:18:31.316135 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eafe74-991f-46bb-be31-5fc29165fb4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:31.317490 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eafe74-991f-46bb-be31-5fc29165fb4b None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:31.329555 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 614/1211] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:18:31.335368 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6882b795-0f7a-42da-b7d1-458f0d591f4d None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:31.433225 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6882b795-0f7a-42da-b7d1-458f0d591f4d None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:31.434757 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:31.466699 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09095a13-5b1d-4b92-939d-66cd731f7e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:31.467562 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09095a13-5b1d-4b92-939d-66cd731f7e9e None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:31.467854 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09095a13-5b1d-4b92-939d-66cd731f7e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:31.468131 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09095a13-5b1d-4b92-939d-66cd731f7e9e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:31.474968 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09095a13-5b1d-4b92-939d-66cd731f7e9e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:31.476432 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09095a13-5b1d-4b92-939d-66cd731f7e9e None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:31.491378 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-09095a13-5b1d-4b92-939d-66cd731f7e9e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 19:18:31.491378 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:18:31.491378 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:18:31.491378 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:18:31.491378 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:18:31.491378 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:18:31.491378 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:18:31.491378 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:18:31.491378 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:18:31.491378 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:18:31.491378 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:18:31.491378 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:18:31.491378 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 19:18:31.491378 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 19:18:31.491378 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 19:18:31.491378 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 19:18:31.492555 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:18:31.492555 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:18:31.492555 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 19:18:31.492555 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:18:31.492555 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 19:18:31.492555 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:18:31.492555 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:18:31.492555 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:18:31.492555 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:18:31.492555 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:18:31.492555 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:18:31.492555 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:18:31.492555 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:18:31.492555 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:18:31.492555 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:18:31.492555 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:18:31.492555 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:18:31.492555 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:18:31.493527 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:18:31.493527 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:18:31.493527 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 19:18:31.493527 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 19:18:31.493527 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 19:18:31.493527 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 19:18:31.493527 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 19:18:31.493527 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 19:18:31.493527 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 19:18:31.493527 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:18:31.493527 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 598/1212] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:18:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:18:31.498540 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eafe74-991f-46bb-be31-5fc29165fb4b None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:31.599144 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eafe74-991f-46bb-be31-5fc29165fb4b None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:31.634587 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79937cdb-abc3-4ce7-a758-13026a938ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:31.635253 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79937cdb-abc3-4ce7-a758-13026a938ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:31.635578 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79937cdb-abc3-4ce7-a758-13026a938ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:31.635859 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79937cdb-abc3-4ce7-a758-13026a938ac9 None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:31.636691 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79937cdb-abc3-4ce7-a758-13026a938ac9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:18:31.637003 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79937cdb-abc3-4ce7-a758-13026a938ac9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:31.638549 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79937cdb-abc3-4ce7-a758-13026a938ac9 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:31.655659 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 615/1213] 10.222.0.60 () {56 vars in 1143 bytes} [Thu Jul 21 19:18:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:18:31.661653 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09095a13-5b1d-4b92-939d-66cd731f7e9e None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:31.760619 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09095a13-5b1d-4b92-939d-66cd731f7e9e None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:31.792916 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07775510-57df-419f-be63-33596bcb7a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:31.793552 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07775510-57df-419f-be63-33596bcb7a6b None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:31.793834 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07775510-57df-419f-be63-33596bcb7a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:31.794110 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07775510-57df-419f-be63-33596bcb7a6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:31.823387 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:31.860562 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07775510-57df-419f-be63-33596bcb7a6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:31.861952 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07775510-57df-419f-be63-33596bcb7a6b None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:31.955790 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 599/1214] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:18:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 19:18:31.961736 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79937cdb-abc3-4ce7-a758-13026a938ac9 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:31.981021 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:32.060904 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79937cdb-abc3-4ce7-a758-13026a938ac9 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:32.094776 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93293cb8-73f2-42b0-86dc-62531b7ebee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:32.095588 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93293cb8-73f2-42b0-86dc-62531b7ebee0 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:32.095874 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93293cb8-73f2-42b0-86dc-62531b7ebee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:32.096155 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93293cb8-73f2-42b0-86dc-62531b7ebee0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:32.106046 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93293cb8-73f2-42b0-86dc-62531b7ebee0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:32.107537 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93293cb8-73f2-42b0-86dc-62531b7ebee0 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:32.128249 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-93293cb8-73f2-42b0-86dc-62531b7ebee0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:18:32.128249 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:18:32.128249 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:18:32.128249 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:18:32.128249 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:18:32.128249 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:18:32.128249 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:18:32.128249 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:18:32.128249 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:18:32.128249 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:18:32.128249 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:18:32.128249 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:18:32.128249 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:18:32.128249 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:18:32.128249 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:18:32.129347 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:18:32.129347 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:18:32.129347 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:18:32.129347 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:18:32.129347 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:18:32.129347 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:18:32.129347 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:18:32.129347 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:18:32.129347 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:18:32.129347 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:18:32.129347 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:18:32.129347 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:18:32.129347 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:18:32.129347 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:18:32.129347 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:18:32.129347 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:18:32.129347 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:18:32.130469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:18:32.130469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:18:32.130469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:18:32.130469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:18:32.130469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 616/1215] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:18:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:18:32.132503 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07775510-57df-419f-be63-33596bcb7a6b None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:32.192349 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:32.230720 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07775510-57df-419f-be63-33596bcb7a6b None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:32.263406 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd2196-ab8c-4ee7-88c3-55b2c1094724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:32.264106 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd2196-ab8c-4ee7-88c3-55b2c1094724 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:32.264436 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd2196-ab8c-4ee7-88c3-55b2c1094724 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:32.264714 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd2196-ab8c-4ee7-88c3-55b2c1094724 None admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:32.265955 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cd2196-ab8c-4ee7-88c3-55b2c1094724 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:18:32.266272 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cd2196-ab8c-4ee7-88c3-55b2c1094724 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:32.267981 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cd2196-ab8c-4ee7-88c3-55b2c1094724 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:32.280523 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 600/1216] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:18:32.287081 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93293cb8-73f2-42b0-86dc-62531b7ebee0 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:32.357227 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:32.387244 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93293cb8-73f2-42b0-86dc-62531b7ebee0 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:32.423501 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e06343-9c32-4d6f-8f09-9c5321d066c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:32.424145 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e06343-9c32-4d6f-8f09-9c5321d066c7 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:32.424318 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e06343-9c32-4d6f-8f09-9c5321d066c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:32.424587 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e06343-9c32-4d6f-8f09-9c5321d066c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:32.431800 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e06343-9c32-4d6f-8f09-9c5321d066c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:32.433237 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e06343-9c32-4d6f-8f09-9c5321d066c7 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:32.447426 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-76e06343-9c32-4d6f-8f09-9c5321d066c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:18:32.447426 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:18:32.447426 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:18:32.447426 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:18:32.447426 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:18:32.447426 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:18:32.447426 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:18:32.447426 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:18:32.447426 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:18:32.447426 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:18:32.447426 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:18:32.447426 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:18:32.447426 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 19:18:32.447426 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 19:18:32.447426 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 19:18:32.448461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 19:18:32.448461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:18:32.448461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:18:32.448461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:18:32.448461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:18:32.448461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:18:32.448461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:18:32.448461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:18:32.448461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:18:32.448461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:18:32.448461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:18:32.448461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:18:32.448461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:18:32.448461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:18:32.448461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:18:32.448461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:18:32.448461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:18:32.449625 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 19:18:32.449625 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 19:18:32.449625 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 19:18:32.449625 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 19:18:32.449625 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 19:18:32.449625 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 19:18:32.449625 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:18:32.449625 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:18:32.449625 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 617/1217] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:18:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:18:32.455046 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd2196-ab8c-4ee7-88c3-55b2c1094724 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:32.550693 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd2196-ab8c-4ee7-88c3-55b2c1094724 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:32.573355 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:32.584860 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb67717-39bc-47b0-b48f-e67669b51108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:32.585517 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb67717-39bc-47b0-b48f-e67669b51108 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:32.585805 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb67717-39bc-47b0-b48f-e67669b51108 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:32.586082 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb67717-39bc-47b0-b48f-e67669b51108 None admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:32.586857 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb67717-39bc-47b0-b48f-e67669b51108 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:18:32.587166 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb67717-39bc-47b0-b48f-e67669b51108 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:32.588615 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb67717-39bc-47b0-b48f-e67669b51108 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:32.600283 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 601/1218] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Jul 21 19:18:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:18:32.606338 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e06343-9c32-4d6f-8f09-9c5321d066c7 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:32.706744 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e06343-9c32-4d6f-8f09-9c5321d066c7 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:32.733688 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:32.739651 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8ff8a-6c43-42bb-ada3-6daa202620b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:32.740302 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8ff8a-6c43-42bb-ada3-6daa202620b7 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:32.740588 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8ff8a-6c43-42bb-ada3-6daa202620b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:32.740864 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8ff8a-6c43-42bb-ada3-6daa202620b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:32.741688 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8ff8a-6c43-42bb-ada3-6daa202620b7 None admin] RBAC: Adding query filter params (role.id=beeebaa4e16c40f387f05b67124a424d, scope.project.id=9847b5e8bc0b4483bbce060a48f405f4, user.id=bcc5eefc2f7c419190e96b46b163fedd) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:18:32.742004 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8ff8a-6c43-42bb-ada3-6daa202620b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:32.743424 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8ff8a-6c43-42bb-ada3-6daa202620b7 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:32.748796 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 618/1219] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:18:32 2022] GET /identity/v3/role_assignments?user.id=bcc5eefc2f7c419190e96b46b163fedd&scope.project.id=9847b5e8bc0b4483bbce060a48f405f4&role.id=beeebaa4e16c40f387f05b67124a424d => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:18:34.743643 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da915b7-4dd1-4f01-ab24-8ff72b8a4938 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:34.744278 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da915b7-4dd1-4f01-ab24-8ff72b8a4938 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:34.744278 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da915b7-4dd1-4f01-ab24-8ff72b8a4938 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:34.745519 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 602/1220] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:18:34.750870 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bec0ed-13dd-4afb-b4f6-d1896963ccf1 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:34.751285 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bec0ed-13dd-4afb-b4f6-d1896963ccf1 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:34.751455 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bec0ed-13dd-4afb-b4f6-d1896963ccf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:34.768115 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-d2bec0ed-13dd-4afb-b4f6-d1896963ccf1 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:18:34.769306 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-d2bec0ed-13dd-4afb-b4f6-d1896963ccf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:18:34.835592 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 619/1221] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:18:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:18:34.859069 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da915b7-4dd1-4f01-ab24-8ff72b8a4938 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:34.959795 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da915b7-4dd1-4f01-ab24-8ff72b8a4938 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:34.993170 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a94098-d267-4091-aaed-13ca85695b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:34.994569 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a94098-d267-4091-aaed-13ca85695b68 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:34.994569 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a94098-d267-4091-aaed-13ca85695b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:34.994754 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a94098-d267-4091-aaed-13ca85695b68 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:35.004575 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a94098-d267-4091-aaed-13ca85695b68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:18:35.012254 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-b4a94098-d267-4091-aaed-13ca85695b68 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 19:18:35.012254 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:18:35.012254 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:18:35.012254 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:18:35.012254 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:18:35.012254 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:18:35.012254 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:18:35.012254 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:18:35.012254 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:18:35.012254 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:18:35.012254 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:18:35.012254 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:18:35.012254 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:18:35.012254 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:18:35.012254 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:18:35.012254 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:18:35.013357 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:18:35.013357 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:18:35.013357 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:18:35.013357 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:18:35.013357 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:18:35.013357 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:18:35.013357 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:18:35.013357 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:18:35.013357 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:18:35.013357 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:18:35.013357 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:18:35.013357 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:18:35.013357 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:18:35.013357 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:18:35.013357 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:18:35.013357 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:18:35.014270 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:18:35.014270 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:18:35.014270 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:18:35.014270 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:18:35.014270 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:18:35.014270 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:18:35.014270 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:18:35.014270 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:18:35.014270 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:18:35.014270 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:18:35.014270 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 19:18:35.014270 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:18:35.014270 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 603/1222] 10.222.0.60 () {56 vars in 1102 bytes} [Thu Jul 21 19:18:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:18:35.019599 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bec0ed-13dd-4afb-b4f6-d1896963ccf1 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:35.117031 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bec0ed-13dd-4afb-b4f6-d1896963ccf1 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:35.140127 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:35.151393 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b98bb-4704-40f5-a466-3bc73b3e6b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:35.152078 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b98bb-4704-40f5-a466-3bc73b3e6b62 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:35.152362 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b98bb-4704-40f5-a466-3bc73b3e6b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:35.152638 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b98bb-4704-40f5-a466-3bc73b3e6b62 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:35.153370 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b98bb-4704-40f5-a466-3bc73b3e6b62 None admin] RBAC: Adding query filter params (name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:18:35.153680 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b98bb-4704-40f5-a466-3bc73b3e6b62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:35.155036 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b98bb-4704-40f5-a466-3bc73b3e6b62 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:35.163332 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 620/1223] 10.222.0.60 () {56 vars in 1103 bytes} [Thu Jul 21 19:18:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:18:35.169169 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a94098-d267-4091-aaed-13ca85695b68 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:35.211726 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:35.265078 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a94098-d267-4091-aaed-13ca85695b68 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:35.298571 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab20a99-5a02-428e-b5fb-356ae86cbf1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:35.299367 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab20a99-5a02-428e-b5fb-356ae86cbf1c None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:35.299679 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab20a99-5a02-428e-b5fb-356ae86cbf1c None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:35.299973 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab20a99-5a02-428e-b5fb-356ae86cbf1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:35.310304 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab20a99-5a02-428e-b5fb-356ae86cbf1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:35.311770 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab20a99-5a02-428e-b5fb-356ae86cbf1c None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:35.328968 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-0ab20a99-5a02-428e-b5fb-356ae86cbf1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:18:35.328968 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:18:35.328968 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:18:35.328968 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:18:35.328968 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:18:35.328968 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:18:35.328968 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:18:35.328968 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:18:35.328968 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:18:35.328968 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:18:35.328968 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:18:35.328968 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:18:35.328968 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:18:35.328968 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:18:35.328968 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:18:35.330209 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:18:35.330209 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:18:35.330209 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:18:35.330209 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:18:35.330209 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:18:35.330209 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:18:35.330209 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:18:35.330209 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:18:35.330209 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:18:35.330209 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:18:35.330209 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:18:35.330209 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:18:35.330209 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:18:35.330209 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:18:35.330209 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:18:35.330209 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:18:35.330209 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:18:35.331310 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:18:35.331310 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:18:35.331310 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:18:35.331310 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:18:35.331310 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 604/1224] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:18:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:18:35.336252 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b98bb-4704-40f5-a466-3bc73b3e6b62 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:35.434896 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b98bb-4704-40f5-a466-3bc73b3e6b62 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:35.469034 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a4ae8-c7cc-44da-b15d-43d6be70e49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:35.469794 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a4ae8-c7cc-44da-b15d-43d6be70e49f None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:35.472844 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a4ae8-c7cc-44da-b15d-43d6be70e49f None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:35.472844 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a4ae8-c7cc-44da-b15d-43d6be70e49f None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:35.472844 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2a4ae8-c7cc-44da-b15d-43d6be70e49f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:18:35.472844 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2a4ae8-c7cc-44da-b15d-43d6be70e49f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:35.472844 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2a4ae8-c7cc-44da-b15d-43d6be70e49f None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:35.484681 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 621/1225] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:18:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:18:35.490543 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab20a99-5a02-428e-b5fb-356ae86cbf1c None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:35.582698 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:35.588966 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab20a99-5a02-428e-b5fb-356ae86cbf1c None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:35.621622 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e25cd-ac06-4f83-96af-2e7562ef8a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:35.622413 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e25cd-ac06-4f83-96af-2e7562ef8a22 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:35.622695 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e25cd-ac06-4f83-96af-2e7562ef8a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:35.622971 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e25cd-ac06-4f83-96af-2e7562ef8a22 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:35.630214 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e25cd-ac06-4f83-96af-2e7562ef8a22 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:35.631689 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e25cd-ac06-4f83-96af-2e7562ef8a22 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:35.647146 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-825e25cd-ac06-4f83-96af-2e7562ef8a22 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 19:18:35.647146 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:18:35.647146 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:18:35.647146 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:18:35.647146 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:18:35.647146 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:18:35.647146 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:18:35.647146 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:18:35.647146 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:18:35.647146 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:18:35.647146 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:18:35.647146 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:18:35.647146 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 19:18:35.647146 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 19:18:35.647146 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 19:18:35.647146 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 19:18:35.648331 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:18:35.648331 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:18:35.648331 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 19:18:35.648331 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:18:35.648331 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 19:18:35.648331 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:18:35.648331 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:18:35.648331 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:18:35.648331 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:18:35.648331 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:18:35.648331 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:18:35.648331 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:18:35.648331 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:18:35.648331 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:18:35.648331 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:18:35.648331 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:18:35.648331 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:18:35.648331 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:18:35.649317 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:18:35.649317 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:18:35.649317 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 19:18:35.649317 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 19:18:35.649317 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 19:18:35.649317 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 19:18:35.649317 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 19:18:35.649317 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 19:18:35.649317 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 19:18:35.649317 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:18:35.649317 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 605/1226] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:18:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:18:35.654324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a4ae8-c7cc-44da-b15d-43d6be70e49f None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:35.700582 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:35.752508 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a4ae8-c7cc-44da-b15d-43d6be70e49f None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:35.786255 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ef58e-19ac-4300-86e6-74b17dfc530b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:35.786915 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ef58e-19ac-4300-86e6-74b17dfc530b None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:35.787199 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ef58e-19ac-4300-86e6-74b17dfc530b None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:35.787504 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ef58e-19ac-4300-86e6-74b17dfc530b None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:35.788334 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ef58e-19ac-4300-86e6-74b17dfc530b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:18:35.788645 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ef58e-19ac-4300-86e6-74b17dfc530b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:35.790069 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ef58e-19ac-4300-86e6-74b17dfc530b None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:35.807594 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 622/1227] 10.222.0.60 () {56 vars in 1143 bytes} [Thu Jul 21 19:18:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:18:35.813464 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e25cd-ac06-4f83-96af-2e7562ef8a22 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:35.910106 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e25cd-ac06-4f83-96af-2e7562ef8a22 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:35.942602 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f68cf-b120-45dd-b14e-f4548e8e31e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:35.943376 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f68cf-b120-45dd-b14e-f4548e8e31e3 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:35.943757 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f68cf-b120-45dd-b14e-f4548e8e31e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:35.944037 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f68cf-b120-45dd-b14e-f4548e8e31e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:35.954350 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2f68cf-b120-45dd-b14e-f4548e8e31e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:35.963719 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2f68cf-b120-45dd-b14e-f4548e8e31e3 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:35.973845 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-7a2f68cf-b120-45dd-b14e-f4548e8e31e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:18:35.973845 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:18:35.973845 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:18:35.973845 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:18:35.973845 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:18:35.973845 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:18:35.973845 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:18:35.973845 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:18:35.973845 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:18:35.973845 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:18:35.973845 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:18:35.973845 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:18:35.973845 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:18:35.973845 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:18:35.973845 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:18:35.974897 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:18:35.974897 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:18:35.974897 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:18:35.974897 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:18:35.974897 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:18:35.974897 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:18:35.974897 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:18:35.974897 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:18:35.974897 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:18:35.974897 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:18:35.974897 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:18:35.974897 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:18:35.974897 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:18:35.974897 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:18:35.974897 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:18:35.974897 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:18:35.974897 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:18:35.975989 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:18:35.975989 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:18:35.975989 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:18:35.975989 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:18:35.975989 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 606/1228] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:18:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:18:35.980891 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ef58e-19ac-4300-86e6-74b17dfc530b None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:36.090614 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ef58e-19ac-4300-86e6-74b17dfc530b None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:36.095753 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:36.129047 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a2840-3c34-4716-9ed1-5015a6d48e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:36.129758 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a2840-3c34-4716-9ed1-5015a6d48e4d None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:36.130070 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a2840-3c34-4716-9ed1-5015a6d48e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:36.130373 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a2840-3c34-4716-9ed1-5015a6d48e4d None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:36.131132 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8a2840-3c34-4716-9ed1-5015a6d48e4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:18:36.131463 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8a2840-3c34-4716-9ed1-5015a6d48e4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:36.132919 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8a2840-3c34-4716-9ed1-5015a6d48e4d None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:36.145001 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 623/1229] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:18:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:18:36.150829 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f68cf-b120-45dd-b14e-f4548e8e31e3 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:36.160595 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:36.247211 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f68cf-b120-45dd-b14e-f4548e8e31e3 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:36.280721 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97db895-e1c0-47a9-a4ef-c7abe0ac5dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:36.281533 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97db895-e1c0-47a9-a4ef-c7abe0ac5dbe None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:36.281818 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97db895-e1c0-47a9-a4ef-c7abe0ac5dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:36.282095 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97db895-e1c0-47a9-a4ef-c7abe0ac5dbe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:36.288559 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97db895-e1c0-47a9-a4ef-c7abe0ac5dbe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:36.290071 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97db895-e1c0-47a9-a4ef-c7abe0ac5dbe None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:36.303793 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-f97db895-e1c0-47a9-a4ef-c7abe0ac5dbe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:18:36.303793 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:18:36.303793 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:18:36.303793 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:18:36.303793 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:18:36.303793 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:18:36.303793 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:18:36.303793 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:18:36.303793 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:18:36.303793 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:18:36.303793 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:18:36.303793 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:18:36.303793 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 19:18:36.303793 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 19:18:36.303793 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 19:18:36.320094 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 19:18:36.320094 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:18:36.320094 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:18:36.320094 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:18:36.320094 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:18:36.320094 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:18:36.320094 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:18:36.320094 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:18:36.320094 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:18:36.320094 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:18:36.320094 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:18:36.320094 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:18:36.320094 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:18:36.320094 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:18:36.320094 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:18:36.320094 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:18:36.320094 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:18:36.321154 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 19:18:36.321154 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 19:18:36.321154 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 19:18:36.321154 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 19:18:36.321154 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 19:18:36.321154 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 19:18:36.321154 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:18:36.321154 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:18:36.321154 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 607/1230] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:18:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:18:36.321705 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a2840-3c34-4716-9ed1-5015a6d48e4d None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:36.412625 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a2840-3c34-4716-9ed1-5015a6d48e4d None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:36.446747 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9facc35e-8dc9-4874-843b-d6d213828228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:36.447404 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9facc35e-8dc9-4874-843b-d6d213828228 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:36.447716 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9facc35e-8dc9-4874-843b-d6d213828228 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:36.448043 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9facc35e-8dc9-4874-843b-d6d213828228 None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:36.451315 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9facc35e-8dc9-4874-843b-d6d213828228 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:18:36.451315 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9facc35e-8dc9-4874-843b-d6d213828228 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:36.451315 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9facc35e-8dc9-4874-843b-d6d213828228 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:36.463295 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 624/1231] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Jul 21 19:18:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:18:36.469711 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97db895-e1c0-47a9-a4ef-c7abe0ac5dbe None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:36.533729 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:36.567086 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97db895-e1c0-47a9-a4ef-c7abe0ac5dbe None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:36.599362 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55193387-fb82-4056-9f8f-7e97f2fa8685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:36.600250 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55193387-fb82-4056-9f8f-7e97f2fa8685 None admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:36.600533 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55193387-fb82-4056-9f8f-7e97f2fa8685 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:36.600807 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55193387-fb82-4056-9f8f-7e97f2fa8685 None admin] PATH_INFO: `/v3/projects/9847b5e8bc0b4483bbce060a48f405f4/users/bcc5eefc2f7c419190e96b46b163fedd/roles/beeebaa4e16c40f387f05b67124a424d` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:36.614806 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55193387-fb82-4056-9f8f-7e97f2fa8685 None admin] RBAC: Authorizing `identity:create_grant(project_id=9847b5e8bc0b4483bbce060a48f405f4, user_id=bcc5eefc2f7c419190e96b46b163fedd, role_id=beeebaa4e16c40f387f05b67124a424d)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:36.616321 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55193387-fb82-4056-9f8f-7e97f2fa8685 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:36.792390 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 608/1232] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Jul 21 19:18:36 2022] PUT /identity/v3/projects/9847b5e8bc0b4483bbce060a48f405f4/users/bcc5eefc2f7c419190e96b46b163fedd/roles/beeebaa4e16c40f387f05b67124a424d => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:18:38.777968 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60921ea8-57f2-4716-b4bb-70c0e99cf086 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:38.778476 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60921ea8-57f2-4716-b4bb-70c0e99cf086 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:38.778476 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60921ea8-57f2-4716-b4bb-70c0e99cf086 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:38.779821 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 625/1233] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:18:38.785085 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8bcac-432a-4769-a434-79e623c83901 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:38.785523 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8bcac-432a-4769-a434-79e623c83901 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:38.785630 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8bcac-432a-4769-a434-79e623c83901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:38.802024 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-90f8bcac-432a-4769-a434-79e623c83901 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:18:38.803216 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-90f8bcac-432a-4769-a434-79e623c83901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:18:38.870250 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 609/1234] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:18:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:18:38.894628 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60921ea8-57f2-4716-b4bb-70c0e99cf086 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:38.919712 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:38.994912 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60921ea8-57f2-4716-b4bb-70c0e99cf086 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:39.027401 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d232ef-270f-4f3e-b049-e8b56f0d6e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:39.028310 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d232ef-270f-4f3e-b049-e8b56f0d6e65 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:39.028594 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d232ef-270f-4f3e-b049-e8b56f0d6e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:39.028872 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d232ef-270f-4f3e-b049-e8b56f0d6e65 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:39.038654 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d232ef-270f-4f3e-b049-e8b56f0d6e65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:18:39.046981 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-85d232ef-270f-4f3e-b049-e8b56f0d6e65 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 19:18:39.046981 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:18:39.046981 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:18:39.046981 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:18:39.046981 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:18:39.046981 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:18:39.046981 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:18:39.046981 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:18:39.046981 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:18:39.046981 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:18:39.046981 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:18:39.046981 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:18:39.046981 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:18:39.046981 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:18:39.046981 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:18:39.046981 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:18:39.047990 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:18:39.047990 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:18:39.047990 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:18:39.047990 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:18:39.047990 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:18:39.047990 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:18:39.047990 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:18:39.047990 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:18:39.047990 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:18:39.047990 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:18:39.047990 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:18:39.047990 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:18:39.047990 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:18:39.047990 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:18:39.047990 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:18:39.047990 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:18:39.048850 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:18:39.048850 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:18:39.048850 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:18:39.048850 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:18:39.048850 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:18:39.048850 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:18:39.048850 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:18:39.048850 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:18:39.048850 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:18:39.048850 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:18:39.048850 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 19:18:39.048850 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:18:39.048850 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 626/1235] 10.222.0.60 () {56 vars in 1102 bytes} [Thu Jul 21 19:18:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:18:39.054975 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f8bcac-432a-4769-a434-79e623c83901 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:39.100989 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:39.151458 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f8bcac-432a-4769-a434-79e623c83901 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:39.184042 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d03669-3991-43b5-94d4-aeeafebb89fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:39.184706 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d03669-3991-43b5-94d4-aeeafebb89fa None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:39.184991 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d03669-3991-43b5-94d4-aeeafebb89fa None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:39.185271 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d03669-3991-43b5-94d4-aeeafebb89fa None admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:39.186012 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d03669-3991-43b5-94d4-aeeafebb89fa None admin] RBAC: Adding query filter params (name=service) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:18:39.186336 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d03669-3991-43b5-94d4-aeeafebb89fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:39.188404 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d03669-3991-43b5-94d4-aeeafebb89fa None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:39.195962 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 610/1236] 10.222.0.60 () {56 vars in 1103 bytes} [Thu Jul 21 19:18:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:18:39.201688 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d232ef-270f-4f3e-b049-e8b56f0d6e65 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:39.285302 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:39.300693 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d232ef-270f-4f3e-b049-e8b56f0d6e65 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:39.333969 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f64c23a-b366-4d40-b918-1eee2b5555f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:39.334740 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64c23a-b366-4d40-b918-1eee2b5555f1 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:39.335022 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64c23a-b366-4d40-b918-1eee2b5555f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:39.335294 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64c23a-b366-4d40-b918-1eee2b5555f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:39.345577 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f64c23a-b366-4d40-b918-1eee2b5555f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:39.347009 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f64c23a-b366-4d40-b918-1eee2b5555f1 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:39.364070 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-9f64c23a-b366-4d40-b918-1eee2b5555f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:18:39.364070 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:18:39.364070 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:18:39.364070 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:18:39.364070 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:18:39.364070 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:18:39.364070 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:18:39.364070 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:18:39.364070 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:18:39.364070 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:18:39.364070 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:18:39.364070 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:18:39.364070 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:18:39.364070 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:18:39.364070 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:18:39.365108 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:18:39.365108 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:18:39.365108 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:18:39.365108 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:18:39.365108 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:18:39.365108 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:18:39.365108 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:18:39.365108 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:18:39.365108 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:18:39.365108 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:18:39.365108 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:18:39.365108 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:18:39.365108 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:18:39.365108 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:18:39.365108 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:18:39.365108 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:18:39.365108 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:18:39.366207 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:18:39.366207 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:18:39.366207 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:18:39.366207 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:18:39.366207 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 627/1237] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:18:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:18:39.371094 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d03669-3991-43b5-94d4-aeeafebb89fa None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:39.471040 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d03669-3991-43b5-94d4-aeeafebb89fa None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:39.502578 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201b686-dafc-456b-8ca9-5563cd861ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:39.503233 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201b686-dafc-456b-8ca9-5563cd861ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:39.503543 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201b686-dafc-456b-8ca9-5563cd861ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:39.503817 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201b686-dafc-456b-8ca9-5563cd861ee7 None admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:39.504528 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201b686-dafc-456b-8ca9-5563cd861ee7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:18:39.504862 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201b686-dafc-456b-8ca9-5563cd861ee7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:39.506211 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201b686-dafc-456b-8ca9-5563cd861ee7 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:39.518186 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 611/1238] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:18:39.524154 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f64c23a-b366-4d40-b918-1eee2b5555f1 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:39.623855 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f64c23a-b366-4d40-b918-1eee2b5555f1 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:39.656931 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7890341-25d8-4e58-bfa6-43d3919b6780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:39.657715 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7890341-25d8-4e58-bfa6-43d3919b6780 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:39.658003 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7890341-25d8-4e58-bfa6-43d3919b6780 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:39.658285 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7890341-25d8-4e58-bfa6-43d3919b6780 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:39.660951 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:39.665903 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7890341-25d8-4e58-bfa6-43d3919b6780 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:39.667342 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7890341-25d8-4e58-bfa6-43d3919b6780 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:39.682085 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-d7890341-25d8-4e58-bfa6-43d3919b6780 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 19:18:39.682085 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:18:39.682085 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:18:39.682085 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:18:39.682085 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:18:39.682085 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:18:39.682085 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:18:39.682085 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:18:39.682085 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:18:39.682085 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:18:39.682085 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:18:39.682085 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:18:39.682085 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 19:18:39.682085 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 19:18:39.682085 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 19:18:39.682085 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 19:18:39.683324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:18:39.683324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:18:39.683324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 19:18:39.683324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:18:39.683324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 19:18:39.683324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:18:39.683324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:18:39.683324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:18:39.683324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:18:39.683324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:18:39.683324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:18:39.683324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:18:39.683324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:18:39.683324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:18:39.683324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:18:39.683324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:18:39.683324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:18:39.683324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:18:39.684516 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:18:39.684516 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:18:39.684516 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 19:18:39.684516 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 19:18:39.684516 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 19:18:39.684516 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 19:18:39.684516 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 19:18:39.684516 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 19:18:39.684516 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 19:18:39.684516 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:18:39.684516 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 628/1239] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:18:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:18:39.689848 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201b686-dafc-456b-8ca9-5563cd861ee7 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:39.709900 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:39.789126 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201b686-dafc-456b-8ca9-5563cd861ee7 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:39.822629 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc4ab1-a7b9-4538-8183-e7a20181fb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:39.823302 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc4ab1-a7b9-4538-8183-e7a20181fb9f None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:39.823620 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc4ab1-a7b9-4538-8183-e7a20181fb9f None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:39.823901 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc4ab1-a7b9-4538-8183-e7a20181fb9f None admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:39.824730 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc4ab1-a7b9-4538-8183-e7a20181fb9f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:18:39.825040 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc4ab1-a7b9-4538-8183-e7a20181fb9f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:39.826552 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc4ab1-a7b9-4538-8183-e7a20181fb9f None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:39.843097 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 612/1240] 10.222.0.60 () {56 vars in 1143 bytes} [Thu Jul 21 19:18:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:18:39.848988 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7890341-25d8-4e58-bfa6-43d3919b6780 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:39.949787 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7890341-25d8-4e58-bfa6-43d3919b6780 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:39.982395 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc4e15a-7f4c-40a5-8ac6-343077741601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:39.983026 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4e15a-7f4c-40a5-8ac6-343077741601 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:39.983311 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4e15a-7f4c-40a5-8ac6-343077741601 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:39.983620 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4e15a-7f4c-40a5-8ac6-343077741601 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:40.043757 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:40.050755 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc4e15a-7f4c-40a5-8ac6-343077741601 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:40.052233 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc4e15a-7f4c-40a5-8ac6-343077741601 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:40.148773 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 629/1241] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:18:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 19:18:40.154537 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc4ab1-a7b9-4538-8183-e7a20181fb9f None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:40.183322 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:40.253558 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc4ab1-a7b9-4538-8183-e7a20181fb9f None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:40.286145 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38bed40-70e4-4b10-b7b5-17044cfd2682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:40.286935 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bed40-70e4-4b10-b7b5-17044cfd2682 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:40.287223 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bed40-70e4-4b10-b7b5-17044cfd2682 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:40.287536 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bed40-70e4-4b10-b7b5-17044cfd2682 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:40.298526 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38bed40-70e4-4b10-b7b5-17044cfd2682 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:40.300017 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38bed40-70e4-4b10-b7b5-17044cfd2682 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:40.318514 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-d38bed40-70e4-4b10-b7b5-17044cfd2682 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:18:40.318514 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:18:40.318514 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:18:40.318514 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:18:40.318514 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:18:40.318514 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:18:40.318514 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:18:40.318514 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:18:40.318514 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:18:40.318514 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:18:40.318514 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:18:40.318514 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:18:40.318514 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:18:40.318514 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:18:40.318514 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:18:40.319706 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:18:40.319706 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:18:40.319706 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:18:40.319706 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:18:40.319706 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:18:40.319706 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:18:40.319706 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:18:40.319706 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:18:40.319706 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:18:40.319706 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:18:40.319706 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:18:40.319706 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:18:40.319706 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:18:40.319706 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:18:40.319706 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:18:40.319706 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:18:40.319706 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:18:40.320844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:18:40.320844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:18:40.320844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:18:40.320844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:18:40.320844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 613/1242] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:18:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:18:40.325719 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc4e15a-7f4c-40a5-8ac6-343077741601 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:40.419523 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:40.425630 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc4e15a-7f4c-40a5-8ac6-343077741601 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:40.460068 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e9c16-1ffe-478b-8eab-8ed2434041f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:40.460725 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e9c16-1ffe-478b-8eab-8ed2434041f8 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:40.461012 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e9c16-1ffe-478b-8eab-8ed2434041f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:40.461316 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e9c16-1ffe-478b-8eab-8ed2434041f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:40.462036 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e9c16-1ffe-478b-8eab-8ed2434041f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:18:40.462347 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e9c16-1ffe-478b-8eab-8ed2434041f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:40.463780 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e9c16-1ffe-478b-8eab-8ed2434041f8 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:40.475427 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 630/1243] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:18:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:18:40.481205 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38bed40-70e4-4b10-b7b5-17044cfd2682 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:40.559352 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:40.580502 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38bed40-70e4-4b10-b7b5-17044cfd2682 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:40.613145 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d874c-0adb-4d80-9480-e2775e6d9181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:40.613959 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d874c-0adb-4d80-9480-e2775e6d9181 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:40.614237 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d874c-0adb-4d80-9480-e2775e6d9181 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:40.614513 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d874c-0adb-4d80-9480-e2775e6d9181 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:40.621018 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d874c-0adb-4d80-9480-e2775e6d9181 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:40.626272 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d874c-0adb-4d80-9480-e2775e6d9181 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:40.636062 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-586d874c-0adb-4d80-9480-e2775e6d9181 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:18:40.636062 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:18:40.636062 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:18:40.636062 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:18:40.636062 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:18:40.636062 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:18:40.636062 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:18:40.636062 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:18:40.636062 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:18:40.636062 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:18:40.636062 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:18:40.636062 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:18:40.636062 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 19:18:40.636062 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 19:18:40.636062 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 19:18:40.637154 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 19:18:40.637154 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:18:40.637154 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:18:40.637154 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:18:40.637154 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:18:40.637154 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:18:40.637154 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:18:40.637154 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:18:40.637154 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:18:40.637154 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:18:40.637154 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:18:40.637154 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:18:40.637154 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:18:40.637154 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:18:40.637154 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:18:40.637154 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:18:40.637154 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:18:40.638434 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 19:18:40.638434 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 19:18:40.638434 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 19:18:40.638434 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 19:18:40.638434 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 19:18:40.638434 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 19:18:40.638434 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:18:40.638434 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:18:40.638434 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 614/1244] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:18:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:18:40.644099 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e9c16-1ffe-478b-8eab-8ed2434041f8 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:40.744797 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e9c16-1ffe-478b-8eab-8ed2434041f8 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:40.779201 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d141ce-9e6f-4762-88f6-da28c58af706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:40.779884 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d141ce-9e6f-4762-88f6-da28c58af706 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:40.780172 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d141ce-9e6f-4762-88f6-da28c58af706 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:40.780452 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d141ce-9e6f-4762-88f6-da28c58af706 None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:40.781303 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d141ce-9e6f-4762-88f6-da28c58af706 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:18:40.781614 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d141ce-9e6f-4762-88f6-da28c58af706 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:40.783035 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d141ce-9e6f-4762-88f6-da28c58af706 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:40.794863 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 631/1245] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Jul 21 19:18:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:18:40.801285 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d874c-0adb-4d80-9480-e2775e6d9181 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:40.901196 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d874c-0adb-4d80-9480-e2775e6d9181 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:40.934596 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6b868-3dea-4207-903b-963752eaa576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:40.935252 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6b868-3dea-4207-903b-963752eaa576 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:40.935571 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6b868-3dea-4207-903b-963752eaa576 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:40.935852 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6b868-3dea-4207-903b-963752eaa576 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:40.936701 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd6b868-3dea-4207-903b-963752eaa576 None admin] RBAC: Adding query filter params (role.id=beeebaa4e16c40f387f05b67124a424d, scope.project.id=9847b5e8bc0b4483bbce060a48f405f4, user.id=bcc5eefc2f7c419190e96b46b163fedd) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:18:40.937502 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd6b868-3dea-4207-903b-963752eaa576 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:40.938926 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd6b868-3dea-4207-903b-963752eaa576 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:40.944794 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 615/1246] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:18:40 2022] GET /identity/v3/role_assignments?user.id=bcc5eefc2f7c419190e96b46b163fedd&scope.project.id=9847b5e8bc0b4483bbce060a48f405f4&role.id=beeebaa4e16c40f387f05b67124a424d => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:18:43.047820 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c795c5-b5c3-40f6-bb50-e7689ee86d08 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:43.048398 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c795c5-b5c3-40f6-bb50-e7689ee86d08 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:43.048398 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c795c5-b5c3-40f6-bb50-e7689ee86d08 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:43.049756 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 632/1247] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:18:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:18:43.055290 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb95c5-ac89-400a-86bf-c544b0e8340b None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:43.055726 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb95c5-ac89-400a-86bf-c544b0e8340b None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:43.055888 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb95c5-ac89-400a-86bf-c544b0e8340b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:43.060979 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:43.073117 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-7ddb95c5-ac89-400a-86bf-c544b0e8340b None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:18:43.074316 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-7ddb95c5-ac89-400a-86bf-c544b0e8340b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:18:43.141931 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 616/1248] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:18:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:18:43.165307 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c795c5-b5c3-40f6-bb50-e7689ee86d08 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:43.184384 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:43.267289 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c795c5-b5c3-40f6-bb50-e7689ee86d08 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:43.301760 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ea8f2-c3ed-4ce6-9466-d4382e130951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:43.302479 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ea8f2-c3ed-4ce6-9466-d4382e130951 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:43.302768 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ea8f2-c3ed-4ce6-9466-d4382e130951 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:43.303047 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ea8f2-c3ed-4ce6-9466-d4382e130951 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:43.313288 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ea8f2-c3ed-4ce6-9466-d4382e130951 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:18:43.321231 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-db3ea8f2-c3ed-4ce6-9466-d4382e130951 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:18:43.321231 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:18:43.321231 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:18:43.321231 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:18:43.321231 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:18:43.321231 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:18:43.321231 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:18:43.321231 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:18:43.321231 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:18:43.321231 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:18:43.321231 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:18:43.321231 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:18:43.321231 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:18:43.321231 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:18:43.321231 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:18:43.321231 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:18:43.325494 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:18:43.325494 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:18:43.325494 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:18:43.325494 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:18:43.325494 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:18:43.325494 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:18:43.325494 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:18:43.325494 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:18:43.325494 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:18:43.325494 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:18:43.325494 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:18:43.325494 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:18:43.325494 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:18:43.325494 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:18:43.325494 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:18:43.325494 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:18:43.326548 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:18:43.326548 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:18:43.326548 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:18:43.326548 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:18:43.326548 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:18:43.326548 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:18:43.326548 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:18:43.326548 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:18:43.326548 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:18:43.326548 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:18:43.326548 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:18:43.326548 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:18:43.326548 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 633/1249] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Jul 21 19:18:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:18:43.329197 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb95c5-ac89-400a-86bf-c544b0e8340b None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:43.430632 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb95c5-ac89-400a-86bf-c544b0e8340b None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:43.460407 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:43.465219 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3526328-bfc8-4327-8edf-7e76925e7828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:43.465879 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3526328-bfc8-4327-8edf-7e76925e7828 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:43.466161 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3526328-bfc8-4327-8edf-7e76925e7828 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:43.466436 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3526328-bfc8-4327-8edf-7e76925e7828 None admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:43.467167 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3526328-bfc8-4327-8edf-7e76925e7828 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:18:43.467496 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3526328-bfc8-4327-8edf-7e76925e7828 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:43.469677 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3526328-bfc8-4327-8edf-7e76925e7828 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:43.477495 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 617/1250] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:18:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:18:43.483264 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ea8f2-c3ed-4ce6-9466-d4382e130951 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:43.560328 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:43.582374 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ea8f2-c3ed-4ce6-9466-d4382e130951 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:43.615078 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2cccd-bc49-4665-a0c5-421d8babb716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:43.615887 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2cccd-bc49-4665-a0c5-421d8babb716 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:43.616172 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2cccd-bc49-4665-a0c5-421d8babb716 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:43.616447 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2cccd-bc49-4665-a0c5-421d8babb716 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:43.626804 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2cccd-bc49-4665-a0c5-421d8babb716 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:43.628276 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2cccd-bc49-4665-a0c5-421d8babb716 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:43.645407 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-f1b2cccd-bc49-4665-a0c5-421d8babb716 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:18:43.645407 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:18:43.645407 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:18:43.645407 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:18:43.645407 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:18:43.645407 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:18:43.645407 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:18:43.645407 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:18:43.645407 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:18:43.645407 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:18:43.645407 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:18:43.645407 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:18:43.645407 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:18:43.645407 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:18:43.645407 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:18:43.646469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:18:43.646469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:18:43.646469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:18:43.646469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:18:43.646469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:18:43.646469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:18:43.646469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:18:43.646469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:18:43.646469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:18:43.646469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:18:43.646469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:18:43.646469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:18:43.646469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:18:43.646469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:18:43.646469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:18:43.646469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:18:43.646469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:18:43.647427 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:18:43.647427 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:18:43.647427 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:18:43.647427 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:18:43.647427 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 634/1251] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:18:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:18:43.652535 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3526328-bfc8-4327-8edf-7e76925e7828 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:43.751422 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3526328-bfc8-4327-8edf-7e76925e7828 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:43.784387 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e747fa-fe4f-43ac-8df1-6dbb5b45158d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:43.785036 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e747fa-fe4f-43ac-8df1-6dbb5b45158d None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:43.785323 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e747fa-fe4f-43ac-8df1-6dbb5b45158d None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:43.785603 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e747fa-fe4f-43ac-8df1-6dbb5b45158d None admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:43.786314 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e747fa-fe4f-43ac-8df1-6dbb5b45158d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:18:43.786628 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e747fa-fe4f-43ac-8df1-6dbb5b45158d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:43.788037 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e747fa-fe4f-43ac-8df1-6dbb5b45158d None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:43.799717 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 618/1252] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:18:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:18:43.805830 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2cccd-bc49-4665-a0c5-421d8babb716 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:43.907658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2cccd-bc49-4665-a0c5-421d8babb716 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:43.934652 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:43.943211 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2190bbb-8a7f-48ef-b9cc-3ca5bef1076e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:43.944041 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2190bbb-8a7f-48ef-b9cc-3ca5bef1076e None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:43.944349 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2190bbb-8a7f-48ef-b9cc-3ca5bef1076e None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:43.944646 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2190bbb-8a7f-48ef-b9cc-3ca5bef1076e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:43.952182 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2190bbb-8a7f-48ef-b9cc-3ca5bef1076e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:43.954292 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2190bbb-8a7f-48ef-b9cc-3ca5bef1076e None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:43.968813 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-a2190bbb-8a7f-48ef-b9cc-3ca5bef1076e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 19:18:43.968813 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:18:43.968813 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:18:43.968813 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:18:43.968813 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:18:43.968813 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:18:43.968813 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:18:43.968813 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:18:43.968813 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:18:43.968813 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:18:43.968813 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:18:43.968813 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:18:43.968813 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 19:18:43.968813 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 19:18:43.968813 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 19:18:43.968813 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 19:18:43.973613 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:18:43.973613 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:18:43.973613 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 19:18:43.973613 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:18:43.973613 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 19:18:43.973613 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:18:43.973613 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:18:43.973613 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:18:43.973613 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:18:43.973613 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:18:43.973613 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:18:43.973613 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:18:43.973613 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:18:43.973613 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:18:43.973613 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:18:43.973613 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:18:43.973613 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:18:43.973613 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:18:43.974768 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:18:43.974768 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:18:43.974768 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 19:18:43.974768 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 19:18:43.974768 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 19:18:43.974768 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 19:18:43.974768 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 19:18:43.974768 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 19:18:43.974768 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 19:18:43.974768 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:18:43.974768 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 635/1253] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:18:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:18:43.975989 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e747fa-fe4f-43ac-8df1-6dbb5b45158d None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:44.031017 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:44.074159 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e747fa-fe4f-43ac-8df1-6dbb5b45158d None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:44.105967 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea0ef7-ee74-4b48-a02d-15c903555949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:44.106622 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea0ef7-ee74-4b48-a02d-15c903555949 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:44.106905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea0ef7-ee74-4b48-a02d-15c903555949 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:44.107179 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea0ef7-ee74-4b48-a02d-15c903555949 None admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:44.108036 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea0ef7-ee74-4b48-a02d-15c903555949 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:18:44.108344 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea0ef7-ee74-4b48-a02d-15c903555949 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:44.110478 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea0ef7-ee74-4b48-a02d-15c903555949 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:44.127158 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 619/1254] 10.222.0.60 () {56 vars in 1143 bytes} [Thu Jul 21 19:18:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:18:44.132949 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2190bbb-8a7f-48ef-b9cc-3ca5bef1076e None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:44.231816 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2190bbb-8a7f-48ef-b9cc-3ca5bef1076e None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:44.265398 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf037f-4010-452e-b83c-732b7de8a2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:44.266121 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf037f-4010-452e-b83c-732b7de8a2dc None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:44.266408 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf037f-4010-452e-b83c-732b7de8a2dc None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:44.266688 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf037f-4010-452e-b83c-732b7de8a2dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:44.321353 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:44.333779 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf037f-4010-452e-b83c-732b7de8a2dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:44.335347 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf037f-4010-452e-b83c-732b7de8a2dc None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:44.433905 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 636/1255] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:18:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 19:18:44.440287 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea0ef7-ee74-4b48-a02d-15c903555949 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:44.539118 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea0ef7-ee74-4b48-a02d-15c903555949 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:44.552864 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:44.573737 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d904fd7-cecd-4bf0-b26d-72e7e39a7eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:44.574522 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d904fd7-cecd-4bf0-b26d-72e7e39a7eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:44.574805 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d904fd7-cecd-4bf0-b26d-72e7e39a7eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:44.575080 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d904fd7-cecd-4bf0-b26d-72e7e39a7eb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:44.585537 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d904fd7-cecd-4bf0-b26d-72e7e39a7eb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:44.587151 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d904fd7-cecd-4bf0-b26d-72e7e39a7eb9 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:44.604135 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-8d904fd7-cecd-4bf0-b26d-72e7e39a7eb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:18:44.604135 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:18:44.604135 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:18:44.604135 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:18:44.604135 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:18:44.604135 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:18:44.604135 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:18:44.604135 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:18:44.604135 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:18:44.604135 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:18:44.604135 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:18:44.604135 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:18:44.604135 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:18:44.604135 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:18:44.604135 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:18:44.609607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:18:44.609607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:18:44.609607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:18:44.609607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:18:44.609607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:18:44.609607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:18:44.609607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:18:44.609607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:18:44.609607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:18:44.609607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:18:44.609607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:18:44.609607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:18:44.609607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:18:44.609607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:18:44.609607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:18:44.609607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:18:44.609607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:18:44.610686 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:18:44.610686 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:18:44.610686 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:18:44.610686 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:18:44.610686 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 620/1256] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:18:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:18:44.611283 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf037f-4010-452e-b83c-732b7de8a2dc None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:44.697855 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:44.710084 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf037f-4010-452e-b83c-732b7de8a2dc None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:44.743151 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc110c-5ec6-4317-9b8d-7af0b9782109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:44.743848 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc110c-5ec6-4317-9b8d-7af0b9782109 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:44.744138 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc110c-5ec6-4317-9b8d-7af0b9782109 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:44.744419 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc110c-5ec6-4317-9b8d-7af0b9782109 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:44.745140 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc110c-5ec6-4317-9b8d-7af0b9782109 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:18:44.745450 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc110c-5ec6-4317-9b8d-7af0b9782109 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:44.746817 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc110c-5ec6-4317-9b8d-7af0b9782109 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:44.758589 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 637/1257] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:18:44.764710 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d904fd7-cecd-4bf0-b26d-72e7e39a7eb9 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:44.860708 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d904fd7-cecd-4bf0-b26d-72e7e39a7eb9 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:44.893279 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb956b-43a2-461d-892c-c39eecb7395c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:44.894106 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb956b-43a2-461d-892c-c39eecb7395c None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:44.894389 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb956b-43a2-461d-892c-c39eecb7395c None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:44.894661 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb956b-43a2-461d-892c-c39eecb7395c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:44.901257 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb956b-43a2-461d-892c-c39eecb7395c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:44.902684 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb956b-43a2-461d-892c-c39eecb7395c None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:44.916014 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-30cb956b-43a2-461d-892c-c39eecb7395c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:18:44.916014 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:18:44.916014 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:18:44.916014 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:18:44.916014 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:18:44.916014 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:18:44.916014 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:18:44.916014 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:18:44.916014 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:18:44.916014 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:18:44.916014 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:18:44.916014 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:18:44.916014 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 19:18:44.916014 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 19:18:44.916014 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 19:18:44.917157 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 19:18:44.917157 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:18:44.917157 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:18:44.917157 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:18:44.917157 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:18:44.917157 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:18:44.917157 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:18:44.917157 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:18:44.917157 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:18:44.917157 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:18:44.917157 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:18:44.917157 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:18:44.917157 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:18:44.917157 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:18:44.917157 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:18:44.917157 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:18:44.917157 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:18:44.918265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 19:18:44.918265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 19:18:44.918265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 19:18:44.918265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 19:18:44.918265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 19:18:44.918265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 19:18:44.918265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:18:44.918265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:18:44.918265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 621/1258] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:18:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:18:44.923909 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc110c-5ec6-4317-9b8d-7af0b9782109 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:45.020860 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc110c-5ec6-4317-9b8d-7af0b9782109 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:45.053170 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf2cf7-895b-40be-9932-6f585f59a1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:45.053816 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf2cf7-895b-40be-9932-6f585f59a1ee None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:45.054366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf2cf7-895b-40be-9932-6f585f59a1ee None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:45.054640 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf2cf7-895b-40be-9932-6f585f59a1ee None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:45.055500 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebf2cf7-895b-40be-9932-6f585f59a1ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:18:45.055809 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebf2cf7-895b-40be-9932-6f585f59a1ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:45.057226 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebf2cf7-895b-40be-9932-6f585f59a1ee None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:45.069760 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 638/1259] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Jul 21 19:18:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:18:45.075672 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb956b-43a2-461d-892c-c39eecb7395c None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:45.100754 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:45.172121 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb956b-43a2-461d-892c-c39eecb7395c None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:45.206058 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f9ff4-8d8d-4664-961d-663b5e9f4eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:45.206705 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f9ff4-8d8d-4664-961d-663b5e9f4eb7 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:45.206997 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f9ff4-8d8d-4664-961d-663b5e9f4eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:45.207279 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f9ff4-8d8d-4664-961d-663b5e9f4eb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:45.208140 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f9ff4-8d8d-4664-961d-663b5e9f4eb7 None admin] RBAC: Adding query filter params (role.id=685e18230e1744c581baaf842d0fd4ca, scope.project.id=9847b5e8bc0b4483bbce060a48f405f4, user.id=bcc5eefc2f7c419190e96b46b163fedd) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:18:45.208454 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f9ff4-8d8d-4664-961d-663b5e9f4eb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:45.209871 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f9ff4-8d8d-4664-961d-663b5e9f4eb7 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:45.218379 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 622/1260] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:18:45 2022] GET /identity/v3/role_assignments?user.id=bcc5eefc2f7c419190e96b46b163fedd&scope.project.id=9847b5e8bc0b4483bbce060a48f405f4&role.id=685e18230e1744c581baaf842d0fd4ca => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:18:47.237753 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e111983-9ce5-4395-894d-68c59397551d None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:47.238328 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e111983-9ce5-4395-894d-68c59397551d None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:47.238328 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e111983-9ce5-4395-894d-68c59397551d None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:47.239767 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 639/1261] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:18:47.245497 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61587d4-24d1-47ef-b9a0-8b91853d7757 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:47.245883 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61587d4-24d1-47ef-b9a0-8b91853d7757 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:47.246055 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61587d4-24d1-47ef-b9a0-8b91853d7757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:47.262906 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-e61587d4-24d1-47ef-b9a0-8b91853d7757 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:18:47.264118 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-e61587d4-24d1-47ef-b9a0-8b91853d7757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:18:47.330088 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 623/1262] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:18:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:18:47.354311 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e111983-9ce5-4395-894d-68c59397551d None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:47.365506 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:47.455979 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e111983-9ce5-4395-894d-68c59397551d None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:47.488946 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701b0e4-39b9-4560-963f-87e2dd4e14b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:47.489761 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701b0e4-39b9-4560-963f-87e2dd4e14b4 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:47.490045 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701b0e4-39b9-4560-963f-87e2dd4e14b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:47.490321 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701b0e4-39b9-4560-963f-87e2dd4e14b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:47.500233 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a701b0e4-39b9-4560-963f-87e2dd4e14b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:18:47.508566 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-a701b0e4-39b9-4560-963f-87e2dd4e14b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:18:47.508566 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:18:47.508566 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:18:47.508566 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:18:47.508566 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:18:47.508566 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:18:47.508566 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:18:47.508566 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:18:47.508566 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:18:47.508566 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:18:47.508566 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:18:47.508566 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:18:47.508566 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:18:47.508566 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:18:47.508566 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:18:47.508566 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:18:47.509678 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:18:47.509678 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:18:47.509678 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:18:47.509678 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:18:47.509678 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:18:47.509678 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:18:47.509678 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:18:47.509678 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:18:47.509678 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:18:47.509678 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:18:47.509678 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:18:47.509678 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:18:47.509678 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:18:47.509678 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:18:47.509678 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:18:47.509678 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:18:47.510563 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:18:47.510563 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:18:47.510563 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:18:47.510563 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:18:47.510563 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:18:47.510563 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:18:47.510563 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:18:47.510563 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:18:47.510563 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:18:47.510563 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:18:47.510563 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:18:47.510563 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:18:47.510563 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 640/1263] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Jul 21 19:18:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:18:47.515808 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61587d4-24d1-47ef-b9a0-8b91853d7757 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:47.534151 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:47.611240 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61587d4-24d1-47ef-b9a0-8b91853d7757 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:47.646890 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21db0ff-3cf7-4b74-91d1-c9235a77f12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:47.649433 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21db0ff-3cf7-4b74-91d1-c9235a77f12a None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:47.649433 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21db0ff-3cf7-4b74-91d1-c9235a77f12a None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:47.649433 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21db0ff-3cf7-4b74-91d1-c9235a77f12a None admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:47.649433 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21db0ff-3cf7-4b74-91d1-c9235a77f12a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:18:47.649433 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21db0ff-3cf7-4b74-91d1-c9235a77f12a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:47.650566 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21db0ff-3cf7-4b74-91d1-c9235a77f12a None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:47.658320 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 624/1264] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:18:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:18:47.664374 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701b0e4-39b9-4560-963f-87e2dd4e14b4 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:47.732357 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:47.768809 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701b0e4-39b9-4560-963f-87e2dd4e14b4 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:47.801862 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd59a9f-b376-4ec4-acc7-d23c7a680da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:47.802645 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd59a9f-b376-4ec4-acc7-d23c7a680da1 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:47.802927 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd59a9f-b376-4ec4-acc7-d23c7a680da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:47.803201 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd59a9f-b376-4ec4-acc7-d23c7a680da1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:47.813647 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd59a9f-b376-4ec4-acc7-d23c7a680da1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:47.815793 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd59a9f-b376-4ec4-acc7-d23c7a680da1 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:47.833051 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-0cd59a9f-b376-4ec4-acc7-d23c7a680da1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:18:47.833051 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:18:47.833051 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:18:47.833051 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:18:47.833051 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:18:47.833051 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:18:47.833051 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:18:47.833051 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:18:47.833051 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:18:47.833051 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:18:47.833051 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:18:47.833051 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:18:47.833051 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:18:47.833051 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:18:47.833051 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:18:47.834065 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:18:47.834065 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:18:47.834065 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:18:47.834065 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:18:47.834065 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:18:47.834065 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:18:47.834065 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:18:47.834065 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:18:47.834065 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:18:47.834065 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:18:47.834065 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:18:47.834065 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:18:47.834065 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:18:47.834065 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:18:47.834065 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:18:47.834065 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:18:47.834065 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:18:47.835223 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:18:47.835223 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:18:47.835223 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:18:47.835223 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:18:47.835223 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 641/1265] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:18:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:18:47.840273 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21db0ff-3cf7-4b74-91d1-c9235a77f12a None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:47.919048 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:47.937953 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21db0ff-3cf7-4b74-91d1-c9235a77f12a None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:47.970875 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4772c-13e0-4184-aacf-b64abe30fbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:47.971555 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4772c-13e0-4184-aacf-b64abe30fbe3 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:47.971844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4772c-13e0-4184-aacf-b64abe30fbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:47.972122 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4772c-13e0-4184-aacf-b64abe30fbe3 None admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:47.972833 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4772c-13e0-4184-aacf-b64abe30fbe3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:18:47.973141 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4772c-13e0-4184-aacf-b64abe30fbe3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:47.974572 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4772c-13e0-4184-aacf-b64abe30fbe3 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:47.985363 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 625/1266] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:18:47.991906 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd59a9f-b376-4ec4-acc7-d23c7a680da1 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:48.090957 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd59a9f-b376-4ec4-acc7-d23c7a680da1 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:48.110068 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:48.124849 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7045d04-61d8-4e55-b75b-cc5edfd89aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:48.125684 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7045d04-61d8-4e55-b75b-cc5edfd89aef None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:48.125966 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7045d04-61d8-4e55-b75b-cc5edfd89aef None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:48.126235 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7045d04-61d8-4e55-b75b-cc5edfd89aef None admin] PATH_INFO: `/v3/users/placement` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:48.134365 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7045d04-61d8-4e55-b75b-cc5edfd89aef None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:48.135915 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7045d04-61d8-4e55-b75b-cc5edfd89aef None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:48.150466 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-f7045d04-61d8-4e55-b75b-cc5edfd89aef None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 19:18:48.150466 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:18:48.150466 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:18:48.150466 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:18:48.150466 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:18:48.150466 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:18:48.150466 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:18:48.150466 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:18:48.150466 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:18:48.150466 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:18:48.150466 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:18:48.150466 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:18:48.150466 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 19:18:48.150466 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 19:18:48.150466 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 19:18:48.150466 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 19:18:48.158428 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:18:48.158428 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:18:48.158428 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 19:18:48.158428 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:18:48.158428 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 19:18:48.158428 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:18:48.158428 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:18:48.158428 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:18:48.158428 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:18:48.158428 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:18:48.158428 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:18:48.158428 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:18:48.158428 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:18:48.158428 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:18:48.158428 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:18:48.158428 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:18:48.158428 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:18:48.158428 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:18:48.159681 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:18:48.159681 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:18:48.159681 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 19:18:48.159681 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 19:18:48.159681 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 19:18:48.159681 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 19:18:48.159681 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 19:18:48.159681 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 19:18:48.159681 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 19:18:48.159681 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:18:48.159681 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 642/1267] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:18:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:18:48.160432 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4772c-13e0-4184-aacf-b64abe30fbe3 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:48.256043 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4772c-13e0-4184-aacf-b64abe30fbe3 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:48.288143 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f99964-16bb-4a16-956a-eee77a09bd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:48.288807 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f99964-16bb-4a16-956a-eee77a09bd0e None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:48.289087 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f99964-16bb-4a16-956a-eee77a09bd0e None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:48.289360 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f99964-16bb-4a16-956a-eee77a09bd0e None admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:48.290181 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f99964-16bb-4a16-956a-eee77a09bd0e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:18:48.290489 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f99964-16bb-4a16-956a-eee77a09bd0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:48.291941 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f99964-16bb-4a16-956a-eee77a09bd0e None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:48.301316 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:48.309746 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 626/1268] 10.222.0.60 () {56 vars in 1143 bytes} [Thu Jul 21 19:18:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:18:48.315503 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7045d04-61d8-4e55-b75b-cc5edfd89aef None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:48.416162 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7045d04-61d8-4e55-b75b-cc5edfd89aef None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:48.450743 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbd419-efdb-4fd6-98f5-4583c8a686e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:48.451560 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbd419-efdb-4fd6-98f5-4583c8a686e9 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:48.451845 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbd419-efdb-4fd6-98f5-4583c8a686e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:48.452119 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbd419-efdb-4fd6-98f5-4583c8a686e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:48.463020 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fbd419-efdb-4fd6-98f5-4583c8a686e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:48.464484 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fbd419-efdb-4fd6-98f5-4583c8a686e9 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:48.481580 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-01fbd419-efdb-4fd6-98f5-4583c8a686e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:18:48.481580 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:18:48.481580 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:18:48.481580 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:18:48.481580 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:18:48.481580 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:18:48.481580 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:18:48.481580 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:18:48.481580 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:18:48.481580 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:18:48.481580 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:18:48.481580 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:18:48.481580 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:18:48.481580 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:18:48.481580 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:18:48.482711 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:18:48.482711 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:18:48.482711 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:18:48.482711 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:18:48.482711 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:18:48.482711 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:18:48.482711 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:18:48.482711 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:18:48.482711 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:18:48.482711 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:18:48.482711 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:18:48.482711 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:18:48.482711 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:18:48.482711 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:18:48.482711 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:18:48.482711 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:18:48.482711 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:18:48.483829 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:18:48.483829 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:18:48.483829 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:18:48.483829 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:18:48.483829 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 643/1269] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:18:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:18:48.489312 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f99964-16bb-4a16-956a-eee77a09bd0e None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:48.587566 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f99964-16bb-4a16-956a-eee77a09bd0e None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:48.621054 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74542ed5-192a-41df-ad74-f5746c4941f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:48.621713 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74542ed5-192a-41df-ad74-f5746c4941f7 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:48.621998 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74542ed5-192a-41df-ad74-f5746c4941f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:48.622277 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74542ed5-192a-41df-ad74-f5746c4941f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:48.622988 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74542ed5-192a-41df-ad74-f5746c4941f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:18:48.623297 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74542ed5-192a-41df-ad74-f5746c4941f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:48.624687 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74542ed5-192a-41df-ad74-f5746c4941f7 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:48.635821 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 627/1270] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:18:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:18:48.641536 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbd419-efdb-4fd6-98f5-4583c8a686e9 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:48.674163 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:48.741732 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbd419-efdb-4fd6-98f5-4583c8a686e9 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:48.774606 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192692a1-d601-4a35-97fd-ca3fe965539f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:48.775395 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192692a1-d601-4a35-97fd-ca3fe965539f None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:48.775709 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192692a1-d601-4a35-97fd-ca3fe965539f None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:48.775988 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192692a1-d601-4a35-97fd-ca3fe965539f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:48.782441 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192692a1-d601-4a35-97fd-ca3fe965539f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:48.784477 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192692a1-d601-4a35-97fd-ca3fe965539f None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:48.798494 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-192692a1-d601-4a35-97fd-ca3fe965539f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:18:48.798494 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:18:48.798494 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:18:48.798494 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:18:48.798494 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:18:48.798494 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:18:48.798494 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:18:48.798494 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:18:48.798494 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:18:48.798494 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:18:48.798494 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:18:48.798494 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:18:48.798494 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 19:18:48.798494 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 19:18:48.798494 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 19:18:48.799611 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 19:18:48.799611 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:18:48.799611 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:18:48.799611 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:18:48.799611 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:18:48.799611 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:18:48.799611 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:18:48.799611 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:18:48.799611 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:18:48.799611 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:18:48.799611 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:18:48.799611 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:18:48.799611 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:18:48.799611 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:18:48.799611 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:18:48.799611 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:18:48.799611 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:18:48.800729 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 19:18:48.800729 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 19:18:48.800729 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 19:18:48.800729 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 19:18:48.800729 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 19:18:48.800729 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 19:18:48.800729 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:18:48.800729 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:18:48.800729 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 644/1271] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:18:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:18:48.805772 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74542ed5-192a-41df-ad74-f5746c4941f7 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:48.863271 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:48.906016 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74542ed5-192a-41df-ad74-f5746c4941f7 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:48.938400 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4a824-b5ac-49e2-8c84-691ff2313916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:48.939509 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4a824-b5ac-49e2-8c84-691ff2313916 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:48.939793 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4a824-b5ac-49e2-8c84-691ff2313916 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:48.940066 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4a824-b5ac-49e2-8c84-691ff2313916 None admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:48.940839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d4a824-b5ac-49e2-8c84-691ff2313916 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:18:48.941186 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d4a824-b5ac-49e2-8c84-691ff2313916 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:48.942594 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d4a824-b5ac-49e2-8c84-691ff2313916 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:48.955306 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 628/1272] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Jul 21 19:18:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:18:48.961360 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192692a1-d601-4a35-97fd-ca3fe965539f None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:49.051685 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:49.060736 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192692a1-d601-4a35-97fd-ca3fe965539f None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:49.096149 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297aecc-5890-4a91-ad0b-c4a7cefccd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:49.097196 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297aecc-5890-4a91-ad0b-c4a7cefccd6a None admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:49.097488 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297aecc-5890-4a91-ad0b-c4a7cefccd6a None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:49.097767 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297aecc-5890-4a91-ad0b-c4a7cefccd6a None admin] PATH_INFO: `/v3/projects/9847b5e8bc0b4483bbce060a48f405f4/users/bcc5eefc2f7c419190e96b46b163fedd/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:49.099837 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9297aecc-5890-4a91-ad0b-c4a7cefccd6a None admin] RBAC: Authorizing `identity:create_grant(project_id=9847b5e8bc0b4483bbce060a48f405f4, user_id=bcc5eefc2f7c419190e96b46b163fedd, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:49.103189 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9297aecc-5890-4a91-ad0b-c4a7cefccd6a None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:49.216454 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 645/1273] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Jul 21 19:18:48 2022] PUT /identity/v3/projects/9847b5e8bc0b4483bbce060a48f405f4/users/bcc5eefc2f7c419190e96b46b163fedd/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:18:51.280426 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719e350-88fe-4413-ad43-bedd7c83ec1b None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:51.280982 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719e350-88fe-4413-ad43-bedd7c83ec1b None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:51.280982 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719e350-88fe-4413-ad43-bedd7c83ec1b None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:51.282384 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 629/1274] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:18:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:18:51.287737 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472a2ec-b790-4ef0-a60f-9d39525e5548 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:51.288147 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472a2ec-b790-4ef0-a60f-9d39525e5548 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:51.288523 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472a2ec-b790-4ef0-a60f-9d39525e5548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:51.304973 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-5472a2ec-b790-4ef0-a60f-9d39525e5548 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:18:51.306229 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-5472a2ec-b790-4ef0-a60f-9d39525e5548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:18:51.380751 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 646/1275] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:18:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:18:51.405686 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719e350-88fe-4413-ad43-bedd7c83ec1b None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:51.508346 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719e350-88fe-4413-ad43-bedd7c83ec1b None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:51.525298 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:51.541632 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f43d8-96b6-4a24-bfbe-ab717945b33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:51.542339 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f43d8-96b6-4a24-bfbe-ab717945b33b None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:51.542619 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f43d8-96b6-4a24-bfbe-ab717945b33b None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:51.542888 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f43d8-96b6-4a24-bfbe-ab717945b33b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:51.553190 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f43d8-96b6-4a24-bfbe-ab717945b33b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 19:18:51.560988 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-633f43d8-96b6-4a24-bfbe-ab717945b33b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:18:51.560988 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:18:51.560988 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:18:51.560988 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:18:51.560988 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:18:51.560988 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:18:51.560988 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:18:51.560988 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:18:51.560988 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:18:51.560988 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:18:51.560988 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:18:51.560988 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:18:51.560988 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 19:18:51.560988 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 19:18:51.560988 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 19:18:51.560988 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 19:18:51.562582 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 19:18:51.562582 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 19:18:51.562582 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 19:18:51.562582 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 19:18:51.562582 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:18:51.562582 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:18:51.562582 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:18:51.562582 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:18:51.562582 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:18:51.562582 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:18:51.562582 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:18:51.562582 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:18:51.562582 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:18:51.562582 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:18:51.562582 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:18:51.562582 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:18:51.564333 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:18:51.564333 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:18:51.564333 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:18:51.564333 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:18:51.564333 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 19:18:51.564333 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 19:18:51.564333 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 19:18:51.564333 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 19:18:51.564333 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 19:18:51.564333 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 19:18:51.564333 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 19:18:51.564333 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:18:51.564333 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 630/1276] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Jul 21 19:18:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:18:51.569144 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472a2ec-b790-4ef0-a60f-9d39525e5548 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:51.650371 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:51.670390 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472a2ec-b790-4ef0-a60f-9d39525e5548 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:51.706037 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c6238-018a-41aa-bb2f-30ecea46349e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:51.706705 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c6238-018a-41aa-bb2f-30ecea46349e None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:51.706990 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c6238-018a-41aa-bb2f-30ecea46349e None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:51.707266 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c6238-018a-41aa-bb2f-30ecea46349e None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:51.708074 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c6238-018a-41aa-bb2f-30ecea46349e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:18:51.708387 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c6238-018a-41aa-bb2f-30ecea46349e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:51.709853 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c6238-018a-41aa-bb2f-30ecea46349e None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:51.718190 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 647/1277] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Jul 21 19:18:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:18:51.724506 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f43d8-96b6-4a24-bfbe-ab717945b33b None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:51.824333 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f43d8-96b6-4a24-bfbe-ab717945b33b None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:51.856727 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368d5bc-d2d5-4a32-9218-18cf8f7712aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:51.859346 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368d5bc-d2d5-4a32-9218-18cf8f7712aa None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:51.859346 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368d5bc-d2d5-4a32-9218-18cf8f7712aa None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:51.859346 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368d5bc-d2d5-4a32-9218-18cf8f7712aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:51.869524 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5368d5bc-d2d5-4a32-9218-18cf8f7712aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:51.870960 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5368d5bc-d2d5-4a32-9218-18cf8f7712aa None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:51.888753 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-5368d5bc-d2d5-4a32-9218-18cf8f7712aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:18:51.888753 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:18:51.888753 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:18:51.888753 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:18:51.888753 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:18:51.888753 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:18:51.888753 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:18:51.888753 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:18:51.888753 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:18:51.888753 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:18:51.888753 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:18:51.888753 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:18:51.888753 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:18:51.888753 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:18:51.888753 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:18:51.889909 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:18:51.889909 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:18:51.889909 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:18:51.889909 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:18:51.889909 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:18:51.889909 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:18:51.889909 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:18:51.889909 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:18:51.889909 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:18:51.889909 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:18:51.889909 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:18:51.889909 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:18:51.889909 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:18:51.889909 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:18:51.889909 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:18:51.889909 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:18:51.889909 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:18:51.891204 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:18:51.891204 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:18:51.891204 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:18:51.891204 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:18:51.891204 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 631/1278] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:18:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:18:51.896108 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c6238-018a-41aa-bb2f-30ecea46349e None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:51.998734 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c6238-018a-41aa-bb2f-30ecea46349e None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:52.031959 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5db62e-c2c3-4e4b-a04f-7d39bdfdfe8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:52.033217 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5db62e-c2c3-4e4b-a04f-7d39bdfdfe8b None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:52.033511 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5db62e-c2c3-4e4b-a04f-7d39bdfdfe8b None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:52.033785 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5db62e-c2c3-4e4b-a04f-7d39bdfdfe8b None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:52.034504 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5db62e-c2c3-4e4b-a04f-7d39bdfdfe8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:18:52.034812 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5db62e-c2c3-4e4b-a04f-7d39bdfdfe8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:52.036263 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5db62e-c2c3-4e4b-a04f-7d39bdfdfe8b None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:52.048695 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 648/1279] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:18:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:18:52.054573 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368d5bc-d2d5-4a32-9218-18cf8f7712aa None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:52.089359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:52.157240 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368d5bc-d2d5-4a32-9218-18cf8f7712aa None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:52.190883 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115bb4a6-cc6e-4a64-a5c3-341c14c0bcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:52.191825 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115bb4a6-cc6e-4a64-a5c3-341c14c0bcb1 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:52.192228 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115bb4a6-cc6e-4a64-a5c3-341c14c0bcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:52.192511 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115bb4a6-cc6e-4a64-a5c3-341c14c0bcb1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:52.199591 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115bb4a6-cc6e-4a64-a5c3-341c14c0bcb1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:52.201027 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115bb4a6-cc6e-4a64-a5c3-341c14c0bcb1 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:52.216143 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-115bb4a6-cc6e-4a64-a5c3-341c14c0bcb1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 19:18:52.216143 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:18:52.216143 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:18:52.216143 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:18:52.216143 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:18:52.216143 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:18:52.216143 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:18:52.216143 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:18:52.216143 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:18:52.216143 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:18:52.216143 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:18:52.216143 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:18:52.216143 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 19:18:52.216143 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 19:18:52.216143 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 19:18:52.216143 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 19:18:52.217264 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:18:52.217264 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:18:52.217264 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 19:18:52.217264 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:18:52.217264 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 19:18:52.217264 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 19:18:52.217264 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:18:52.217264 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:18:52.217264 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:18:52.217264 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:18:52.217264 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:18:52.217264 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:18:52.217264 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:18:52.217264 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:18:52.217264 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:18:52.217264 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:18:52.217264 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:18:52.217264 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:18:52.218395 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:18:52.218395 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:18:52.218395 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 19:18:52.218395 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 19:18:52.218395 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 19:18:52.218395 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 19:18:52.218395 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 19:18:52.218395 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 19:18:52.218395 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 19:18:52.218395 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:18:52.218395 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 632/1280] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:18:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 19:18:52.223881 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5db62e-c2c3-4e4b-a04f-7d39bdfdfe8b None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:52.227731 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:52.322426 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5db62e-c2c3-4e4b-a04f-7d39bdfdfe8b None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:52.357294 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034f674-8401-4ddc-9a14-98ae71f01a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:52.357896 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034f674-8401-4ddc-9a14-98ae71f01a0f None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:52.358183 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034f674-8401-4ddc-9a14-98ae71f01a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:52.358462 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034f674-8401-4ddc-9a14-98ae71f01a0f None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:52.359397 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7034f674-8401-4ddc-9a14-98ae71f01a0f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:18:52.359743 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7034f674-8401-4ddc-9a14-98ae71f01a0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:52.364317 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7034f674-8401-4ddc-9a14-98ae71f01a0f None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:52.378143 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 649/1281] 10.222.0.60 () {56 vars in 1143 bytes} [Thu Jul 21 19:18:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:18:52.384261 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115bb4a6-cc6e-4a64-a5c3-341c14c0bcb1 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:52.475229 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:52.491992 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115bb4a6-cc6e-4a64-a5c3-341c14c0bcb1 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:52.525488 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c128a07-1f32-4fb7-98b1-747a21c891c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:52.526127 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c128a07-1f32-4fb7-98b1-747a21c891c6 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:52.526410 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c128a07-1f32-4fb7-98b1-747a21c891c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:52.526685 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c128a07-1f32-4fb7-98b1-747a21c891c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:52.591279 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c128a07-1f32-4fb7-98b1-747a21c891c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:52.592829 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c128a07-1f32-4fb7-98b1-747a21c891c6 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:52.688432 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 633/1282] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Jul 21 19:18:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 19:18:52.694871 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034f674-8401-4ddc-9a14-98ae71f01a0f None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:52.697266 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:52.756163 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:52.794510 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034f674-8401-4ddc-9a14-98ae71f01a0f None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:52.828002 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900bb12-c7fd-4b48-a607-2fbb153ff9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:52.828786 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900bb12-c7fd-4b48-a607-2fbb153ff9ca None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:52.829069 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900bb12-c7fd-4b48-a607-2fbb153ff9ca None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:52.829347 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900bb12-c7fd-4b48-a607-2fbb153ff9ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:52.839800 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900bb12-c7fd-4b48-a607-2fbb153ff9ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:52.841238 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900bb12-c7fd-4b48-a607-2fbb153ff9ca None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:52.858830 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-f900bb12-c7fd-4b48-a607-2fbb153ff9ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:18:52.858830 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:18:52.858830 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:18:52.858830 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:18:52.858830 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:18:52.858830 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:18:52.858830 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:18:52.858830 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:18:52.858830 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:18:52.858830 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:18:52.858830 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:18:52.858830 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:18:52.858830 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 19:18:52.858830 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 19:18:52.858830 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 19:18:52.864465 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 19:18:52.864465 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:18:52.864465 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:18:52.864465 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:18:52.864465 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:18:52.864465 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:18:52.864465 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:18:52.864465 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:18:52.864465 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:18:52.864465 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:18:52.864465 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:18:52.864465 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:18:52.864465 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:18:52.864465 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:18:52.864465 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:18:52.864465 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:18:52.864465 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:18:52.865714 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 19:18:52.865714 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 19:18:52.865714 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 19:18:52.865714 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:18:52.865714 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 650/1283] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:18:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:18:52.866052 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c128a07-1f32-4fb7-98b1-747a21c891c6 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:52.965109 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c128a07-1f32-4fb7-98b1-747a21c891c6 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:52.997805 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c0a71-4c4c-4d86-8334-aad8f65fce60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:52.998463 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c0a71-4c4c-4d86-8334-aad8f65fce60 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:52.998749 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c0a71-4c4c-4d86-8334-aad8f65fce60 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:52.999026 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c0a71-4c4c-4d86-8334-aad8f65fce60 None admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:52.999778 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c0a71-4c4c-4d86-8334-aad8f65fce60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:18:53.000086 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c0a71-4c4c-4d86-8334-aad8f65fce60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:53.001965 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c0a71-4c4c-4d86-8334-aad8f65fce60 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:53.013091 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 634/1284] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Jul 21 19:18:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:18:53.019548 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900bb12-c7fd-4b48-a607-2fbb153ff9ca None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:53.121970 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900bb12-c7fd-4b48-a607-2fbb153ff9ca None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:53.136510 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:53.156439 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57286f81-2e91-471f-b612-124d9ef72d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:53.157225 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57286f81-2e91-471f-b612-124d9ef72d0c None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:53.157510 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57286f81-2e91-471f-b612-124d9ef72d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:53.158021 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57286f81-2e91-471f-b612-124d9ef72d0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:53.164597 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57286f81-2e91-471f-b612-124d9ef72d0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:53.166035 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57286f81-2e91-471f-b612-124d9ef72d0c None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:53.180935 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-57286f81-2e91-471f-b612-124d9ef72d0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:18:53.180935 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:18:53.180935 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:18:53.180935 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:18:53.180935 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:18:53.180935 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:18:53.180935 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:18:53.180935 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:18:53.180935 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:18:53.180935 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:18:53.180935 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:18:53.180935 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:18:53.180935 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 19:18:53.180935 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 19:18:53.180935 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 19:18:53.181977 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 19:18:53.181977 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:18:53.181977 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:18:53.181977 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:18:53.181977 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:18:53.181977 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:18:53.181977 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:18:53.181977 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:18:53.181977 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 21 19:18:53.181977 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:18:53.181977 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:18:53.181977 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:18:53.181977 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:18:53.181977 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:18:53.181977 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:18:53.181977 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:18:53.181977 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:18:53.183061 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 19:18:53.183061 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 19:18:53.183061 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 19:18:53.183061 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 19:18:53.183061 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 19:18:53.183061 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 19:18:53.183061 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 19:18:53.183061 dv-cinder-749155-9-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 21 19:18:53.183061 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 651/1285] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Jul 21 19:18:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:18:53.188251 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c0a71-4c4c-4d86-8334-aad8f65fce60 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:53.238185 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:53.287076 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c0a71-4c4c-4d86-8334-aad8f65fce60 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:53.320195 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de906eec-e475-4be7-bc03-c54956aa2d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:53.320847 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de906eec-e475-4be7-bc03-c54956aa2d1e None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:53.321129 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de906eec-e475-4be7-bc03-c54956aa2d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:53.321404 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de906eec-e475-4be7-bc03-c54956aa2d1e None admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:53.322220 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de906eec-e475-4be7-bc03-c54956aa2d1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:18:53.322528 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de906eec-e475-4be7-bc03-c54956aa2d1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:53.323980 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de906eec-e475-4be7-bc03-c54956aa2d1e None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:53.335709 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 635/1286] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Jul 21 19:18:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:18:53.341830 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57286f81-2e91-471f-b612-124d9ef72d0c None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:53.442803 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57286f81-2e91-471f-b612-124d9ef72d0c None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:53.476805 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e249a8-67fa-4642-a92f-d5f0790e22de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:53.477448 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e249a8-67fa-4642-a92f-d5f0790e22de None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:53.477730 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e249a8-67fa-4642-a92f-d5f0790e22de None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:53.478064 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e249a8-67fa-4642-a92f-d5f0790e22de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:53.478857 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e249a8-67fa-4642-a92f-d5f0790e22de None admin] RBAC: Adding query filter params (role.id=685e18230e1744c581baaf842d0fd4ca, scope.project.id=9847b5e8bc0b4483bbce060a48f405f4, user.id=bcc5eefc2f7c419190e96b46b163fedd) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:18:53.479164 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e249a8-67fa-4642-a92f-d5f0790e22de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:53.480615 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e249a8-67fa-4642-a92f-d5f0790e22de None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:53.488550 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 652/1287] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Jul 21 19:18:53 2022] GET /identity/v3/role_assignments?user.id=bcc5eefc2f7c419190e96b46b163fedd&scope.project.id=9847b5e8bc0b4483bbce060a48f405f4&role.id=685e18230e1744c581baaf842d0fd4ca => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:18:55.517676 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deba5ef-ae47-4ae1-a450-af8405b259fd None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:55.518390 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deba5ef-ae47-4ae1-a450-af8405b259fd None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:55.518390 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deba5ef-ae47-4ae1-a450-af8405b259fd None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:55.519615 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 636/1288] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:18:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:18:55.524658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddcc9b-4eb3-4370-9e82-8af89ef7c678 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:55.525078 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddcc9b-4eb3-4370-9e82-8af89ef7c678 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:55.525232 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddcc9b-4eb3-4370-9e82-8af89ef7c678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:55.542881 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-4eddcc9b-4eb3-4370-9e82-8af89ef7c678 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:18:55.544103 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-4eddcc9b-4eb3-4370-9e82-8af89ef7c678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:18:55.573476 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:55.609825 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 653/1289] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:18:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:18:55.633195 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deba5ef-ae47-4ae1-a450-af8405b259fd None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:55.734723 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deba5ef-ae47-4ae1-a450-af8405b259fd None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:55.745172 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:55.768888 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938375cb-b905-4fa3-b1e4-041d1ac4f286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:55.769702 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938375cb-b905-4fa3-b1e4-041d1ac4f286 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:55.770069 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938375cb-b905-4fa3-b1e4-041d1ac4f286 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:55.770350 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938375cb-b905-4fa3-b1e4-041d1ac4f286 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:55.770987 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938375cb-b905-4fa3-b1e4-041d1ac4f286 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:55.772387 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938375cb-b905-4fa3-b1e4-041d1ac4f286 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:55.783984 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-938375cb-b905-4fa3-b1e4-041d1ac4f286 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 19:18:55.783984 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:18:55.783984 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 19:18:55.783984 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 19:18:55.783984 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 19:18:55.783984 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 19:18:55.783984 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 19:18:55.783984 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:18:55.783984 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 19:18:55.783984 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:18:55.783984 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 19:18:55.783984 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:18:55.783984 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:18:55.783984 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:18:55.783984 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:18:55.783984 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:18:55.783984 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:18:55.785280 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:18:55.785280 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:18:55.785280 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:18:55.785280 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:18:55.785280 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:18:55.785280 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:18:55.785280 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 19:18:55.785280 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 19:18:55.785280 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 19:18:55.785280 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 19:18:55.785280 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:18:55.785280 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:18:55.785280 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:18:55.785280 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:18:55.785280 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:18:55.785280 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:18:55.786340 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:18:55.786340 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:18:55.786340 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:18:55.786340 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:18:55.786340 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:18:55.786340 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:18:55.786340 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:18:55.786340 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:18:55.786340 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:18:55.786340 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:18:55.786340 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 19:18:55.786340 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:18:55.786340 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 19:18:55.786340 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:18:55.786340 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 637/1290] 10.222.0.60 () {56 vars in 1117 bytes} [Thu Jul 21 19:18:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:18:55.791239 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eddcc9b-4eb3-4370-9e82-8af89ef7c678 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:55.895082 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eddcc9b-4eb3-4370-9e82-8af89ef7c678 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:55.927869 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0d048-d2a2-4d26-8085-36a90c3011c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:55.928495 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0d048-d2a2-4d26-8085-36a90c3011c4 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:55.928779 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0d048-d2a2-4d26-8085-36a90c3011c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:55.929056 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0d048-d2a2-4d26-8085-36a90c3011c4 None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:55.930008 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0d048-d2a2-4d26-8085-36a90c3011c4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:18:55.930317 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0d048-d2a2-4d26-8085-36a90c3011c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:55.931712 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0d048-d2a2-4d26-8085-36a90c3011c4 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:55.936497 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 654/1291] 10.222.0.60 () {56 vars in 1116 bytes} [Thu Jul 21 19:18:55 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:18:55.943011 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938375cb-b905-4fa3-b1e4-041d1ac4f286 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:56.041550 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938375cb-b905-4fa3-b1e4-041d1ac4f286 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:56.075413 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208725d-7d82-4695-acbe-6410980498ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:56.076091 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208725d-7d82-4695-acbe-6410980498ba None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:56.076379 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208725d-7d82-4695-acbe-6410980498ba None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:56.076658 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208725d-7d82-4695-acbe-6410980498ba None admin] PATH_INFO: `/v3/services` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:56.077422 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d208725d-7d82-4695-acbe-6410980498ba None admin] RBAC: Adding query filter params (type=placement) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:18:56.077733 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d208725d-7d82-4695-acbe-6410980498ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:56.079097 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d208725d-7d82-4695-acbe-6410980498ba None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:56.083514 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 638/1292] 10.222.0.60 () {56 vars in 1116 bytes} [Thu Jul 21 19:18:55 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:18:58.122689 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442d448-509d-4a9c-9d88-f7d691907cc8 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:58.123240 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442d448-509d-4a9c-9d88-f7d691907cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:58.123240 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442d448-509d-4a9c-9d88-f7d691907cc8 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:58.124653 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 655/1293] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:18:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:18:58.130058 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189a870-a31d-4c0c-915e-08ba48b63e3a None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:58.130477 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189a870-a31d-4c0c-915e-08ba48b63e3a None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:58.130620 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189a870-a31d-4c0c-915e-08ba48b63e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:58.147378 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-8189a870-a31d-4c0c-915e-08ba48b63e3a None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:18:58.148569 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-8189a870-a31d-4c0c-915e-08ba48b63e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:18:58.178966 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:58.214618 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 639/1294] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:18:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:18:58.238739 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442d448-509d-4a9c-9d88-f7d691907cc8 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:18:58.270536 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:18:58.339628 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442d448-509d-4a9c-9d88-f7d691907cc8 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:18:58.374421 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95750b3a-a166-4917-9e00-4e4de2b32690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:18:58.375051 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95750b3a-a166-4917-9e00-4e4de2b32690 None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:18:58.375395 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95750b3a-a166-4917-9e00-4e4de2b32690 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:18:58.375706 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95750b3a-a166-4917-9e00-4e4de2b32690 None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:18:58.376619 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95750b3a-a166-4917-9e00-4e4de2b32690 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:18:58.378124 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95750b3a-a166-4917-9e00-4e4de2b32690 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:18:58.468273 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 656/1295] 10.222.0.60 () {60 vars in 1141 bytes} [Thu Jul 21 19:18:58 2022] POST /identity/v3/services => generated 246 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:19:00.536081 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b9253-17cb-47d2-8de7-9542b6fc3385 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:19:00.536629 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b9253-17cb-47d2-8de7-9542b6fc3385 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:19:00.536629 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b9253-17cb-47d2-8de7-9542b6fc3385 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:19:00.537985 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 640/1296] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:19:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:19:00.543211 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a1cd0-a969-4b43-b56e-1d04928515ff None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:19:00.543658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a1cd0-a969-4b43-b56e-1d04928515ff None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:19:00.543808 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a1cd0-a969-4b43-b56e-1d04928515ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:19:00.560967 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-892a1cd0-a969-4b43-b56e-1d04928515ff None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:19:00.562149 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-892a1cd0-a969-4b43-b56e-1d04928515ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:19:00.633727 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 657/1297] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:19:00 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:19:00.656864 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b9253-17cb-47d2-8de7-9542b6fc3385 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:19:00.759913 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b9253-17cb-47d2-8de7-9542b6fc3385 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:19:00.793567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d41d27-edf8-4ee2-ae35-0924a2228854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:19:00.794359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d41d27-edf8-4ee2-ae35-0924a2228854 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:19:00.794646 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d41d27-edf8-4ee2-ae35-0924a2228854 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:19:00.794945 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d41d27-edf8-4ee2-ae35-0924a2228854 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:19:00.795636 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d41d27-edf8-4ee2-ae35-0924a2228854 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:19:00.797016 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d41d27-edf8-4ee2-ae35-0924a2228854 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:19:00.809634 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-24d41d27-edf8-4ee2-ae35-0924a2228854 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 19:19:00.809634 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:19:00.809634 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 19:19:00.809634 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 19:19:00.809634 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 19:19:00.809634 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 19:19:00.809634 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 19:19:00.809634 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:19:00.809634 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 19:19:00.809634 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:19:00.809634 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 19:19:00.809634 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:19:00.809634 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:19:00.809634 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:19:00.809634 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:19:00.809634 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:19:00.809634 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:19:00.812453 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:19:00.812453 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:19:00.812453 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:19:00.812453 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:19:00.812453 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:19:00.812453 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:19:00.812453 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 19:19:00.812453 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 19:19:00.812453 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 19:19:00.812453 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 19:19:00.812453 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:19:00.812453 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:19:00.812453 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:19:00.812453 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:19:00.812453 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:19:00.812453 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:19:00.813570 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:19:00.813570 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:19:00.813570 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:19:00.813570 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:19:00.813570 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:19:00.813570 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:19:00.813570 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:19:00.813570 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:19:00.813570 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:19:00.813570 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:19:00.813570 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 19:19:00.813570 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:19:00.813570 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 19:19:00.813570 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:19:00.813570 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 641/1298] 10.222.0.60 () {56 vars in 1117 bytes} [Thu Jul 21 19:19:00 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:19:00.817192 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a1cd0-a969-4b43-b56e-1d04928515ff None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:19:00.835423 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:19:00.918446 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a1cd0-a969-4b43-b56e-1d04928515ff None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:19:00.952817 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54210afb-d0ec-4526-94bb-f2445c148c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:19:00.953474 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54210afb-d0ec-4526-94bb-f2445c148c0c None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:19:00.953758 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54210afb-d0ec-4526-94bb-f2445c148c0c None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:19:00.954035 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54210afb-d0ec-4526-94bb-f2445c148c0c None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:19:00.955295 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54210afb-d0ec-4526-94bb-f2445c148c0c None admin] RBAC: Adding query filter params (name=placement) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:19:00.955634 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54210afb-d0ec-4526-94bb-f2445c148c0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:19:00.956991 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54210afb-d0ec-4526-94bb-f2445c148c0c None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:19:00.962069 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 658/1299] 10.222.0.60 () {56 vars in 1116 bytes} [Thu Jul 21 19:19:00 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:19:00.968037 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d41d27-edf8-4ee2-ae35-0924a2228854 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:19:00.999316 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:19:01.067408 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d41d27-edf8-4ee2-ae35-0924a2228854 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:19:01.101241 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65ca1d-ca11-423c-81e8-e19f06ccb66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:19:01.101889 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65ca1d-ca11-423c-81e8-e19f06ccb66f None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:19:01.102173 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65ca1d-ca11-423c-81e8-e19f06ccb66f None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:19:01.102449 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65ca1d-ca11-423c-81e8-e19f06ccb66f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:19:01.103226 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65ca1d-ca11-423c-81e8-e19f06ccb66f None admin] RBAC: Adding query filter params (interface=public, service_id=110f011abe5448eaaa974f4afbd8f3ac, region_id=RegionOne) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:19:01.103565 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65ca1d-ca11-423c-81e8-e19f06ccb66f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:19:01.104927 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65ca1d-ca11-423c-81e8-e19f06ccb66f None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:19:01.110061 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 642/1300] 10.222.0.60 () {56 vars in 1251 bytes} [Thu Jul 21 19:19:00 2022] GET /identity/v3/endpoints?service_id=110f011abe5448eaaa974f4afbd8f3ac&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:19:01.115970 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54210afb-d0ec-4526-94bb-f2445c148c0c None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:19:01.198197 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:19:01.216187 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54210afb-d0ec-4526-94bb-f2445c148c0c None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:19:01.249089 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1208c3-5c0a-4b25-ad39-ac4a5ef9f0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:19:01.249745 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1208c3-5c0a-4b25-ad39-ac4a5ef9f0ce None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:19:01.250029 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1208c3-5c0a-4b25-ad39-ac4a5ef9f0ce None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:19:01.250307 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1208c3-5c0a-4b25-ad39-ac4a5ef9f0ce None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:19:01.250981 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1208c3-5c0a-4b25-ad39-ac4a5ef9f0ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:19:01.252387 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1208c3-5c0a-4b25-ad39-ac4a5ef9f0ce None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:19:01.258960 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 659/1301] 10.222.0.60 () {56 vars in 1087 bytes} [Thu Jul 21 19:19:01 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:19:03.281902 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5fa8c-2853-4056-b128-a148f4f6d701 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:19:03.282551 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5fa8c-2853-4056-b128-a148f4f6d701 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:19:03.282551 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5fa8c-2853-4056-b128-a148f4f6d701 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:19:03.283878 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 643/1302] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:19:03.289097 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ad7f4-b937-4d17-a5d4-1f5f045892b7 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:19:03.289532 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ad7f4-b937-4d17-a5d4-1f5f045892b7 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:19:03.289653 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ad7f4-b937-4d17-a5d4-1f5f045892b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:19:03.306801 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-238ad7f4-b937-4d17-a5d4-1f5f045892b7 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:19:03.308076 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-238ad7f4-b937-4d17-a5d4-1f5f045892b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:19:03.374057 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 660/1303] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:19:03 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 19:19:03.397940 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5fa8c-2853-4056-b128-a148f4f6d701 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:19:03.493651 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:19:03.500234 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5fa8c-2853-4056-b128-a148f4f6d701 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:19:03.533343 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa05d1a-ab1c-4b71-ad76-27eacc921b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:19:03.533978 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa05d1a-ab1c-4b71-ad76-27eacc921b95 None admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:19:03.534259 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa05d1a-ab1c-4b71-ad76-27eacc921b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:19:03.534533 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa05d1a-ab1c-4b71-ad76-27eacc921b95 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:19:03.535309 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa05d1a-ab1c-4b71-ad76-27eacc921b95 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:19:03.536631 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa05d1a-ab1c-4b71-ad76-27eacc921b95 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:19:03.548684 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application [None req-0fa05d1a-ab1c-4b71-ad76-27eacc921b95 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 19:19:03.548684 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:19:03.548684 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 19:19:03.548684 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 19:19:03.548684 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 19:19:03.548684 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 19:19:03.548684 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 19:19:03.548684 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:19:03.548684 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 19:19:03.548684 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:19:03.548684 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 19:19:03.548684 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:19:03.548684 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 19:19:03.548684 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 19:19:03.548684 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 19:19:03.548684 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 19:19:03.548684 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 19:19:03.549975 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 19:19:03.549975 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 19:19:03.549975 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 19:19:03.549975 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 19:19:03.549975 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 19:19:03.549975 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 19:19:03.549975 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 19:19:03.549975 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 19:19:03.549975 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 19:19:03.549975 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 19:19:03.549975 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 19:19:03.549975 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 19:19:03.549975 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 19:19:03.549975 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 19:19:03.549975 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 19:19:03.549975 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 19:19:03.551059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 19:19:03.551059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application with Lock( Jul 21 19:19:03.551059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 19:19:03.551059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self._enter() Jul 21 19:19:03.551059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 19:19:03.551059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 19:19:03.551059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 19:19:03.551059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application return self.creator() Jul 21 19:19:03.551059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 19:19:03.551059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application created_value = creator( Jul 21 19:19:03.551059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 19:19:03.551059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 19:19:03.551059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 19:19:03.551059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: ERROR keystone.server.flask.application Jul 21 19:19:03.551059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 644/1304] 10.222.0.60 () {56 vars in 1117 bytes} [Thu Jul 21 19:19:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 19:19:03.556283 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ad7f4-b937-4d17-a5d4-1f5f045892b7 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:19:03.631876 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:19:03.653856 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ad7f4-b937-4d17-a5d4-1f5f045892b7 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:19:03.687299 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f1ad0-24e1-471d-a53d-7d30dae38f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:19:03.687983 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f1ad0-24e1-471d-a53d-7d30dae38f0b None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:19:03.688270 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f1ad0-24e1-471d-a53d-7d30dae38f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:19:03.688584 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f1ad0-24e1-471d-a53d-7d30dae38f0b None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:19:03.689284 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f1ad0-24e1-471d-a53d-7d30dae38f0b None admin] RBAC: Adding query filter params (name=placement) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:19:03.689670 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f1ad0-24e1-471d-a53d-7d30dae38f0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:19:03.691044 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f1ad0-24e1-471d-a53d-7d30dae38f0b None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:19:03.696199 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 661/1305] 10.222.0.60 () {56 vars in 1116 bytes} [Thu Jul 21 19:19:03 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:19:03.701909 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa05d1a-ab1c-4b71-ad76-27eacc921b95 None admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:19:03.803450 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa05d1a-ab1c-4b71-ad76-27eacc921b95 None admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:19:03.836328 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063e47f-deae-4263-9d67-2c77947eb0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:19:03.836984 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063e47f-deae-4263-9d67-2c77947eb0f2 None admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:19:03.837270 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063e47f-deae-4263-9d67-2c77947eb0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:19:03.837547 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063e47f-deae-4263-9d67-2c77947eb0f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:19:03.838316 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e063e47f-deae-4263-9d67-2c77947eb0f2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:19:03.839727 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e063e47f-deae-4263-9d67-2c77947eb0f2 None admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:19:03.942104 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 645/1306] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Jul 21 19:19:03 2022] POST /identity/v3/endpoints => generated 331 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 19:19:13.725116 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=30 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:19:13.937382 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:25:01.562592 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22125abf-4b71-46c6-9d9b-dc49e110b5a3 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:01.563769 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22125abf-4b71-46c6-9d9b-dc49e110b5a3 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:01.569564 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22125abf-4b71-46c6-9d9b-dc49e110b5a3 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:01.571311 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748de9a7-d60e-418c-9518-8d158e6af517 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:01.571803 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748de9a7-d60e-418c-9518-8d158e6af517 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:01.572106 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748de9a7-d60e-418c-9518-8d158e6af517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:01.574485 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 662/1307] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:25:01 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:25:01.670664 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-748de9a7-d60e-418c-9518-8d158e6af517 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:25:01.671929 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-748de9a7-d60e-418c-9518-8d158e6af517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:25:01.841003 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 646/1308] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:25:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:25:01.904178 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04baeff7-40e7-4095-869e-c45cb4ebfcf2 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:01.905504 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04baeff7-40e7-4095-869e-c45cb4ebfcf2 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:01.906507 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04baeff7-40e7-4095-869e-c45cb4ebfcf2 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:01.910406 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 663/1309] 10.222.0.60 () {54 vars in 965 bytes} [Thu Jul 21 19:25:01 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:25:01.919399 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8ec68-3fae-49a7-9bb3-9126011b52d7 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:01.919908 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8ec68-3fae-49a7-9bb3-9126011b52d7 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:01.920289 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8ec68-3fae-49a7-9bb3-9126011b52d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:02.028575 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-ced8ec68-3fae-49a7-9bb3-9126011b52d7 None None] MFA Rules not processed for user `b1908b2f87d5442da8ba826489cb2018`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:25:02.030023 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-ced8ec68-3fae-49a7-9bb3-9126011b52d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:25:02.054105 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:25:02.122174 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 647/1310] 10.222.0.60 () {58 vars in 1062 bytes} [Thu Jul 21 19:25:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:25:02.131068 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04baeff7-40e7-4095-869e-c45cb4ebfcf2 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:25:02.133180 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-04baeff7-40e7-4095-869e-c45cb4ebfcf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:25:02.276157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04baeff7-40e7-4095-869e-c45cb4ebfcf2 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:25:02.364388 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93f44d-e6d3-4942-82ce-895d6a653941 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:25:02.365037 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93f44d-e6d3-4942-82ce-895d6a653941 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:02.365319 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93f44d-e6d3-4942-82ce-895d6a653941 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:02.365621 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93f44d-e6d3-4942-82ce-895d6a653941 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:02.367524 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ca93f44d-e6d3-4942-82ce-895d6a653941 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:25:02.428126 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:25:02.502275 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca93f44d-e6d3-4942-82ce-895d6a653941 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:25:02.503764 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca93f44d-e6d3-4942-82ce-895d6a653941 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:25:02.526228 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 664/1311] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:25:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:25:04.909220 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb969e1d-3ff1-4c18-b692-654fb4a710d4 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:04.909750 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb969e1d-3ff1-4c18-b692-654fb4a710d4 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:04.909866 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb969e1d-3ff1-4c18-b692-654fb4a710d4 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:04.911166 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 648/1312] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:25:04.917005 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae78c85-090b-4297-8128-4bbfbe73f92c None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:04.917424 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae78c85-090b-4297-8128-4bbfbe73f92c None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:04.917573 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae78c85-090b-4297-8128-4bbfbe73f92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:04.988208 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-fae78c85-090b-4297-8128-4bbfbe73f92c None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:25:04.989403 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-fae78c85-090b-4297-8128-4bbfbe73f92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:25:05.094805 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 665/1313] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:25:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:25:05.134827 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb969e1d-3ff1-4c18-b692-654fb4a710d4 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:25:05.136467 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-fb969e1d-3ff1-4c18-b692-654fb4a710d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:25:05.249094 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb969e1d-3ff1-4c18-b692-654fb4a710d4 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:25:05.320133 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:25:05.322596 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d6a43-7686-45c2-9bc2-2cee3bb6e132 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:25:05.323243 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d6a43-7686-45c2-9bc2-2cee3bb6e132 service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:05.323567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d6a43-7686-45c2-9bc2-2cee3bb6e132 service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:05.323849 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d6a43-7686-45c2-9bc2-2cee3bb6e132 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:05.325490 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-cc4d6a43-7686-45c2-9bc2-2cee3bb6e132 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:25:05.438183 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4d6a43-7686-45c2-9bc2-2cee3bb6e132 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:25:05.439656 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4d6a43-7686-45c2-9bc2-2cee3bb6e132 service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:25:05.458571 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 649/1314] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:25:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:25:08.019842 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16005d1a-6636-4d0a-b61f-89ae12ec5e51 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:08.020389 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16005d1a-6636-4d0a-b61f-89ae12ec5e51 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:08.020502 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16005d1a-6636-4d0a-b61f-89ae12ec5e51 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:08.021979 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 666/1315] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:25:08.027206 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe084c-23ee-40d8-8f57-84b789d87fb3 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:08.027675 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe084c-23ee-40d8-8f57-84b789d87fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:08.027811 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe084c-23ee-40d8-8f57-84b789d87fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:08.094076 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-4abe084c-23ee-40d8-8f57-84b789d87fb3 None None] MFA Rules not processed for user `c85d049ff6344e709f0b3295a93105c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:25:08.095287 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-4abe084c-23ee-40d8-8f57-84b789d87fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:25:08.146572 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:25:08.192086 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 650/1316] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:25:08 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:25:08.234244 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16005d1a-6636-4d0a-b61f-89ae12ec5e51 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:25:08.236026 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-16005d1a-6636-4d0a-b61f-89ae12ec5e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:25:08.246206 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:25:08.342145 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16005d1a-6636-4d0a-b61f-89ae12ec5e51 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:25:08.415462 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430abb3-5a87-4569-963a-e20811bc2569 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:25:08.416112 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430abb3-5a87-4569-963a-e20811bc2569 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:08.416392 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430abb3-5a87-4569-963a-e20811bc2569 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:08.416664 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430abb3-5a87-4569-963a-e20811bc2569 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:08.418286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-8430abb3-5a87-4569-963a-e20811bc2569 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:25:08.482341 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:25:08.528709 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8430abb3-5a87-4569-963a-e20811bc2569 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:25:08.530184 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8430abb3-5a87-4569-963a-e20811bc2569 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:25:08.548386 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 667/1317] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:25:08 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:25:11.340509 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057dd0ab-5d63-49aa-b945-687b3bd8ba82 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:11.341107 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057dd0ab-5d63-49aa-b945-687b3bd8ba82 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:11.341107 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057dd0ab-5d63-49aa-b945-687b3bd8ba82 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:11.342423 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 651/1318] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:25:11.347681 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68e237-21bd-41b9-a0d8-7f0d1161519d None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:11.348074 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68e237-21bd-41b9-a0d8-7f0d1161519d None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:11.348248 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68e237-21bd-41b9-a0d8-7f0d1161519d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:11.415334 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-ea68e237-21bd-41b9-a0d8-7f0d1161519d None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:25:11.416540 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ea68e237-21bd-41b9-a0d8-7f0d1161519d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:25:11.515506 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 668/1319] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:25:11 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:25:11.570898 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e1a32-4f9a-4319-8b1b-94b0982257cb None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:11.571192 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e1a32-4f9a-4319-8b1b-94b0982257cb None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:11.571537 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e1a32-4f9a-4319-8b1b-94b0982257cb None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:11.572916 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 652/1320] 10.222.0.60 () {54 vars in 965 bytes} [Thu Jul 21 19:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:25:11.578718 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91a126-04ac-4fec-b7bf-6182a5f78c4e None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:11.579012 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91a126-04ac-4fec-b7bf-6182a5f78c4e None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:11.579294 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91a126-04ac-4fec-b7bf-6182a5f78c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:11.600476 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:25:11.653324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-df91a126-04ac-4fec-b7bf-6182a5f78c4e None None] MFA Rules not processed for user `b1908b2f87d5442da8ba826489cb2018`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:25:11.654507 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-df91a126-04ac-4fec-b7bf-6182a5f78c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:25:11.727970 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 669/1321] 10.222.0.60 () {58 vars in 1062 bytes} [Thu Jul 21 19:25:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:25:11.736750 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e1a32-4f9a-4319-8b1b-94b0982257cb None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:25:11.738327 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-ac1e1a32-4f9a-4319-8b1b-94b0982257cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:25:11.843977 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e1a32-4f9a-4319-8b1b-94b0982257cb None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:25:11.914088 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d119298-bc75-4964-bbea-744391922c32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:25:11.914728 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d119298-bc75-4964-bbea-744391922c32 service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:11.915010 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d119298-bc75-4964-bbea-744391922c32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:11.915282 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d119298-bc75-4964-bbea-744391922c32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:11.916924 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-8d119298-bc75-4964-bbea-744391922c32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:25:11.924073 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:25:12.024182 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d119298-bc75-4964-bbea-744391922c32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:25:12.025604 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d119298-bc75-4964-bbea-744391922c32 service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:25:12.043108 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 653/1322] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:25:11 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:25:15.577447 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2f183-914b-4c91-b98e-e4a025e33b99 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:15.577999 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2f183-914b-4c91-b98e-e4a025e33b99 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:15.577999 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2f183-914b-4c91-b98e-e4a025e33b99 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:15.579365 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 670/1323] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:25:15.584417 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e62cb-f544-421a-8a88-def873dc0642 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:15.585384 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e62cb-f544-421a-8a88-def873dc0642 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:15.585601 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e62cb-f544-421a-8a88-def873dc0642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:15.649363 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-9d3e62cb-f544-421a-8a88-def873dc0642 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:25:15.650561 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-9d3e62cb-f544-421a-8a88-def873dc0642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:25:15.706698 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:25:15.746742 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 654/1324] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:25:15.783184 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2f183-914b-4c91-b98e-e4a025e33b99 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:25:15.784785 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-e3c2f183-914b-4c91-b98e-e4a025e33b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:25:15.897715 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2f183-914b-4c91-b98e-e4a025e33b99 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:25:15.910687 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:25:15.978305 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc6143c-2b21-4af5-8978-a7e6a01e5eb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:25:15.978873 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6143c-2b21-4af5-8978-a7e6a01e5eb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:15.979158 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6143c-2b21-4af5-8978-a7e6a01e5eb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:15.979463 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6143c-2b21-4af5-8978-a7e6a01e5eb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:15.981176 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-7dc6143c-2b21-4af5-8978-a7e6a01e5eb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:25:16.093994 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc6143c-2b21-4af5-8978-a7e6a01e5eb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:25:16.095445 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc6143c-2b21-4af5-8978-a7e6a01e5eb4 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:25:16.114066 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 671/1325] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:25:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:25:18.245534 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962f669-c241-418a-8d51-b9c499bdf395 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:18.246126 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962f669-c241-418a-8d51-b9c499bdf395 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:18.246126 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962f669-c241-418a-8d51-b9c499bdf395 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:18.247634 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 655/1326] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:25:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:25:18.252812 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe5a6a-6974-4b0d-acb4-08ec697de6f4 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:18.253213 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe5a6a-6974-4b0d-acb4-08ec697de6f4 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:18.253380 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe5a6a-6974-4b0d-acb4-08ec697de6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:18.302229 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:25:18.322170 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-7fbe5a6a-6974-4b0d-acb4-08ec697de6f4 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:25:18.323288 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-7fbe5a6a-6974-4b0d-acb4-08ec697de6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:25:18.428344 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 672/1327] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:25:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:25:18.465317 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962f669-c241-418a-8d51-b9c499bdf395 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:25:18.466932 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-5962f669-c241-418a-8d51-b9c499bdf395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:25:18.572143 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962f669-c241-418a-8d51-b9c499bdf395 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:25:18.649497 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd72280-05a6-464c-a09b-0564feeac959 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:25:18.650150 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd72280-05a6-464c-a09b-0564feeac959 service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:18.650435 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd72280-05a6-464c-a09b-0564feeac959 service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:18.650714 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd72280-05a6-464c-a09b-0564feeac959 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:18.652418 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-acd72280-05a6-464c-a09b-0564feeac959 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:25:18.669110 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:25:18.766324 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd72280-05a6-464c-a09b-0564feeac959 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:25:18.767807 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd72280-05a6-464c-a09b-0564feeac959 service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:25:18.786403 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 656/1328] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:25:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:25:20.875327 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70d15a-4774-4042-8d1f-0b3f94478736 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:20.875896 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70d15a-4774-4042-8d1f-0b3f94478736 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:20.875896 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70d15a-4774-4042-8d1f-0b3f94478736 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:20.877278 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 673/1329] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:25:20.883130 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec4516-f1fd-4ff4-abe6-ff9045124d5d None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:20.883609 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec4516-f1fd-4ff4-abe6-ff9045124d5d None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:20.883976 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec4516-f1fd-4ff4-abe6-ff9045124d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:20.954215 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-1aec4516-f1fd-4ff4-abe6-ff9045124d5d None None] MFA Rules not processed for user `c85d049ff6344e709f0b3295a93105c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:25:20.955426 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-1aec4516-f1fd-4ff4-abe6-ff9045124d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:25:21.022570 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:25:21.055781 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 657/1330] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:25:20 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:25:21.093768 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70d15a-4774-4042-8d1f-0b3f94478736 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:25:21.095280 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-4b70d15a-4774-4042-8d1f-0b3f94478736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:25:21.204138 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70d15a-4774-4042-8d1f-0b3f94478736 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:25:21.225114 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:25:21.279893 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fee38d-912c-4998-95db-d7146b66a829 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:25:21.280464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fee38d-912c-4998-95db-d7146b66a829 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:21.280747 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fee38d-912c-4998-95db-d7146b66a829 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:21.281022 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fee38d-912c-4998-95db-d7146b66a829 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:21.282668 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-b2fee38d-912c-4998-95db-d7146b66a829 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:25:21.394274 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fee38d-912c-4998-95db-d7146b66a829 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:25:21.395881 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fee38d-912c-4998-95db-d7146b66a829 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:25:21.415331 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 674/1331] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:25:21 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:25:23.976699 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a88bc7-34ee-43d5-a242-e2311fd3d661 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:23.977245 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a88bc7-34ee-43d5-a242-e2311fd3d661 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:23.977245 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a88bc7-34ee-43d5-a242-e2311fd3d661 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:23.978521 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 658/1332] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:25:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:25:23.983778 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c0449-a131-4031-968e-dbb3fbec34af None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:23.984160 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c0449-a131-4031-968e-dbb3fbec34af None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:23.984337 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c0449-a131-4031-968e-dbb3fbec34af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:24.047273 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:25:24.049948 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-6b7c0449-a131-4031-968e-dbb3fbec34af None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:25:24.051153 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-6b7c0449-a131-4031-968e-dbb3fbec34af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:25:24.146503 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 675/1333] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:25:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:25:24.187717 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a88bc7-34ee-43d5-a242-e2311fd3d661 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:25:24.187717 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-85a88bc7-34ee-43d5-a242-e2311fd3d661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:25:24.287958 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a88bc7-34ee-43d5-a242-e2311fd3d661 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:25:24.359322 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d3310-f5ce-4f07-9040-c4b4dc829ef3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:25:24.359992 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d3310-f5ce-4f07-9040-c4b4dc829ef3 service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:24.360278 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d3310-f5ce-4f07-9040-c4b4dc829ef3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:24.360556 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d3310-f5ce-4f07-9040-c4b4dc829ef3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:24.362182 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-9f2d3310-f5ce-4f07-9040-c4b4dc829ef3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:25:24.390187 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:25:24.470976 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d3310-f5ce-4f07-9040-c4b4dc829ef3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:25:24.472431 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d3310-f5ce-4f07-9040-c4b4dc829ef3 service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:25:24.489845 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 659/1334] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:25:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:25:26.553664 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bc31f-2ac0-4b7d-a826-6aae9a20427b None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:26.554192 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bc31f-2ac0-4b7d-a826-6aae9a20427b None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:26.554285 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bc31f-2ac0-4b7d-a826-6aae9a20427b None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:26.555638 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 676/1335] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:25:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:25:26.561080 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d464c-476f-479c-bcf8-eefebb1f2056 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:26.561466 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d464c-476f-479c-bcf8-eefebb1f2056 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:26.561640 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d464c-476f-479c-bcf8-eefebb1f2056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:26.624151 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-968d464c-476f-479c-bcf8-eefebb1f2056 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:25:26.625348 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-968d464c-476f-479c-bcf8-eefebb1f2056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:25:26.698479 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:25:26.720284 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 660/1336] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:25:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:25:26.760886 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0bc31f-2ac0-4b7d-a826-6aae9a20427b None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:25:26.762410 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3f0bc31f-2ac0-4b7d-a826-6aae9a20427b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:25:26.866143 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0bc31f-2ac0-4b7d-a826-6aae9a20427b None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:25:26.894290 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:25:26.939122 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75339218-5ae8-4095-a83e-ae4296b4e971 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:25:26.939795 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75339218-5ae8-4095-a83e-ae4296b4e971 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:26.940075 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75339218-5ae8-4095-a83e-ae4296b4e971 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:26.940347 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75339218-5ae8-4095-a83e-ae4296b4e971 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:26.941968 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-75339218-5ae8-4095-a83e-ae4296b4e971 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:25:27.049335 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75339218-5ae8-4095-a83e-ae4296b4e971 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:25:27.050684 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75339218-5ae8-4095-a83e-ae4296b4e971 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:25:27.069914 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 677/1337] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:25:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:25:29.690989 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85971458-0717-4e90-b76f-9d7737e58c48 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:29.691623 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85971458-0717-4e90-b76f-9d7737e58c48 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:29.691623 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85971458-0717-4e90-b76f-9d7737e58c48 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:29.692837 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 661/1338] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:25:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:25:29.698050 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e7d23-c9c0-45f0-8b0e-516e56b8344e None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:29.698487 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e7d23-c9c0-45f0-8b0e-516e56b8344e None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:29.698607 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e7d23-c9c0-45f0-8b0e-516e56b8344e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:29.762534 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-326e7d23-c9c0-45f0-8b0e-516e56b8344e None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:25:29.763776 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-326e7d23-c9c0-45f0-8b0e-516e56b8344e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:25:29.772458 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:25:29.861203 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 678/1339] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:25:29 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:25:29.897903 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85971458-0717-4e90-b76f-9d7737e58c48 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:25:29.899412 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-85971458-0717-4e90-b76f-9d7737e58c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:25:30.000938 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85971458-0717-4e90-b76f-9d7737e58c48 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:25:30.073331 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c05be-50e7-413b-bd7e-74643a69370a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:25:30.073974 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c05be-50e7-413b-bd7e-74643a69370a service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:30.074255 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c05be-50e7-413b-bd7e-74643a69370a service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:30.074527 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c05be-50e7-413b-bd7e-74643a69370a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:30.076191 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-913c05be-50e7-413b-bd7e-74643a69370a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:25:30.110883 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:25:30.182010 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c05be-50e7-413b-bd7e-74643a69370a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:25:30.183428 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c05be-50e7-413b-bd7e-74643a69370a service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:25:30.203529 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 662/1340] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:25:29 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:25:34.543480 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c333231-a2ac-4918-be7c-111772e65d92 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:34.544040 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c333231-a2ac-4918-be7c-111772e65d92 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:34.544209 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c333231-a2ac-4918-be7c-111772e65d92 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:34.545694 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 679/1341] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:25:34.551125 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc52f2-e7eb-4097-a336-b5d1f05540e0 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:34.551615 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc52f2-e7eb-4097-a336-b5d1f05540e0 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:34.551937 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc52f2-e7eb-4097-a336-b5d1f05540e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:34.625043 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-d8cc52f2-e7eb-4097-a336-b5d1f05540e0 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:25:34.626348 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-d8cc52f2-e7eb-4097-a336-b5d1f05540e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:25:34.716817 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:25:34.727824 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 663/1342] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:25:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:25:34.767127 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c333231-a2ac-4918-be7c-111772e65d92 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:25:34.768719 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-7c333231-a2ac-4918-be7c-111772e65d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:25:34.873562 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c333231-a2ac-4918-be7c-111772e65d92 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:25:34.912053 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:25:34.949948 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f2f6b1-7ab0-47e2-a9bc-dbe22bef0925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:25:34.950602 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2f6b1-7ab0-47e2-a9bc-dbe22bef0925 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:34.950888 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2f6b1-7ab0-47e2-a9bc-dbe22bef0925 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:34.951166 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2f6b1-7ab0-47e2-a9bc-dbe22bef0925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:34.952870 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-56f2f6b1-7ab0-47e2-a9bc-dbe22bef0925 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:25:35.062986 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f2f6b1-7ab0-47e2-a9bc-dbe22bef0925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:25:35.064410 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f2f6b1-7ab0-47e2-a9bc-dbe22bef0925 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:25:35.083832 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 680/1343] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:25:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:25:38.153700 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af19e3-078f-4307-8694-90c46e85b3d0 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:38.154280 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af19e3-078f-4307-8694-90c46e85b3d0 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:38.154280 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af19e3-078f-4307-8694-90c46e85b3d0 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:38.155641 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 664/1344] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:25:38.160895 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0a8c9-080d-4ed1-b9bc-07ae79d1d3a0 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:38.161391 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0a8c9-080d-4ed1-b9bc-07ae79d1d3a0 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:38.161506 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0a8c9-080d-4ed1-b9bc-07ae79d1d3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:38.227308 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-04e0a8c9-080d-4ed1-b9bc-07ae79d1d3a0 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:25:38.228444 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-04e0a8c9-080d-4ed1-b9bc-07ae79d1d3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:25:38.246438 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:25:38.326416 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 681/1345] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:25:38 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:25:38.365044 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af19e3-078f-4307-8694-90c46e85b3d0 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:25:38.366628 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-43af19e3-078f-4307-8694-90c46e85b3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:25:38.472514 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af19e3-078f-4307-8694-90c46e85b3d0 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:25:38.546454 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57539c1-ec38-4959-ad64-267d54d6dfa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:25:38.547026 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57539c1-ec38-4959-ad64-267d54d6dfa5 service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:38.547308 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57539c1-ec38-4959-ad64-267d54d6dfa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:38.547616 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57539c1-ec38-4959-ad64-267d54d6dfa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:38.549255 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-c57539c1-ec38-4959-ad64-267d54d6dfa5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:25:38.594857 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:25:38.669168 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57539c1-ec38-4959-ad64-267d54d6dfa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:25:38.670621 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57539c1-ec38-4959-ad64-267d54d6dfa5 service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:25:38.690969 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 665/1346] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:25:38 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:25:42.924660 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafb958-af18-4232-a27a-0da2ba13a0b9 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:42.925268 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafb958-af18-4232-a27a-0da2ba13a0b9 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:42.925268 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafb958-af18-4232-a27a-0da2ba13a0b9 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:42.926602 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 682/1347] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:25:42.932994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da724a-0519-45eb-9d91-01038e8bfd48 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:42.933524 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da724a-0519-45eb-9d91-01038e8bfd48 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:42.933524 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da724a-0519-45eb-9d91-01038e8bfd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:43.003817 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-a2da724a-0519-45eb-9d91-01038e8bfd48 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:25:43.005153 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-a2da724a-0519-45eb-9d91-01038e8bfd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:25:43.102648 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:25:43.105668 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 666/1348] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:25:43.144356 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbafb958-af18-4232-a27a-0da2ba13a0b9 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:25:43.145895 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-bbafb958-af18-4232-a27a-0da2ba13a0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:25:43.253490 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbafb958-af18-4232-a27a-0da2ba13a0b9 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:25:43.307142 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:25:43.334269 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9068bcd3-e6a0-4abf-a7e3-4b05a4b1a341 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:25:43.335010 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9068bcd3-e6a0-4abf-a7e3-4b05a4b1a341 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:43.335296 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9068bcd3-e6a0-4abf-a7e3-4b05a4b1a341 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:43.335618 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9068bcd3-e6a0-4abf-a7e3-4b05a4b1a341 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:43.337320 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-9068bcd3-e6a0-4abf-a7e3-4b05a4b1a341 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:25:43.447675 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9068bcd3-e6a0-4abf-a7e3-4b05a4b1a341 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:25:43.449118 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9068bcd3-e6a0-4abf-a7e3-4b05a4b1a341 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:25:43.467639 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 683/1349] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:25:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:25:48.417927 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25e16e-b81f-483c-a9b1-924e9b9f8144 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:48.418425 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25e16e-b81f-483c-a9b1-924e9b9f8144 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:48.418425 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25e16e-b81f-483c-a9b1-924e9b9f8144 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:48.429348 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 667/1350] 10.222.0.60 () {54 vars in 921 bytes} [Thu Jul 21 19:25:48 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:25:48.448158 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcad252-0a23-4035-8857-199b1997892c None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:48.448602 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcad252-0a23-4035-8857-199b1997892c None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:48.448793 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcad252-0a23-4035-8857-199b1997892c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:48.654280 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-9fcad252-0a23-4035-8857-199b1997892c None None] MFA Rules not processed for user `bcc5eefc2f7c419190e96b46b163fedd`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:25:48.660219 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-9fcad252-0a23-4035-8857-199b1997892c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:25:48.694674 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:25:48.929965 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 684/1351] 10.222.0.60 () {58 vars in 1018 bytes} [Thu Jul 21 19:25:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 483 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:25:52.905293 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae430591-f15e-4bb6-9940-f856fb9be73d None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:52.905856 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae430591-f15e-4bb6-9940-f856fb9be73d None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:52.905856 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae430591-f15e-4bb6-9940-f856fb9be73d None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:52.907448 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 668/1352] 10.222.0.60 () {54 vars in 921 bytes} [Thu Jul 21 19:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:25:52.913265 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5548e68-689f-42d1-881d-40dfe73b38a5 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:52.913718 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5548e68-689f-42d1-881d-40dfe73b38a5 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:52.913944 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5548e68-689f-42d1-881d-40dfe73b38a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:52.991658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-b5548e68-689f-42d1-881d-40dfe73b38a5 None None] MFA Rules not processed for user `bcc5eefc2f7c419190e96b46b163fedd`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:25:52.992863 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-b5548e68-689f-42d1-881d-40dfe73b38a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:25:53.069504 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:25:53.105130 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 685/1353] 10.222.0.60 () {58 vars in 1018 bytes} [Thu Jul 21 19:25:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:25:54.582767 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0688cf8-9f83-4aea-b8d6-1dadd83ae295 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:54.583387 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0688cf8-9f83-4aea-b8d6-1dadd83ae295 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:54.583387 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0688cf8-9f83-4aea-b8d6-1dadd83ae295 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:54.584939 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 669/1354] 10.222.0.60 () {54 vars in 921 bytes} [Thu Jul 21 19:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:25:54.590310 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88762c-895e-42da-9a1b-f9599aec8acc None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:54.592390 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88762c-895e-42da-9a1b-f9599aec8acc None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:54.592390 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88762c-895e-42da-9a1b-f9599aec8acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:54.667197 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-4e88762c-895e-42da-9a1b-f9599aec8acc None None] MFA Rules not processed for user `bcc5eefc2f7c419190e96b46b163fedd`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:25:54.668445 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-4e88762c-895e-42da-9a1b-f9599aec8acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:25:54.784444 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 686/1355] 10.222.0.60 () {58 vars in 1018 bytes} [Thu Jul 21 19:25:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:25:58.095912 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd994605-6000-4421-b5ca-bb33f7756a1c None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:58.096877 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd994605-6000-4421-b5ca-bb33f7756a1c None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:58.097374 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd994605-6000-4421-b5ca-bb33f7756a1c None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:58.099400 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 670/1356] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:25:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:25:58.105130 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85afad-d5ca-4f02-bf77-1320990096d0 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:58.106056 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85afad-d5ca-4f02-bf77-1320990096d0 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:58.106544 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85afad-d5ca-4f02-bf77-1320990096d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:58.154895 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:25:58.191347 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-4b85afad-d5ca-4f02-bf77-1320990096d0 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:25:58.193372 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-4b85afad-d5ca-4f02-bf77-1320990096d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:25:58.297305 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 687/1357] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:25:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:25:58.354710 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3c87a-d83f-4e0b-9dbb-c5ca49ab8426 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:58.354999 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3c87a-d83f-4e0b-9dbb-c5ca49ab8426 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:58.355344 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3c87a-d83f-4e0b-9dbb-c5ca49ab8426 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:58.356650 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 671/1358] 10.222.0.60 () {54 vars in 962 bytes} [Thu Jul 21 19:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:25:58.366107 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29b7dc-de18-4c66-9a08-d8df72f249ac None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:58.366251 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29b7dc-de18-4c66-9a08-d8df72f249ac None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:58.366507 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29b7dc-de18-4c66-9a08-d8df72f249ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:58.453607 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-9c29b7dc-de18-4c66-9a08-d8df72f249ac None None] MFA Rules not processed for user `6b4d98e967814e5f84f5f0d67ebb3c17`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:25:58.454859 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-9c29b7dc-de18-4c66-9a08-d8df72f249ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:25:58.512109 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:25:58.592801 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 688/1359] 10.222.0.60 () {58 vars in 1059 bytes} [Thu Jul 21 19:25:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:25:58.600831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3c87a-d83f-4e0b-9dbb-c5ca49ab8426 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:25:58.603464 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-eda3c87a-d83f-4e0b-9dbb-c5ca49ab8426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:25:58.772094 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3c87a-d83f-4e0b-9dbb-c5ca49ab8426 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:25:58.851269 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:25:58.894823 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd8be0-8720-46c5-9286-31e4348959fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:25:58.895550 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd8be0-8720-46c5-9286-31e4348959fe service nova] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:25:58.895824 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd8be0-8720-46c5-9286-31e4348959fe service nova] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:25:58.896106 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd8be0-8720-46c5-9286-31e4348959fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:25:58.897749 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-03dd8be0-8720-46c5-9286-31e4348959fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:25:58.992833 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd8be0-8720-46c5-9286-31e4348959fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:25:58.994426 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd8be0-8720-46c5-9286-31e4348959fe service nova] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:25:59.013808 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 672/1360] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:25:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:26:01.285283 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee38ca8-86ec-46a5-8b02-08c691efe48e None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:01.285822 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee38ca8-86ec-46a5-8b02-08c691efe48e None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:01.285822 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee38ca8-86ec-46a5-8b02-08c691efe48e None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:01.288293 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 689/1361] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:26:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:26:01.293748 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b85afb-2e4b-465c-a52a-585a83fa57f9 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:01.294237 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b85afb-2e4b-465c-a52a-585a83fa57f9 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:01.294430 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b85afb-2e4b-465c-a52a-585a83fa57f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:01.363803 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-b0b85afb-2e4b-465c-a52a-585a83fa57f9 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:26:01.365263 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-b0b85afb-2e4b-465c-a52a-585a83fa57f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:01.403597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:26:01.469017 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 673/1362] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:26:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:26:01.513503 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee38ca8-86ec-46a5-8b02-08c691efe48e None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:26:01.515142 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-5ee38ca8-86ec-46a5-8b02-08c691efe48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:01.694696 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee38ca8-86ec-46a5-8b02-08c691efe48e None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:26:01.705279 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:26:01.842507 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb2aa1-98b5-4b8a-836f-4d89c23ebf82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:26:01.843256 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb2aa1-98b5-4b8a-836f-4d89c23ebf82 service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:01.843663 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb2aa1-98b5-4b8a-836f-4d89c23ebf82 service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:01.844038 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb2aa1-98b5-4b8a-836f-4d89c23ebf82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:01.845754 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-78eb2aa1-98b5-4b8a-836f-4d89c23ebf82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:01.943607 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb2aa1-98b5-4b8a-836f-4d89c23ebf82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:26:01.945200 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb2aa1-98b5-4b8a-836f-4d89c23ebf82 service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:26:01.968986 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 690/1363] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:26:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:26:04.551189 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec21d9b-ebf1-4658-91fa-651bf0621278 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:04.552852 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec21d9b-ebf1-4658-91fa-651bf0621278 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:04.553217 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec21d9b-ebf1-4658-91fa-651bf0621278 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:04.554957 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 674/1364] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:26:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:26:04.560844 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7e12e-eecd-42c3-9f83-c4b76efa2c6a None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:04.561323 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7e12e-eecd-42c3-9f83-c4b76efa2c6a None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:04.561430 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7e12e-eecd-42c3-9f83-c4b76efa2c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:04.578491 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:26:04.637036 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-6cb7e12e-eecd-42c3-9f83-c4b76efa2c6a None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:26:04.638288 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-6cb7e12e-eecd-42c3-9f83-c4b76efa2c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:04.741577 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 691/1365] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:26:04.788003 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0552b22-0b93-4d41-af9a-a76b591d633c None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:04.788298 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0552b22-0b93-4d41-af9a-a76b591d633c None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:04.788577 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0552b22-0b93-4d41-af9a-a76b591d633c None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:04.789950 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 675/1366] 10.222.0.60 () {54 vars in 962 bytes} [Thu Jul 21 19:26:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:26:04.795187 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0eae6-e25d-4a73-bb59-5627631b73a9 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:04.795518 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0eae6-e25d-4a73-bb59-5627631b73a9 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:04.795801 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0eae6-e25d-4a73-bb59-5627631b73a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:04.875030 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-ccc0eae6-e25d-4a73-bb59-5627631b73a9 None None] MFA Rules not processed for user `6b4d98e967814e5f84f5f0d67ebb3c17`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:26:04.876371 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ccc0eae6-e25d-4a73-bb59-5627631b73a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:04.913436 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:26:05.010058 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 692/1367] 10.222.0.60 () {58 vars in 1059 bytes} [Thu Jul 21 19:26:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:26:05.011191 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0552b22-0b93-4d41-af9a-a76b591d633c None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:26:05.013042 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-b0552b22-0b93-4d41-af9a-a76b591d633c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:05.172257 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0552b22-0b93-4d41-af9a-a76b591d633c None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:26:05.194706 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:26:05.291087 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16936290-f0ec-4219-a874-71443d4ec314 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:26:05.292425 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16936290-f0ec-4219-a874-71443d4ec314 service nova] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:05.292809 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16936290-f0ec-4219-a874-71443d4ec314 service nova] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:05.293601 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16936290-f0ec-4219-a874-71443d4ec314 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:05.295372 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-16936290-f0ec-4219-a874-71443d4ec314 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:05.389415 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16936290-f0ec-4219-a874-71443d4ec314 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:26:05.391155 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16936290-f0ec-4219-a874-71443d4ec314 service nova] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:26:05.410134 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 676/1368] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:26:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:26:06.387353 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14136d12-71b0-4fec-b451-301d4b828f5d None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:06.387948 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14136d12-71b0-4fec-b451-301d4b828f5d None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:06.387948 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14136d12-71b0-4fec-b451-301d4b828f5d None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:06.389360 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 693/1369] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:26:06.394757 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7fad0-6f1b-45b5-bca8-21b686e620db None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:06.395212 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7fad0-6f1b-45b5-bca8-21b686e620db None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:06.396257 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7fad0-6f1b-45b5-bca8-21b686e620db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:06.432342 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:26:06.468133 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-efd7fad0-6f1b-45b5-bca8-21b686e620db None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:26:06.469345 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-efd7fad0-6f1b-45b5-bca8-21b686e620db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:06.570327 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 677/1370] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:26:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:26:06.880622 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d24f1-4812-4f26-ac93-87689adeacd1 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:06.880924 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d24f1-4812-4f26-ac93-87689adeacd1 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:06.881195 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d24f1-4812-4f26-ac93-87689adeacd1 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:06.882715 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 694/1371] 10.222.0.60 () {54 vars in 964 bytes} [Thu Jul 21 19:26:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:26:06.887370 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100d1b4-6b2b-4a48-8b7b-6f93467fe0c9 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:06.887703 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100d1b4-6b2b-4a48-8b7b-6f93467fe0c9 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:06.887984 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100d1b4-6b2b-4a48-8b7b-6f93467fe0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:06.964995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-c100d1b4-6b2b-4a48-8b7b-6f93467fe0c9 None None] MFA Rules not processed for user `591016b95ab24d3a8de83089a141d914`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:26:06.966201 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-c100d1b4-6b2b-4a48-8b7b-6f93467fe0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:07.028828 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:26:07.058859 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 678/1372] 10.222.0.60 () {58 vars in 1061 bytes} [Thu Jul 21 19:26:06 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:26:07.066600 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d24f1-4812-4f26-ac93-87689adeacd1 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:26:07.068984 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ea9d24f1-4812-4f26-ac93-87689adeacd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:07.190196 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d24f1-4812-4f26-ac93-87689adeacd1 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:26:07.233842 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:26:07.271878 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7e718-7eaf-4246-8d1f-1e013ea32325 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:26:07.272685 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7e718-7eaf-4246-8d1f-1e013ea32325 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:07.273116 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7e718-7eaf-4246-8d1f-1e013ea32325 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:07.273472 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7e718-7eaf-4246-8d1f-1e013ea32325 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:07.275243 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-84b7e718-7eaf-4246-8d1f-1e013ea32325 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:07.391842 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b7e718-7eaf-4246-8d1f-1e013ea32325 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:26:07.393924 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b7e718-7eaf-4246-8d1f-1e013ea32325 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:26:07.414466 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 695/1373] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:26:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:26:07.667577 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f493c7-128f-4a67-bb3c-36460466af3b None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:07.668068 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f493c7-128f-4a67-bb3c-36460466af3b None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:07.668447 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f493c7-128f-4a67-bb3c-36460466af3b None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:07.669465 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 679/1374] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:26:07.676071 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee153720-ffd2-4e86-b2a0-3690a4743bd6 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:07.677215 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee153720-ffd2-4e86-b2a0-3690a4743bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:07.677760 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee153720-ffd2-4e86-b2a0-3690a4743bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:07.754229 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-ee153720-ffd2-4e86-b2a0-3690a4743bd6 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:26:07.756036 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ee153720-ffd2-4e86-b2a0-3690a4743bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:07.777075 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:26:07.867478 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 696/1375] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:26:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:26:07.911957 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f493c7-128f-4a67-bb3c-36460466af3b None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:26:07.913755 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-47f493c7-128f-4a67-bb3c-36460466af3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:08.060695 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f493c7-128f-4a67-bb3c-36460466af3b None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:26:08.112901 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:26:08.173073 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf6076-ec58-499e-9bea-5bdff4ea9016 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:26:08.173718 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf6076-ec58-499e-9bea-5bdff4ea9016 service nova] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:08.174009 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf6076-ec58-499e-9bea-5bdff4ea9016 service nova] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:08.174290 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf6076-ec58-499e-9bea-5bdff4ea9016 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:08.176093 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-4dbf6076-ec58-499e-9bea-5bdff4ea9016 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:08.268759 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf6076-ec58-499e-9bea-5bdff4ea9016 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:26:08.270872 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf6076-ec58-499e-9bea-5bdff4ea9016 service nova] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:26:08.289287 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 680/1376] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:26:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:26:10.456662 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85e403-eda8-4cce-b9b3-c1848e8e8f07 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:10.457524 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85e403-eda8-4cce-b9b3-c1848e8e8f07 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:10.457840 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85e403-eda8-4cce-b9b3-c1848e8e8f07 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:10.459396 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 697/1377] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:26:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:26:10.465067 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a73bb5-bbab-48cd-835b-bd3d7f77a6e7 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:10.465512 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a73bb5-bbab-48cd-835b-bd3d7f77a6e7 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:10.465630 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a73bb5-bbab-48cd-835b-bd3d7f77a6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:10.546222 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-f5a73bb5-bbab-48cd-835b-bd3d7f77a6e7 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:26:10.547859 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-f5a73bb5-bbab-48cd-835b-bd3d7f77a6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:10.558542 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:26:10.652816 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 681/1378] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:26:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:26:10.697695 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85e403-eda8-4cce-b9b3-c1848e8e8f07 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:26:10.699302 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-9a85e403-eda8-4cce-b9b3-c1848e8e8f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:10.849952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85e403-eda8-4cce-b9b3-c1848e8e8f07 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:26:10.853766 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:26:10.984814 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dbae86-6f81-47cf-ab34-7885111355df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:26:10.986294 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbae86-6f81-47cf-ab34-7885111355df service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:10.986587 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbae86-6f81-47cf-ab34-7885111355df service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:10.987087 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbae86-6f81-47cf-ab34-7885111355df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:10.989811 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-03dbae86-6f81-47cf-ab34-7885111355df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:11.108976 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dbae86-6f81-47cf-ab34-7885111355df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:26:11.110546 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dbae86-6f81-47cf-ab34-7885111355df service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:26:11.134887 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 698/1379] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:26:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:26:13.359971 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24b2e6-e01f-4c12-a3f6-66ca953fd5dc None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:13.360462 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24b2e6-e01f-4c12-a3f6-66ca953fd5dc None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:13.360552 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24b2e6-e01f-4c12-a3f6-66ca953fd5dc None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:13.362210 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 682/1380] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:26:13.367657 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d443c95-408b-4158-96d9-7cc74a66f43d None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:13.368099 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d443c95-408b-4158-96d9-7cc74a66f43d None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:13.368297 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d443c95-408b-4158-96d9-7cc74a66f43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:13.378495 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:26:13.448440 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-5d443c95-408b-4158-96d9-7cc74a66f43d None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:26:13.449744 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-5d443c95-408b-4158-96d9-7cc74a66f43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:13.555114 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 699/1381] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:26:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:26:13.600216 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24b2e6-e01f-4c12-a3f6-66ca953fd5dc None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:26:13.601736 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-4e24b2e6-e01f-4c12-a3f6-66ca953fd5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:13.748652 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:26:13.759456 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24b2e6-e01f-4c12-a3f6-66ca953fd5dc None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:26:13.903723 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516b789-7a5a-405a-a7d1-eaa4e468b582 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:26:13.904415 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516b789-7a5a-405a-a7d1-eaa4e468b582 service nova] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:13.904706 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516b789-7a5a-405a-a7d1-eaa4e468b582 service nova] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:13.904985 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516b789-7a5a-405a-a7d1-eaa4e468b582 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:13.906927 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-3516b789-7a5a-405a-a7d1-eaa4e468b582 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:14.013383 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3516b789-7a5a-405a-a7d1-eaa4e468b582 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:26:14.014980 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3516b789-7a5a-405a-a7d1-eaa4e468b582 service nova] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:26:14.026583 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:26:14.036827 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 683/1382] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:26:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:26:16.249437 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d1b10-4a03-41c3-ab6d-a96777699d60 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:16.250009 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d1b10-4a03-41c3-ab6d-a96777699d60 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:16.250009 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d1b10-4a03-41c3-ab6d-a96777699d60 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:16.251331 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 700/1383] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:26:16.257130 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bcbf4d-5845-4c20-ada8-d96be13f6fd4 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:16.257542 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bcbf4d-5845-4c20-ada8-d96be13f6fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:16.257756 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bcbf4d-5845-4c20-ada8-d96be13f6fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:16.331145 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-10bcbf4d-5845-4c20-ada8-d96be13f6fd4 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:26:16.332756 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-10bcbf4d-5845-4c20-ada8-d96be13f6fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:16.438141 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 684/1384] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:26:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:26:16.482395 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d1b10-4a03-41c3-ab6d-a96777699d60 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:26:16.483982 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-761d1b10-4a03-41c3-ab6d-a96777699d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:16.570836 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:26:16.635400 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d1b10-4a03-41c3-ab6d-a96777699d60 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:26:16.762653 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa1577-3764-4821-965e-fb530dfe7012 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:26:16.763480 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa1577-3764-4821-965e-fb530dfe7012 service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:16.764085 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa1577-3764-4821-965e-fb530dfe7012 service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:16.764459 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa1577-3764-4821-965e-fb530dfe7012 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:16.766791 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-12fa1577-3764-4821-965e-fb530dfe7012 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:16.830739 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:26:16.875903 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fa1577-3764-4821-965e-fb530dfe7012 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:26:16.877777 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fa1577-3764-4821-965e-fb530dfe7012 service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:26:16.896341 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 701/1385] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:26:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:26:19.039788 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e849d6-7a23-4e9a-9d9a-078c26846ef8 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:19.040390 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e849d6-7a23-4e9a-9d9a-078c26846ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:19.040390 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e849d6-7a23-4e9a-9d9a-078c26846ef8 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:19.041710 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 685/1386] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:26:19.047102 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c3ffe-b7c6-44ee-8884-4b0b9a40edb0 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:19.049174 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c3ffe-b7c6-44ee-8884-4b0b9a40edb0 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:19.049174 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c3ffe-b7c6-44ee-8884-4b0b9a40edb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:19.122694 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-485c3ffe-b7c6-44ee-8884-4b0b9a40edb0 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:26:19.124615 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-485c3ffe-b7c6-44ee-8884-4b0b9a40edb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:19.240751 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 702/1387] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:26:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:26:19.286896 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e849d6-7a23-4e9a-9d9a-078c26846ef8 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:26:19.288401 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-60e849d6-7a23-4e9a-9d9a-078c26846ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:19.370922 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:26:19.447190 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e849d6-7a23-4e9a-9d9a-078c26846ef8 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:26:19.571583 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b3c1c1-36f9-41f5-a6aa-7dd41f2edc4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:26:19.572167 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3c1c1-36f9-41f5-a6aa-7dd41f2edc4f service nova] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:19.572454 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3c1c1-36f9-41f5-a6aa-7dd41f2edc4f service nova] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:19.572735 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3c1c1-36f9-41f5-a6aa-7dd41f2edc4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:19.574396 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-e1b3c1c1-36f9-41f5-a6aa-7dd41f2edc4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:19.615391 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:26:19.668824 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b3c1c1-36f9-41f5-a6aa-7dd41f2edc4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:26:19.670941 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b3c1c1-36f9-41f5-a6aa-7dd41f2edc4f service nova] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:26:19.694051 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 686/1388] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:26:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:26:21.874197 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fdeeb-43bf-473c-9f62-685d97c406b6 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:21.874739 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fdeeb-43bf-473c-9f62-685d97c406b6 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:21.874739 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fdeeb-43bf-473c-9f62-685d97c406b6 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:21.876194 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 703/1389] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:26:21.882208 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e902f-4103-4d4e-a329-0fd47e1f0d82 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:21.882777 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e902f-4103-4d4e-a329-0fd47e1f0d82 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:21.882870 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e902f-4103-4d4e-a329-0fd47e1f0d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:21.949004 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-a08e902f-4103-4d4e-a329-0fd47e1f0d82 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:26:21.950222 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-a08e902f-4103-4d4e-a329-0fd47e1f0d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:22.047233 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 687/1390] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:26:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:26:22.092896 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17fdeeb-43bf-473c-9f62-685d97c406b6 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:26:22.094509 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-c17fdeeb-43bf-473c-9f62-685d97c406b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:22.125157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:26:22.244619 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17fdeeb-43bf-473c-9f62-685d97c406b6 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:26:22.354518 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:26:22.366527 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1758b0e-beb3-4731-b243-c82b1b5786be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:26:22.367424 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1758b0e-beb3-4731-b243-c82b1b5786be service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:22.370751 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1758b0e-beb3-4731-b243-c82b1b5786be service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:22.370751 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1758b0e-beb3-4731-b243-c82b1b5786be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:22.370751 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-b1758b0e-beb3-4731-b243-c82b1b5786be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:22.464669 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1758b0e-beb3-4731-b243-c82b1b5786be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:26:22.466293 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1758b0e-beb3-4731-b243-c82b1b5786be service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:26:22.484402 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 704/1391] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:26:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:26:22.809419 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d768d-fa87-4231-a5a1-aa59bd29e400 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:22.809628 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d768d-fa87-4231-a5a1-aa59bd29e400 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:22.810151 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d768d-fa87-4231-a5a1-aa59bd29e400 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:22.811723 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 688/1392] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:26:22.816710 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c7f8a-9523-4eba-8b60-b2bd0a0f2c6c None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:22.817043 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c7f8a-9523-4eba-8b60-b2bd0a0f2c6c None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:22.817330 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c7f8a-9523-4eba-8b60-b2bd0a0f2c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:22.884078 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-3d4c7f8a-9523-4eba-8b60-b2bd0a0f2c6c None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:26:22.885283 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3d4c7f8a-9523-4eba-8b60-b2bd0a0f2c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:22.945480 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:26:22.985052 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 705/1393] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:26:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:26:23.041096 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7ab51-cf6a-4878-a850-ad0402cf7b5d None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:23.041555 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7ab51-cf6a-4878-a850-ad0402cf7b5d None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:23.041793 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7ab51-cf6a-4878-a850-ad0402cf7b5d None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:23.043268 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 689/1394] 10.222.0.60 () {54 vars in 966 bytes} [Thu Jul 21 19:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:26:23.048424 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db526d5-ec66-40ea-adcb-1790b87d5aa1 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:23.048726 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db526d5-ec66-40ea-adcb-1790b87d5aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:23.049007 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db526d5-ec66-40ea-adcb-1790b87d5aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:23.124329 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-7db526d5-ec66-40ea-adcb-1790b87d5aa1 None None] MFA Rules not processed for user `1a23a8e608f94d5d8153dcf7e79250f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:26:23.125441 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-7db526d5-ec66-40ea-adcb-1790b87d5aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:23.200924 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 706/1395] 10.222.0.60 () {58 vars in 1063 bytes} [Thu Jul 21 19:26:23 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:26:23.209281 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7ab51-cf6a-4878-a850-ad0402cf7b5d None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:26:23.210807 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-44d7ab51-cf6a-4878-a850-ad0402cf7b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:23.225443 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:26:23.317033 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7ab51-cf6a-4878-a850-ad0402cf7b5d None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:26:23.388703 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da858ca0-95df-4896-8c1c-548ad64da2e7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a23a8e608f94d5d8153dcf7e79250f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:26:23.389380 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da858ca0-95df-4896-8c1c-548ad64da2e7 service glance] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:23.389661 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da858ca0-95df-4896-8c1c-548ad64da2e7 service glance] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:23.389936 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da858ca0-95df-4896-8c1c-548ad64da2e7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:23.391587 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-da858ca0-95df-4896-8c1c-548ad64da2e7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:23.464465 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:26:23.504899 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da858ca0-95df-4896-8c1c-548ad64da2e7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:26:23.506334 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da858ca0-95df-4896-8c1c-548ad64da2e7 service glance] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:26:23.525757 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 690/1396] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:26:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:26:24.407287 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe0a76-3a96-4a00-95aa-6f872b851155 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:24.407837 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe0a76-3a96-4a00-95aa-6f872b851155 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:24.415011 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe0a76-3a96-4a00-95aa-6f872b851155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:24.477256 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-29fe0a76-3a96-4a00-95aa-6f872b851155 None None] MFA Rules not processed for user `22d11b8e390e4b9db3b84c419266c4b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:26:24.478584 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-29fe0a76-3a96-4a00-95aa-6f872b851155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:24.486877 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:26:24.571487 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 707/1397] 10.222.0.60 () {58 vars in 1009 bytes} [Thu Jul 21 19:26:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:26:24.620510 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c8f7d-b16c-4126-baee-7bbccf15e1a6 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:24.621005 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c8f7d-b16c-4126-baee-7bbccf15e1a6 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:24.621171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c8f7d-b16c-4126-baee-7bbccf15e1a6 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:24.624365 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 691/1398] 10.222.0.60 () {54 vars in 943 bytes} [Thu Jul 21 19:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:26:24.629000 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc3395-e916-4310-9323-cdb6b090da56 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:24.629301 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc3395-e916-4310-9323-cdb6b090da56 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:24.629713 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc3395-e916-4310-9323-cdb6b090da56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:24.657450 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc37a4-4c72-4a5b-aea0-a7542d5b5ddc None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:24.657663 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc37a4-4c72-4a5b-aea0-a7542d5b5ddc None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:24.657942 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc37a4-4c72-4a5b-aea0-a7542d5b5ddc None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:24.659295 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 692/1399] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 19:26:24.664817 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb619d72-ae04-4f5f-b955-7e435c4e035b None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:24.665107 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb619d72-ae04-4f5f-b955-7e435c4e035b None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:24.665389 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb619d72-ae04-4f5f-b955-7e435c4e035b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:24.709312 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-cdbc3395-e916-4310-9323-cdb6b090da56 None None] MFA Rules not processed for user `0aa579af53a6441a9205cf82864a640e`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:26:24.710691 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-cdbc3395-e916-4310-9323-cdb6b090da56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:24.731979 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-fb619d72-ae04-4f5f-b955-7e435c4e035b None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:26:24.733188 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-fb619d72-ae04-4f5f-b955-7e435c4e035b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:24.803725 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:26:24.829897 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 708/1400] 10.222.0.60 () {58 vars in 1040 bytes} [Thu Jul 21 19:26:24 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:26:24.839901 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc3395-e916-4310-9323-cdb6b090da56 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:26:24.850846 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc3395-e916-4310-9323-cdb6b090da56 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:26:24.951489 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 693/1401] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:26:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:26:24.961257 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd27026-79a9-415f-a442-ee2343abf50e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa579af53a6441a9205cf82864a640e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:26:24.961910 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd27026-79a9-415f-a442-ee2343abf50e service swift] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:24.962196 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd27026-79a9-415f-a442-ee2343abf50e service swift] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:24.962478 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd27026-79a9-415f-a442-ee2343abf50e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:24.964204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-5cd27026-79a9-415f-a442-ee2343abf50e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:24.994506 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb619d72-ae04-4f5f-b955-7e435c4e035b None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:26:24.995727 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-fb619d72-ae04-4f5f-b955-7e435c4e035b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:25.022900 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:26:25.049712 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd27026-79a9-415f-a442-ee2343abf50e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:26:25.051533 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd27026-79a9-415f-a442-ee2343abf50e service swift] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:26:25.059815 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 709/1402] 10.222.0.60 () {60 vars in 1384 bytes} [Thu Jul 21 19:26:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 19:26:25.117867 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb619d72-ae04-4f5f-b955-7e435c4e035b None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:26:25.229942 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0fbdae-2159-4c3c-b6f8-35b76fb5d72b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:26:25.230510 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0fbdae-2159-4c3c-b6f8-35b76fb5d72b service nova] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:25.230788 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0fbdae-2159-4c3c-b6f8-35b76fb5d72b service nova] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:25.231058 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0fbdae-2159-4c3c-b6f8-35b76fb5d72b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:25.232784 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-cd0fbdae-2159-4c3c-b6f8-35b76fb5d72b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:25.249991 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:26:25.321530 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0fbdae-2159-4c3c-b6f8-35b76fb5d72b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:26:25.323120 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0fbdae-2159-4c3c-b6f8-35b76fb5d72b service nova] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:26:25.340835 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 694/1403] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:26:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 19:26:27.587283 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3d044-588f-4ab9-9d9f-23c8204cdc9a None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:27.587924 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3d044-588f-4ab9-9d9f-23c8204cdc9a None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:27.587924 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3d044-588f-4ab9-9d9f-23c8204cdc9a None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:27.589246 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 710/1404] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:26:27.595849 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3fd9c3-9fdd-4388-a1e2-279d4a916556 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:27.596395 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3fd9c3-9fdd-4388-a1e2-279d4a916556 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:27.596395 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3fd9c3-9fdd-4388-a1e2-279d4a916556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:27.667905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-ca3fd9c3-9fdd-4388-a1e2-279d4a916556 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:26:27.669428 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-ca3fd9c3-9fdd-4388-a1e2-279d4a916556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:27.773030 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:26:27.778867 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 695/1405] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:26:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:26:27.824297 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3d044-588f-4ab9-9d9f-23c8204cdc9a None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:26:27.826136 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3de3d044-588f-4ab9-9d9f-23c8204cdc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:27.837011 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:26:27.993171 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3d044-588f-4ab9-9d9f-23c8204cdc9a None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:26:28.081013 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:26:28.123676 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a91d4-c950-4348-a42b-593cd6131811 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:26:28.124317 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a91d4-c950-4348-a42b-593cd6131811 service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:28.124765 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a91d4-c950-4348-a42b-593cd6131811 service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:28.125054 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a91d4-c950-4348-a42b-593cd6131811 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:28.126720 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-246a91d4-c950-4348-a42b-593cd6131811 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:28.230051 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a91d4-c950-4348-a42b-593cd6131811 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:26:28.231915 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a91d4-c950-4348-a42b-593cd6131811 service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:26:28.252076 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 711/1406] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:26:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:26:30.592535 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993f758-c87c-4c5d-8ae5-2f49d69a3227 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:30.593415 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993f758-c87c-4c5d-8ae5-2f49d69a3227 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:30.593703 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993f758-c87c-4c5d-8ae5-2f49d69a3227 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:30.595220 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 696/1407] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:26:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:26:30.600711 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85f0af-4bdd-48cf-bf02-b0ce441eb9a0 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:30.601204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85f0af-4bdd-48cf-bf02-b0ce441eb9a0 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:30.601303 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85f0af-4bdd-48cf-bf02-b0ce441eb9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:30.670439 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-6c85f0af-4bdd-48cf-bf02-b0ce441eb9a0 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:26:30.671785 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-6c85f0af-4bdd-48cf-bf02-b0ce441eb9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:30.721412 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:26:30.783484 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 712/1408] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:26:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:26:30.830767 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993f758-c87c-4c5d-8ae5-2f49d69a3227 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:26:30.832370 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-8993f758-c87c-4c5d-8ae5-2f49d69a3227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:30.992939 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993f758-c87c-4c5d-8ae5-2f49d69a3227 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:26:31.068853 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:26:31.122168 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363ad80-bc74-4a28-8389-f58e21b53930 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:26:31.122827 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363ad80-bc74-4a28-8389-f58e21b53930 service nova] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:31.123138 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363ad80-bc74-4a28-8389-f58e21b53930 service nova] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:31.123417 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363ad80-bc74-4a28-8389-f58e21b53930 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:31.125096 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-4363ad80-bc74-4a28-8389-f58e21b53930 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:31.227922 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363ad80-bc74-4a28-8389-f58e21b53930 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:26:31.229560 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363ad80-bc74-4a28-8389-f58e21b53930 service nova] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:26:31.252936 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 697/1409] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:26:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:26:40.779308 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=23 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:26:41.250125 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=64 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:26:48.960952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c95b1-01fe-4751-84b1-4f8855083f85 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:48.961522 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c95b1-01fe-4751-84b1-4f8855083f85 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:48.961522 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c95b1-01fe-4751-84b1-4f8855083f85 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:48.962894 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 713/1410] 10.222.0.60 () {54 vars in 918 bytes} [Thu Jul 21 19:26:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:26:48.968129 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32621d25-0d89-42b0-a863-736c2db6e718 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:48.968583 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32621d25-0d89-42b0-a863-736c2db6e718 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:48.968713 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32621d25-0d89-42b0-a863-736c2db6e718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:49.054424 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-32621d25-0d89-42b0-a863-736c2db6e718 None None] MFA Rules not processed for user `bcc5eefc2f7c419190e96b46b163fedd`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:26:49.055763 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-32621d25-0d89-42b0-a863-736c2db6e718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:49.162033 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 698/1411] 10.222.0.60 () {58 vars in 1015 bytes} [Thu Jul 21 19:26:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:26:49.176465 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180aaff1-301a-4a33-a09c-9525be67cdc2 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:49.176832 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180aaff1-301a-4a33-a09c-9525be67cdc2 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:49.177231 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180aaff1-301a-4a33-a09c-9525be67cdc2 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:49.179372 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 714/1412] 10.222.0.60 () {54 vars in 918 bytes} [Thu Jul 21 19:26:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:26:49.184031 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab20c2a-cfd0-4e3a-8d7f-122a2a1e4936 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:49.184323 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab20c2a-cfd0-4e3a-8d7f-122a2a1e4936 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:49.184597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab20c2a-cfd0-4e3a-8d7f-122a2a1e4936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:49.257861 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:26:49.260200 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-9ab20c2a-cfd0-4e3a-8d7f-122a2a1e4936 None None] MFA Rules not processed for user `6b4d98e967814e5f84f5f0d67ebb3c17`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:26:49.261388 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-9ab20c2a-cfd0-4e3a-8d7f-122a2a1e4936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:49.373143 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 699/1413] 10.222.0.60 () {58 vars in 1015 bytes} [Thu Jul 21 19:26:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:26:51.868029 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fedd2f-9584-495c-99f4-2c1bccd1684e None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:51.868562 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fedd2f-9584-495c-99f4-2c1bccd1684e None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:51.868562 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fedd2f-9584-495c-99f4-2c1bccd1684e None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:51.869889 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 715/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 19:26:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:26:51.874986 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e83dec-1ad5-419f-a57b-10dcec068fa8 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:51.875403 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e83dec-1ad5-419f-a57b-10dcec068fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:51.875567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e83dec-1ad5-419f-a57b-10dcec068fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:51.938668 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-83e83dec-1ad5-419f-a57b-10dcec068fa8 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:26:51.939909 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-83e83dec-1ad5-419f-a57b-10dcec068fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:51.993062 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:26:52.033019 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 700/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 19:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:26:52.077976 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fedd2f-9584-495c-99f4-2c1bccd1684e None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:26:52.079531 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-d7fedd2f-9584-495c-99f4-2c1bccd1684e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:52.223833 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fedd2f-9584-495c-99f4-2c1bccd1684e None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:26:52.296062 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:26:52.335999 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2566f96-30b1-48b0-804b-08b20cf06e84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:26:52.336641 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2566f96-30b1-48b0-804b-08b20cf06e84 service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:52.336926 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2566f96-30b1-48b0-804b-08b20cf06e84 service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:52.337204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2566f96-30b1-48b0-804b-08b20cf06e84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:52.338856 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f2566f96-30b1-48b0-804b-08b20cf06e84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:52.429357 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2566f96-30b1-48b0-804b-08b20cf06e84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:26:52.430978 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2566f96-30b1-48b0-804b-08b20cf06e84 service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:26:52.449525 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 716/1416] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:26:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:26:53.347970 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70cc45-af43-4b1d-bf36-dfc454e491f8 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:53.348553 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70cc45-af43-4b1d-bf36-dfc454e491f8 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:53.348553 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70cc45-af43-4b1d-bf36-dfc454e491f8 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:53.349877 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 701/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 19:26:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:26:53.355315 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aec1fc-a943-4d06-9d07-a03fdbbf9d20 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:53.355752 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aec1fc-a943-4d06-9d07-a03fdbbf9d20 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:53.355930 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aec1fc-a943-4d06-9d07-a03fdbbf9d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:53.432649 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-97aec1fc-a943-4d06-9d07-a03fdbbf9d20 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:26:53.433884 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-97aec1fc-a943-4d06-9d07-a03fdbbf9d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:53.460889 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:26:53.532512 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 717/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 19:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:26:53.682712 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70cc45-af43-4b1d-bf36-dfc454e491f8 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:26:53.684344 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-7b70cc45-af43-4b1d-bf36-dfc454e491f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:53.825594 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70cc45-af43-4b1d-bf36-dfc454e491f8 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:26:53.864616 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:26:53.937592 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f5546-fe84-4266-bc34-86e8b820d613 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:26:53.938194 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f5546-fe84-4266-bc34-86e8b820d613 service nova] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:53.938472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f5546-fe84-4266-bc34-86e8b820d613 service nova] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:53.938742 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f5546-fe84-4266-bc34-86e8b820d613 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:53.940467 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-4b0f5546-fe84-4266-bc34-86e8b820d613 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:54.026094 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f5546-fe84-4266-bc34-86e8b820d613 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:26:54.027718 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f5546-fe84-4266-bc34-86e8b820d613 service nova] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:26:54.046368 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 702/1419] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:26:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:26:54.921791 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a9088-1e69-424b-8cdb-63f06e6afd17 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:54.922349 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a9088-1e69-424b-8cdb-63f06e6afd17 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:54.922349 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a9088-1e69-424b-8cdb-63f06e6afd17 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:54.923776 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 718/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 19:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:26:54.929339 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c7339-ca88-4b4f-9e74-fb1b62cf6c63 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:54.929774 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c7339-ca88-4b4f-9e74-fb1b62cf6c63 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:54.929893 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c7339-ca88-4b4f-9e74-fb1b62cf6c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:54.981763 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:26:55.002995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-160c7339-ca88-4b4f-9e74-fb1b62cf6c63 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:26:55.004231 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-160c7339-ca88-4b4f-9e74-fb1b62cf6c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:55.098685 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 703/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 19:26:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:26:55.248252 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a9088-1e69-424b-8cdb-63f06e6afd17 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:26:55.249666 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-565a9088-1e69-424b-8cdb-63f06e6afd17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:55.393412 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a9088-1e69-424b-8cdb-63f06e6afd17 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:26:55.405936 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:26:55.510998 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2caf57-770e-40ec-9965-6de69902832a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:26:55.511610 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2caf57-770e-40ec-9965-6de69902832a service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:55.511897 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2caf57-770e-40ec-9965-6de69902832a service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:55.512175 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2caf57-770e-40ec-9965-6de69902832a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:55.513845 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-4c2caf57-770e-40ec-9965-6de69902832a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:55.603998 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2caf57-770e-40ec-9965-6de69902832a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:26:55.605612 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2caf57-770e-40ec-9965-6de69902832a service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:26:55.623627 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 719/1422] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:26:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:26:56.483175 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bbb636-48f3-4f2e-8acc-fa896817947e None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:56.483706 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bbb636-48f3-4f2e-8acc-fa896817947e None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:56.483833 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bbb636-48f3-4f2e-8acc-fa896817947e None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:56.485094 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 704/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 19:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:26:56.489861 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee7572-1909-46c8-8496-1b15c4e1e391 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:56.490249 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee7572-1909-46c8-8496-1b15c4e1e391 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:56.490424 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee7572-1909-46c8-8496-1b15c4e1e391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:56.509215 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:26:56.564702 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-d4ee7572-1909-46c8-8496-1b15c4e1e391 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:26:56.565896 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-d4ee7572-1909-46c8-8496-1b15c4e1e391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:56.662767 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 720/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 19:26:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:26:56.812748 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bbb636-48f3-4f2e-8acc-fa896817947e None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:26:56.814180 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-11bbb636-48f3-4f2e-8acc-fa896817947e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:56.922526 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:26:56.958253 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bbb636-48f3-4f2e-8acc-fa896817947e None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:26:57.067985 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c2b80e-9f79-40e0-94a3-e0b2ede09edc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:26:57.068566 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2b80e-9f79-40e0-94a3-e0b2ede09edc service nova] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:57.068850 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2b80e-9f79-40e0-94a3-e0b2ede09edc service nova] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:57.069766 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2b80e-9f79-40e0-94a3-e0b2ede09edc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:57.071534 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-21c2b80e-9f79-40e0-94a3-e0b2ede09edc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:57.146372 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:26:57.159642 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c2b80e-9f79-40e0-94a3-e0b2ede09edc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:26:57.161271 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c2b80e-9f79-40e0-94a3-e0b2ede09edc service nova] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:26:57.179878 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 705/1425] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:26:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:26:58.045093 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab9d48-2804-4594-b422-9b0f4629aef4 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:58.045715 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab9d48-2804-4594-b422-9b0f4629aef4 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:58.045715 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab9d48-2804-4594-b422-9b0f4629aef4 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:58.047012 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 721/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 19:26:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:26:58.052017 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63029699-d9ac-4449-93b3-8bc7fb055dc1 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:58.052464 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63029699-d9ac-4449-93b3-8bc7fb055dc1 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:58.052585 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63029699-d9ac-4449-93b3-8bc7fb055dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:58.128488 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-63029699-d9ac-4449-93b3-8bc7fb055dc1 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:26:58.129704 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-63029699-d9ac-4449-93b3-8bc7fb055dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:58.232444 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 706/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 19:26:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:26:58.382583 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab9d48-2804-4594-b422-9b0f4629aef4 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:26:58.384082 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-c1ab9d48-2804-4594-b422-9b0f4629aef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:58.469110 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:26:58.532741 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab9d48-2804-4594-b422-9b0f4629aef4 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:26:58.647345 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd880e0-b71a-45e8-911a-6276066a3a02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:26:58.648019 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd880e0-b71a-45e8-911a-6276066a3a02 service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:58.648300 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd880e0-b71a-45e8-911a-6276066a3a02 service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:58.648574 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd880e0-b71a-45e8-911a-6276066a3a02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:58.650195 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-dbd880e0-b71a-45e8-911a-6276066a3a02 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:58.699582 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:26:58.741390 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd880e0-b71a-45e8-911a-6276066a3a02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:26:58.743182 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd880e0-b71a-45e8-911a-6276066a3a02 service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:26:58.761272 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 722/1428] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:26:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:26:59.638661 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874716ad-a4fe-4222-916a-af04eeb00115 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:59.639205 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874716ad-a4fe-4222-916a-af04eeb00115 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:59.639205 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874716ad-a4fe-4222-916a-af04eeb00115 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:59.640620 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 707/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 19:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:26:59.645572 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb726f-6e28-447b-8c8f-188a690bfb45 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:26:59.645994 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb726f-6e28-447b-8c8f-188a690bfb45 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:26:59.646136 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb726f-6e28-447b-8c8f-188a690bfb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:26:59.725742 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-04fb726f-6e28-447b-8c8f-188a690bfb45 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:26:59.726899 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-04fb726f-6e28-447b-8c8f-188a690bfb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:26:59.831123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 723/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 19:26:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:26:59.989879 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874716ad-a4fe-4222-916a-af04eeb00115 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:26:59.993675 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-874716ad-a4fe-4222-916a-af04eeb00115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:00.049172 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:27:00.145644 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874716ad-a4fe-4222-916a-af04eeb00115 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:27:00.255464 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bae0f4-f244-46c3-a412-f3307ef3dccf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:27:00.256052 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bae0f4-f244-46c3-a412-f3307ef3dccf service nova] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:00.256879 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bae0f4-f244-46c3-a412-f3307ef3dccf service nova] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:00.257160 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bae0f4-f244-46c3-a412-f3307ef3dccf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:00.258800 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-58bae0f4-f244-46c3-a412-f3307ef3dccf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:00.265704 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:27:00.349602 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bae0f4-f244-46c3-a412-f3307ef3dccf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:27:00.351255 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bae0f4-f244-46c3-a412-f3307ef3dccf service nova] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:27:00.368847 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 708/1431] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:26:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:27:01.271626 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a023042-4115-43ef-b37f-66e26645785e None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:01.272160 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a023042-4115-43ef-b37f-66e26645785e None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:01.272160 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a023042-4115-43ef-b37f-66e26645785e None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:01.273528 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 724/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 19:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:27:01.278492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4ebef-633a-45c1-86ed-a594f82850e5 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:01.278946 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4ebef-633a-45c1-86ed-a594f82850e5 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:01.279059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4ebef-633a-45c1-86ed-a594f82850e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:01.350596 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-eca4ebef-633a-45c1-86ed-a594f82850e5 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:27:01.351813 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-eca4ebef-633a-45c1-86ed-a594f82850e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:01.418465 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:27:01.449385 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 709/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 19:27:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:27:01.600905 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a023042-4115-43ef-b37f-66e26645785e None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:27:01.602477 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-9a023042-4115-43ef-b37f-66e26645785e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:01.621273 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:27:01.748171 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a023042-4115-43ef-b37f-66e26645785e None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:27:01.834692 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:27:01.860063 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875b883-d1b3-498d-887d-5ccd7d8bae74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:27:01.860742 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875b883-d1b3-498d-887d-5ccd7d8bae74 service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:01.861028 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875b883-d1b3-498d-887d-5ccd7d8bae74 service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:01.861302 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875b883-d1b3-498d-887d-5ccd7d8bae74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:01.862928 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-4875b883-d1b3-498d-887d-5ccd7d8bae74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:01.951915 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4875b883-d1b3-498d-887d-5ccd7d8bae74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:27:01.953522 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4875b883-d1b3-498d-887d-5ccd7d8bae74 service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:27:01.973067 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 725/1434] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:27:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:27:02.885476 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ee76f-00dc-4d0a-bf9a-f2ddcb1e2cdf None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:02.886007 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ee76f-00dc-4d0a-bf9a-f2ddcb1e2cdf None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:02.886119 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ee76f-00dc-4d0a-bf9a-f2ddcb1e2cdf None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:02.887567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 710/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 19:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:27:02.892418 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c0af1-fb42-49a7-82b4-3338f4c915ff None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:02.892806 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c0af1-fb42-49a7-82b4-3338f4c915ff None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:02.892992 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c0af1-fb42-49a7-82b4-3338f4c915ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:02.968292 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-8c9c0af1-fb42-49a7-82b4-3338f4c915ff None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:27:02.969487 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-8c9c0af1-fb42-49a7-82b4-3338f4c915ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:03.011222 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:27:03.067255 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 726/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 19:27:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:27:03.229421 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ee76f-00dc-4d0a-bf9a-f2ddcb1e2cdf None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:27:03.230855 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-832ee76f-00dc-4d0a-bf9a-f2ddcb1e2cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:03.376163 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ee76f-00dc-4d0a-bf9a-f2ddcb1e2cdf None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:27:03.432712 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:27:03.489921 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d540a1-40e2-491a-9510-6e4b8b2897ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:27:03.490522 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d540a1-40e2-491a-9510-6e4b8b2897ac service nova] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:03.490987 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d540a1-40e2-491a-9510-6e4b8b2897ac service nova] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:03.491269 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d540a1-40e2-491a-9510-6e4b8b2897ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:03.492938 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-98d540a1-40e2-491a-9510-6e4b8b2897ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:03.580044 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d540a1-40e2-491a-9510-6e4b8b2897ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:27:03.581627 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d540a1-40e2-491a-9510-6e4b8b2897ac service nova] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:27:03.599799 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 711/1437] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:27:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:27:04.459343 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490acfb-b9b2-4713-a711-6fa54f9a4aa2 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:04.460028 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490acfb-b9b2-4713-a711-6fa54f9a4aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:04.460028 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490acfb-b9b2-4713-a711-6fa54f9a4aa2 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:04.461363 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 727/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 19:27:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:27:04.469663 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f162bd-8872-4e05-a872-46e0e8152b77 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:04.470060 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f162bd-8872-4e05-a872-46e0e8152b77 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:04.470224 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f162bd-8872-4e05-a872-46e0e8152b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:04.548778 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-d2f162bd-8872-4e05-a872-46e0e8152b77 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:27:04.554954 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-d2f162bd-8872-4e05-a872-46e0e8152b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:04.557228 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:27:04.666800 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 712/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 19:27:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:27:04.819764 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490acfb-b9b2-4713-a711-6fa54f9a4aa2 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:27:04.821270 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-e490acfb-b9b2-4713-a711-6fa54f9a4aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:04.967234 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490acfb-b9b2-4713-a711-6fa54f9a4aa2 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:27:04.994088 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:27:05.080436 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb594618-e876-4aae-952b-ce839dc61336 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:27:05.081080 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb594618-e876-4aae-952b-ce839dc61336 service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:05.081361 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb594618-e876-4aae-952b-ce839dc61336 service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:05.081635 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb594618-e876-4aae-952b-ce839dc61336 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:05.083289 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-bb594618-e876-4aae-952b-ce839dc61336 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:05.172250 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb594618-e876-4aae-952b-ce839dc61336 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:27:05.173989 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb594618-e876-4aae-952b-ce839dc61336 service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:27:05.192358 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 728/1440] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:27:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:27:07.124212 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbdff82-120f-48aa-995d-2e3ead1e1323 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:07.124806 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbdff82-120f-48aa-995d-2e3ead1e1323 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:07.124806 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbdff82-120f-48aa-995d-2e3ead1e1323 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:07.126128 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 713/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 19:27:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:27:07.131950 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c304a13-314b-4fbc-b0c7-f1b616aafb24 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:07.132392 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c304a13-314b-4fbc-b0c7-f1b616aafb24 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:07.132672 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c304a13-314b-4fbc-b0c7-f1b616aafb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:07.172388 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:27:07.198342 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-8c304a13-314b-4fbc-b0c7-f1b616aafb24 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:27:07.199615 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-8c304a13-314b-4fbc-b0c7-f1b616aafb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:07.295767 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 729/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 19:27:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:27:07.335326 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbdff82-120f-48aa-995d-2e3ead1e1323 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:27:07.336874 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-7fbdff82-120f-48aa-995d-2e3ead1e1323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:07.438142 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbdff82-120f-48aa-995d-2e3ead1e1323 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:27:07.470022 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:27:07.510768 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265166a-c659-40c6-addd-fc64bad64a11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:27:07.511418 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265166a-c659-40c6-addd-fc64bad64a11 service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:07.511734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265166a-c659-40c6-addd-fc64bad64a11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:07.512013 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265166a-c659-40c6-addd-fc64bad64a11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:07.513649 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-d265166a-c659-40c6-addd-fc64bad64a11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:07.620094 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265166a-c659-40c6-addd-fc64bad64a11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:27:07.621537 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265166a-c659-40c6-addd-fc64bad64a11 service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:27:07.639702 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 714/1443] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:27:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:27:09.893581 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709931e-5390-4a09-b62f-7031fdb20fb8 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:09.894172 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709931e-5390-4a09-b62f-7031fdb20fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:09.894172 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709931e-5390-4a09-b62f-7031fdb20fb8 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:09.895546 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 730/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 19:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:27:09.900898 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c21f25-d007-47e2-97c1-32d9817cda0a None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:09.901376 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c21f25-d007-47e2-97c1-32d9817cda0a None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:09.901484 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c21f25-d007-47e2-97c1-32d9817cda0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:09.964760 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-49c21f25-d007-47e2-97c1-32d9817cda0a None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:27:09.965954 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-49c21f25-d007-47e2-97c1-32d9817cda0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:09.978956 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:27:10.061896 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 715/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 19:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:27:10.100669 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709931e-5390-4a09-b62f-7031fdb20fb8 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:27:10.102229 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-5709931e-5390-4a09-b62f-7031fdb20fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:10.207968 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709931e-5390-4a09-b62f-7031fdb20fb8 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:27:10.221055 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:27:10.283651 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4157c0ff-e269-4216-b35a-7d6a2040fdd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:27:10.284325 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157c0ff-e269-4216-b35a-7d6a2040fdd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:10.284604 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157c0ff-e269-4216-b35a-7d6a2040fdd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:10.284901 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157c0ff-e269-4216-b35a-7d6a2040fdd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:10.286526 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-4157c0ff-e269-4216-b35a-7d6a2040fdd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:10.395667 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4157c0ff-e269-4216-b35a-7d6a2040fdd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:27:10.397805 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4157c0ff-e269-4216-b35a-7d6a2040fdd2 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:27:10.416962 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 731/1446] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:27:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:27:12.805328 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a284783-a12c-469e-aa9b-bdbc568d53c9 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:12.805859 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a284783-a12c-469e-aa9b-bdbc568d53c9 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:12.806082 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a284783-a12c-469e-aa9b-bdbc568d53c9 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:12.807470 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 716/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 19:27:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:27:12.813005 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85c93e-04b5-459d-ae37-3d2b2bc713a8 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:12.813392 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85c93e-04b5-459d-ae37-3d2b2bc713a8 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:12.813569 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85c93e-04b5-459d-ae37-3d2b2bc713a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:12.860788 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:27:12.877980 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-4d85c93e-04b5-459d-ae37-3d2b2bc713a8 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:27:12.884491 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-4d85c93e-04b5-459d-ae37-3d2b2bc713a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:12.978105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 732/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 19:27:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:27:13.017278 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a284783-a12c-469e-aa9b-bdbc568d53c9 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:27:13.018840 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-1a284783-a12c-469e-aa9b-bdbc568d53c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:13.120027 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a284783-a12c-469e-aa9b-bdbc568d53c9 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:27:13.158889 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:27:13.192766 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9212d-d706-4ba9-9bb4-3727db9f6e2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:27:13.194054 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9212d-d706-4ba9-9bb4-3727db9f6e2c service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:13.194542 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9212d-d706-4ba9-9bb4-3727db9f6e2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:13.194863 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9212d-d706-4ba9-9bb4-3727db9f6e2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:13.196539 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-b2c9212d-d706-4ba9-9bb4-3727db9f6e2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:13.301902 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c9212d-d706-4ba9-9bb4-3727db9f6e2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:27:13.304089 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c9212d-d706-4ba9-9bb4-3727db9f6e2c service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:27:13.323026 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 717/1449] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:27:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:27:15.491282 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb7c32-2193-4235-9b35-29db1a97f1ca None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:15.491827 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb7c32-2193-4235-9b35-29db1a97f1ca None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:15.491945 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb7c32-2193-4235-9b35-29db1a97f1ca None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:15.493335 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 733/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 19:27:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:27:15.498551 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2316e83-b66e-4bde-9560-f2283a3b686b None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:15.498984 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2316e83-b66e-4bde-9560-f2283a3b686b None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:15.499101 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2316e83-b66e-4bde-9560-f2283a3b686b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:15.563574 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-c2316e83-b66e-4bde-9560-f2283a3b686b None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:27:15.564781 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-c2316e83-b66e-4bde-9560-f2283a3b686b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:15.585304 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:27:15.660319 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 718/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 19:27:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:27:15.701370 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb7c32-2193-4235-9b35-29db1a97f1ca None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:27:15.702942 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-eafb7c32-2193-4235-9b35-29db1a97f1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:15.807328 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb7c32-2193-4235-9b35-29db1a97f1ca None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:27:15.827984 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:27:15.888567 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20168ec7-b04b-4ffc-b89e-3183dba7a377 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:27:15.889214 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20168ec7-b04b-4ffc-b89e-3183dba7a377 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:15.889502 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20168ec7-b04b-4ffc-b89e-3183dba7a377 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:15.889776 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20168ec7-b04b-4ffc-b89e-3183dba7a377 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:15.891422 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-20168ec7-b04b-4ffc-b89e-3183dba7a377 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:16.000482 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20168ec7-b04b-4ffc-b89e-3183dba7a377 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:27:16.001873 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20168ec7-b04b-4ffc-b89e-3183dba7a377 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:27:16.019856 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 734/1452] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:27:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:27:18.150708 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487c092-792c-4a7c-adef-b6e4e7d4bbb1 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:18.151291 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487c092-792c-4a7c-adef-b6e4e7d4bbb1 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:18.151291 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487c092-792c-4a7c-adef-b6e4e7d4bbb1 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:18.152695 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 719/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 19:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:27:18.158205 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212cf89-d61d-4d6a-91f2-5412e3ba22ef None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:18.158614 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212cf89-d61d-4d6a-91f2-5412e3ba22ef None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:18.158775 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212cf89-d61d-4d6a-91f2-5412e3ba22ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:18.221820 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:27:18.224816 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-a212cf89-d61d-4d6a-91f2-5412e3ba22ef None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:27:18.226222 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-a212cf89-d61d-4d6a-91f2-5412e3ba22ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:18.323591 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 735/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 19:27:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:27:18.362558 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487c092-792c-4a7c-adef-b6e4e7d4bbb1 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:27:18.364124 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-b487c092-792c-4a7c-adef-b6e4e7d4bbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:18.468553 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487c092-792c-4a7c-adef-b6e4e7d4bbb1 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:27:18.516707 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:27:18.540905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04edd00-0907-4544-a0dc-7ec2ec0538d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:27:18.541544 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04edd00-0907-4544-a0dc-7ec2ec0538d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:18.541823 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04edd00-0907-4544-a0dc-7ec2ec0538d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:18.542095 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04edd00-0907-4544-a0dc-7ec2ec0538d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:18.543741 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-d04edd00-0907-4544-a0dc-7ec2ec0538d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:18.650768 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04edd00-0907-4544-a0dc-7ec2ec0538d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:27:18.652245 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04edd00-0907-4544-a0dc-7ec2ec0538d8 service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:27:18.670197 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 720/1455] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:27:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:27:20.748983 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4d00f-42b3-4ed3-92bf-32f1728094a5 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:20.749577 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4d00f-42b3-4ed3-92bf-32f1728094a5 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:20.749577 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4d00f-42b3-4ed3-92bf-32f1728094a5 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:20.750901 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 736/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 19:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:27:20.756174 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d802b99-7467-433e-88e8-1a567d08590b None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:20.756620 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d802b99-7467-433e-88e8-1a567d08590b None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:20.756746 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d802b99-7467-433e-88e8-1a567d08590b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:20.820170 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-6d802b99-7467-433e-88e8-1a567d08590b None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:27:20.821362 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-6d802b99-7467-433e-88e8-1a567d08590b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:20.851281 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:27:20.916995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 721/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 19:27:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:27:20.955858 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4d00f-42b3-4ed3-92bf-32f1728094a5 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:27:20.957425 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-11d4d00f-42b3-4ed3-92bf-32f1728094a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:21.063965 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4d00f-42b3-4ed3-92bf-32f1728094a5 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:27:21.093175 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:27:21.139102 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b1b8e-c3ce-47fc-a7e6-6772a65f5a31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:27:21.139785 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b1b8e-c3ce-47fc-a7e6-6772a65f5a31 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:21.140069 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b1b8e-c3ce-47fc-a7e6-6772a65f5a31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:21.140345 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b1b8e-c3ce-47fc-a7e6-6772a65f5a31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:21.141984 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-a25b1b8e-c3ce-47fc-a7e6-6772a65f5a31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:21.252176 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25b1b8e-c3ce-47fc-a7e6-6772a65f5a31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:27:21.253619 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25b1b8e-c3ce-47fc-a7e6-6772a65f5a31 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:27:21.271829 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 737/1458] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:27:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:27:23.377598 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276cb3e-1117-47ba-98f7-ae6ee2e9244a None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:23.378136 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276cb3e-1117-47ba-98f7-ae6ee2e9244a None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:23.378136 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276cb3e-1117-47ba-98f7-ae6ee2e9244a None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:23.379709 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 722/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 19:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:27:23.385007 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5a6df-b076-4136-8ee7-84885df15d4f None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:23.385407 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5a6df-b076-4136-8ee7-84885df15d4f None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:23.385572 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5a6df-b076-4136-8ee7-84885df15d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:23.451084 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-30c5a6df-b076-4136-8ee7-84885df15d4f None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:27:23.452303 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-30c5a6df-b076-4136-8ee7-84885df15d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:23.460906 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:27:23.550271 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 738/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 19:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:27:23.588201 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276cb3e-1117-47ba-98f7-ae6ee2e9244a None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:27:23.589734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-0276cb3e-1117-47ba-98f7-ae6ee2e9244a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:23.694674 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276cb3e-1117-47ba-98f7-ae6ee2e9244a None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:27:23.749158 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:27:23.767325 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7fab2-b472-4b6c-829b-02a9faba8472 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:27:23.768001 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7fab2-b472-4b6c-829b-02a9faba8472 service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:23.768287 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7fab2-b472-4b6c-829b-02a9faba8472 service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:23.768566 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7fab2-b472-4b6c-829b-02a9faba8472 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:23.770198 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-afe7fab2-b472-4b6c-829b-02a9faba8472 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:23.878264 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7fab2-b472-4b6c-829b-02a9faba8472 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:27:23.879743 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7fab2-b472-4b6c-829b-02a9faba8472 service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:27:23.898579 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 723/1461] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:27:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:27:25.955343 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ee960-9d0f-473b-ab6f-2f76e4aaa5d6 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:25.955969 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ee960-9d0f-473b-ab6f-2f76e4aaa5d6 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:25.955969 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ee960-9d0f-473b-ab6f-2f76e4aaa5d6 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:25.957339 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 739/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 19:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:27:25.963021 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c848e57-9048-4f0b-b147-b4075330387e None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:25.963424 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c848e57-9048-4f0b-b147-b4075330387e None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:25.963611 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c848e57-9048-4f0b-b147-b4075330387e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:26.026507 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-5c848e57-9048-4f0b-b147-b4075330387e None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:27:26.027727 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-5c848e57-9048-4f0b-b147-b4075330387e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:26.065313 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:27:26.122743 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 724/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 19:27:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:27:26.160090 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ee960-9d0f-473b-ab6f-2f76e4aaa5d6 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:27:26.162204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-6f3ee960-9d0f-473b-ab6f-2f76e4aaa5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:26.264228 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ee960-9d0f-473b-ab6f-2f76e4aaa5d6 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:27:26.302081 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:27:26.339032 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d998b-50e8-42ef-9016-df5ebd1a2789 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:27:26.339824 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d998b-50e8-42ef-9016-df5ebd1a2789 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:26.340301 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d998b-50e8-42ef-9016-df5ebd1a2789 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:26.340736 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d998b-50e8-42ef-9016-df5ebd1a2789 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:26.342700 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-4a1d998b-50e8-42ef-9016-df5ebd1a2789 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:26.454009 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d998b-50e8-42ef-9016-df5ebd1a2789 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:27:26.455478 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d998b-50e8-42ef-9016-df5ebd1a2789 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:27:26.475624 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 740/1464] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:27:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:27:28.532458 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7d08a-3236-4297-838f-f1068d23290f None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:28.532994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7d08a-3236-4297-838f-f1068d23290f None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:28.532994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7d08a-3236-4297-838f-f1068d23290f None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:28.534372 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 725/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 19:27:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:27:28.539904 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86095fb2-f043-4aaa-8a5f-6b5bd742b6ea None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:28.540337 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86095fb2-f043-4aaa-8a5f-6b5bd742b6ea None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:28.540488 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86095fb2-f043-4aaa-8a5f-6b5bd742b6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:28.605672 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-86095fb2-f043-4aaa-8a5f-6b5bd742b6ea None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:27:28.606876 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-86095fb2-f043-4aaa-8a5f-6b5bd742b6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:28.626481 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:27:28.709985 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 741/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 19:27:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:27:28.747584 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7d08a-3236-4297-838f-f1068d23290f None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:27:28.749105 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-66e7d08a-3236-4297-838f-f1068d23290f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:28.851825 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7d08a-3236-4297-838f-f1068d23290f None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:27:28.918550 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:27:28.925176 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d3227-c38e-4b7c-bf15-381127ecdd7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:27:28.925827 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d3227-c38e-4b7c-bf15-381127ecdd7a service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:28.926107 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d3227-c38e-4b7c-bf15-381127ecdd7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:28.926380 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d3227-c38e-4b7c-bf15-381127ecdd7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:28.928637 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-a97d3227-c38e-4b7c-bf15-381127ecdd7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:29.034021 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97d3227-c38e-4b7c-bf15-381127ecdd7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:27:29.035400 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97d3227-c38e-4b7c-bf15-381127ecdd7a service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:27:29.053608 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 726/1467] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:27:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:27:31.112711 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cf8c5-a35a-4879-a4c6-8b5fdcdc34a8 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:31.113252 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cf8c5-a35a-4879-a4c6-8b5fdcdc34a8 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:31.113252 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cf8c5-a35a-4879-a4c6-8b5fdcdc34a8 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:31.114659 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 742/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 19:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:27:31.119948 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c279763-5e90-413c-84fd-416f13482b02 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:31.120376 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c279763-5e90-413c-84fd-416f13482b02 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:31.120516 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c279763-5e90-413c-84fd-416f13482b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:31.184653 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-2c279763-5e90-413c-84fd-416f13482b02 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:27:31.186102 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-2c279763-5e90-413c-84fd-416f13482b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:31.233931 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:27:31.283046 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 727/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 19:27:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:27:31.321822 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cf8c5-a35a-4879-a4c6-8b5fdcdc34a8 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:27:31.323540 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-4e6cf8c5-a35a-4879-a4c6-8b5fdcdc34a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:31.431679 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cf8c5-a35a-4879-a4c6-8b5fdcdc34a8 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:27:31.480971 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:27:31.509618 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcaeaae-ea06-4ee8-9199-5ae34a9ade76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:27:31.510202 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcaeaae-ea06-4ee8-9199-5ae34a9ade76 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:31.510563 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcaeaae-ea06-4ee8-9199-5ae34a9ade76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:31.510760 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcaeaae-ea06-4ee8-9199-5ae34a9ade76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:31.512526 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3bcaeaae-ea06-4ee8-9199-5ae34a9ade76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:31.622151 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcaeaae-ea06-4ee8-9199-5ae34a9ade76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:27:31.623665 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcaeaae-ea06-4ee8-9199-5ae34a9ade76 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:27:31.642338 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 743/1470] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:27:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:27:41.281111 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=22 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:27:41.639944 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=66 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:27:51.397152 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5279d7f-e5b7-4154-b99c-2a124893259f None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:51.397727 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5279d7f-e5b7-4154-b99c-2a124893259f None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:51.397727 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5279d7f-e5b7-4154-b99c-2a124893259f None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:51.399092 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 728/1471] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:27:51.404236 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8d091-9ec0-49c6-9366-a460dd46d148 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:51.404634 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8d091-9ec0-49c6-9366-a460dd46d148 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:51.404791 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8d091-9ec0-49c6-9366-a460dd46d148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:51.470903 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-3cf8d091-9ec0-49c6-9366-a460dd46d148 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:27:51.472136 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3cf8d091-9ec0-49c6-9366-a460dd46d148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:51.568505 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 744/1472] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:27:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:27:51.652165 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb26104-f24d-4ef1-b7d0-99c38bede3c8 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:51.652400 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb26104-f24d-4ef1-b7d0-99c38bede3c8 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:51.652678 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb26104-f24d-4ef1-b7d0-99c38bede3c8 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:51.654012 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 729/1473] 10.222.0.60 () {54 vars in 966 bytes} [Thu Jul 21 19:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:27:51.658651 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a7046-28e8-4307-a829-fcca6795fbfa None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:51.658945 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a7046-28e8-4307-a829-fcca6795fbfa None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:51.659224 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a7046-28e8-4307-a829-fcca6795fbfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:51.733513 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-035a7046-28e8-4307-a829-fcca6795fbfa None None] MFA Rules not processed for user `1a23a8e608f94d5d8153dcf7e79250f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:27:51.734716 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-035a7046-28e8-4307-a829-fcca6795fbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:51.755156 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:27:51.811938 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 745/1474] 10.222.0.60 () {58 vars in 1063 bytes} [Thu Jul 21 19:27:51 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:27:51.820027 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb26104-f24d-4ef1-b7d0-99c38bede3c8 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:27:51.821538 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-2cb26104-f24d-4ef1-b7d0-99c38bede3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:51.922980 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb26104-f24d-4ef1-b7d0-99c38bede3c8 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:27:51.998972 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27748ad9-d05d-4da9-949f-3d8a75650aa3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a23a8e608f94d5d8153dcf7e79250f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:27:51.999654 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27748ad9-d05d-4da9-949f-3d8a75650aa3 service glance] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:51.999941 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27748ad9-d05d-4da9-949f-3d8a75650aa3 service glance] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:52.000219 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27748ad9-d05d-4da9-949f-3d8a75650aa3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:52.001859 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-27748ad9-d05d-4da9-949f-3d8a75650aa3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:52.055966 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:27:52.110279 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27748ad9-d05d-4da9-949f-3d8a75650aa3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:27:52.111897 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27748ad9-d05d-4da9-949f-3d8a75650aa3 service glance] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:27:52.134571 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 730/1475] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:27:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:27:54.243491 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce21a7-18a2-4a19-b4a4-0b4c200b01c3 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:54.244201 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce21a7-18a2-4a19-b4a4-0b4c200b01c3 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:54.244201 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce21a7-18a2-4a19-b4a4-0b4c200b01c3 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:54.245628 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 746/1476] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:27:54.251141 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a8469-d7f0-4b97-aca6-42d911ee2ea5 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:54.251586 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a8469-d7f0-4b97-aca6-42d911ee2ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:54.251728 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a8469-d7f0-4b97-aca6-42d911ee2ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:54.315758 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-bc7a8469-d7f0-4b97-aca6-42d911ee2ea5 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:27:54.316954 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-bc7a8469-d7f0-4b97-aca6-42d911ee2ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:54.411558 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 731/1477] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:27:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:27:54.435095 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce21a7-18a2-4a19-b4a4-0b4c200b01c3 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:27:54.436970 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-35ce21a7-18a2-4a19-b4a4-0b4c200b01c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:54.562516 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce21a7-18a2-4a19-b4a4-0b4c200b01c3 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:27:54.612197 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:27:54.658339 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98b804-b06e-4269-b152-840e8dba687f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:27:54.658988 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98b804-b06e-4269-b152-840e8dba687f admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:54.659272 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98b804-b06e-4269-b152-840e8dba687f admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:54.659602 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98b804-b06e-4269-b152-840e8dba687f admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:54.660336 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd98b804-b06e-4269-b152-840e8dba687f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:27:54.662894 dv-cinder-749155-9-smb devstack@keystone.service[80338]: WARNING py.warnings [None req-bd98b804-b06e-4269-b152-840e8dba687f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 19:27:54.662894 dv-cinder-749155-9-smb devstack@keystone.service[80338]: warnings.warn(msg) Jul 21 19:27:54.662894 dv-cinder-749155-9-smb devstack@keystone.service[80338]: Jul 21 19:27:54.664054 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd98b804-b06e-4269-b152-840e8dba687f admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:27:54.683959 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 747/1478] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Jul 21 19:27:54 2022] GET /identity/v3/projects => generated 2553 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:27:56.717943 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b9c59-9299-4260-b305-8c9708493e03 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:56.718488 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b9c59-9299-4260-b305-8c9708493e03 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:56.718488 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b9c59-9299-4260-b305-8c9708493e03 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:56.719868 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 732/1479] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:27:56.725998 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce264bd-3b20-43e2-ae8a-2a1c33b82c20 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:56.726427 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce264bd-3b20-43e2-ae8a-2a1c33b82c20 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:56.726563 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce264bd-3b20-43e2-ae8a-2a1c33b82c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:56.790270 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-8ce264bd-3b20-43e2-ae8a-2a1c33b82c20 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:27:56.791503 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-8ce264bd-3b20-43e2-ae8a-2a1c33b82c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:56.887148 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 748/1480] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:27:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:27:56.931002 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b9c59-9299-4260-b305-8c9708493e03 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:27:56.932553 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-ce1b9c59-9299-4260-b305-8c9708493e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:56.942500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:27:57.073493 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b9c59-9299-4260-b305-8c9708493e03 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:27:57.151143 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:27:57.183578 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b8fa4-8513-4488-a9a6-aafa5545b088 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:27:57.184225 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b8fa4-8513-4488-a9a6-aafa5545b088 service nova] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:57.184515 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b8fa4-8513-4488-a9a6-aafa5545b088 service nova] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:57.184792 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b8fa4-8513-4488-a9a6-aafa5545b088 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:57.186683 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-135b8fa4-8513-4488-a9a6-aafa5545b088 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:57.275591 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135b8fa4-8513-4488-a9a6-aafa5545b088 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:27:57.277199 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135b8fa4-8513-4488-a9a6-aafa5545b088 service nova] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:27:57.294833 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 733/1481] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:27:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:27:59.518647 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d6a1e-71f7-4e82-a22d-2811917eafc3 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:59.519212 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d6a1e-71f7-4e82-a22d-2811917eafc3 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:59.519212 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d6a1e-71f7-4e82-a22d-2811917eafc3 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:59.521128 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 749/1482] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:27:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:27:59.526429 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4e2aa-e655-4b14-a15a-3354d93e23b0 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:59.526820 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4e2aa-e655-4b14-a15a-3354d93e23b0 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:59.526988 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4e2aa-e655-4b14-a15a-3354d93e23b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:59.590895 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-a9f4e2aa-e655-4b14-a15a-3354d93e23b0 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:27:59.592123 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-a9f4e2aa-e655-4b14-a15a-3354d93e23b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:59.636784 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:27:59.685585 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 734/1483] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:27:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:27:59.722825 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d6a1e-71f7-4e82-a22d-2811917eafc3 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:27:59.724533 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-be5d6a1e-71f7-4e82-a22d-2811917eafc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:59.748833 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:27:59.828506 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d6a1e-71f7-4e82-a22d-2811917eafc3 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:27:59.901600 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f42b1-69bd-4998-9fff-9421105e0b0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:27:59.902251 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f42b1-69bd-4998-9fff-9421105e0b0f service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:27:59.902536 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f42b1-69bd-4998-9fff-9421105e0b0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:27:59.902815 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f42b1-69bd-4998-9fff-9421105e0b0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:27:59.904500 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-7c4f42b1-69bd-4998-9fff-9421105e0b0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:27:59.978411 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:28:00.013807 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f42b1-69bd-4998-9fff-9421105e0b0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:28:00.015823 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f42b1-69bd-4998-9fff-9421105e0b0f service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:28:00.036993 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 750/1484] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:27:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:28:02.134508 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695dfdbb-56cf-4a4a-9e03-397f525ea5d3 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:28:02.135073 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695dfdbb-56cf-4a4a-9e03-397f525ea5d3 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:28:02.135073 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695dfdbb-56cf-4a4a-9e03-397f525ea5d3 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:28:02.136522 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 735/1485] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:28:02.141924 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a5b1d-9e15-4575-bed7-70a51472239b None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:28:02.142399 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a5b1d-9e15-4575-bed7-70a51472239b None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:28:02.142496 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a5b1d-9e15-4575-bed7-70a51472239b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:28:02.209860 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-849a5b1d-9e15-4575-bed7-70a51472239b None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:28:02.211082 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-849a5b1d-9e15-4575-bed7-70a51472239b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:28:02.308173 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 751/1486] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:28:02.347605 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695dfdbb-56cf-4a4a-9e03-397f525ea5d3 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:28:02.349120 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-695dfdbb-56cf-4a4a-9e03-397f525ea5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:28:02.453076 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695dfdbb-56cf-4a4a-9e03-397f525ea5d3 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:28:02.524354 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:28:02.526084 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f40b750-97f0-4dde-b866-258090def23a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:28:02.526732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40b750-97f0-4dde-b866-258090def23a service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:28:02.527016 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40b750-97f0-4dde-b866-258090def23a service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:28:02.527294 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40b750-97f0-4dde-b866-258090def23a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:28:02.528977 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-4f40b750-97f0-4dde-b866-258090def23a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:28:02.636688 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f40b750-97f0-4dde-b866-258090def23a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:28:02.638146 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f40b750-97f0-4dde-b866-258090def23a service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:28:02.658252 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 736/1487] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:28:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:28:04.824071 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87ca20-cf8b-4be9-80ce-5370fadb5985 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:28:04.824589 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87ca20-cf8b-4be9-80ce-5370fadb5985 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:28:04.824589 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87ca20-cf8b-4be9-80ce-5370fadb5985 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:28:04.825916 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 752/1488] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:28:04.831037 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691ee2a-9b95-4ab4-9c96-6daee595875b None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:28:04.831508 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691ee2a-9b95-4ab4-9c96-6daee595875b None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:28:04.831639 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691ee2a-9b95-4ab4-9c96-6daee595875b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:28:04.897326 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-a691ee2a-9b95-4ab4-9c96-6daee595875b None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:28:04.898630 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-a691ee2a-9b95-4ab4-9c96-6daee595875b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:28:04.953278 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:28:04.998639 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 737/1489] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:28:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:28:05.040230 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87ca20-cf8b-4be9-80ce-5370fadb5985 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:28:05.041756 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-7e87ca20-cf8b-4be9-80ce-5370fadb5985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:28:05.078716 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:28:05.147251 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87ca20-cf8b-4be9-80ce-5370fadb5985 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:28:05.220282 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f068226-e708-4972-bf96-120f98a1a81e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:28:05.220927 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f068226-e708-4972-bf96-120f98a1a81e service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:28:05.221211 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f068226-e708-4972-bf96-120f98a1a81e service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:28:05.221486 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f068226-e708-4972-bf96-120f98a1a81e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:28:05.223131 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-9f068226-e708-4972-bf96-120f98a1a81e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:28:05.304145 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:28:05.332809 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f068226-e708-4972-bf96-120f98a1a81e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:28:05.334276 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f068226-e708-4972-bf96-120f98a1a81e service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:28:05.352814 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 753/1490] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:28:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:28:07.881635 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137eb71f-fde5-4c75-9a73-b4a81ce70afa None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:28:07.882162 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137eb71f-fde5-4c75-9a73-b4a81ce70afa None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:28:07.882162 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137eb71f-fde5-4c75-9a73-b4a81ce70afa None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:28:07.883487 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 738/1491] 10.222.0.60 () {54 vars in 926 bytes} [Thu Jul 21 19:28:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:28:07.888811 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f387df-e68f-4505-862a-f0ad552b203f None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:28:07.889278 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f387df-e68f-4505-862a-f0ad552b203f None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:28:07.889376 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f387df-e68f-4505-862a-f0ad552b203f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:28:07.957685 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-c7f387df-e68f-4505-862a-f0ad552b203f None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:28:07.959206 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-c7f387df-e68f-4505-862a-f0ad552b203f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:28:08.058248 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 754/1492] 10.222.0.60 () {58 vars in 1023 bytes} [Thu Jul 21 19:28:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:28:08.100705 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137eb71f-fde5-4c75-9a73-b4a81ce70afa None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:28:08.102261 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-137eb71f-fde5-4c75-9a73-b4a81ce70afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:28:08.205251 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137eb71f-fde5-4c75-9a73-b4a81ce70afa None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:28:08.277053 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f076e-853e-4443-bd0d-56ee6deaf63c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:28:08.277699 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f076e-853e-4443-bd0d-56ee6deaf63c service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:28:08.277987 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f076e-853e-4443-bd0d-56ee6deaf63c service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:28:08.278269 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f076e-853e-4443-bd0d-56ee6deaf63c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:28:08.279919 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-212f076e-853e-4443-bd0d-56ee6deaf63c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:28:08.289491 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:28:08.387712 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f076e-853e-4443-bd0d-56ee6deaf63c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:28:08.389180 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f076e-853e-4443-bd0d-56ee6deaf63c service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:28:08.406840 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 739/1493] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:28:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 19:28:18.056383 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=82 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:28:18.404627 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=50 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:29:44.235877 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb94133-8b6b-41c0-bca3-9cd37fca7189 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:29:44.236478 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb94133-8b6b-41c0-bca3-9cd37fca7189 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:29:44.236478 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb94133-8b6b-41c0-bca3-9cd37fca7189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:29:44.312414 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-0bb94133-8b6b-41c0-bca3-9cd37fca7189 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:29:44.313636 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-0bb94133-8b6b-41c0-bca3-9cd37fca7189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:29:44.411137 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 755/1494] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:29:44.419066 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5c186-10fa-41f5-9d7d-386e90a8deca None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:29:44.419575 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5c186-10fa-41f5-9d7d-386e90a8deca None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:29:44.419671 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5c186-10fa-41f5-9d7d-386e90a8deca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:29:44.497085 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-6be5c186-10fa-41f5-9d7d-386e90a8deca None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:29:44.498221 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-6be5c186-10fa-41f5-9d7d-386e90a8deca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:29:44.595225 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 740/1495] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:29:44.600671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb94133-8b6b-41c0-bca3-9cd37fca7189 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:29:44.601874 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-0bb94133-8b6b-41c0-bca3-9cd37fca7189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:29:44.615096 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb94133-8b6b-41c0-bca3-9cd37fca7189 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:29:44.678309 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:29:44.712030 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e9a8a-6606-40f7-9ecd-f1687851dbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:29:44.713727 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e9a8a-6606-40f7-9ecd-f1687851dbea admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:29:44.713727 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e9a8a-6606-40f7-9ecd-f1687851dbea admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:29:44.713727 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e9a8a-6606-40f7-9ecd-f1687851dbea admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:29:44.714079 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e9a8a-6606-40f7-9ecd-f1687851dbea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:29:44.714180 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e9a8a-6606-40f7-9ecd-f1687851dbea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:29:44.715195 dv-cinder-749155-9-smb devstack@keystone.service[80338]: WARNING py.warnings [None req-d87e9a8a-6606-40f7-9ecd-f1687851dbea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 19:29:44.715195 dv-cinder-749155-9-smb devstack@keystone.service[80338]: warnings.warn(msg) Jul 21 19:29:44.715195 dv-cinder-749155-9-smb devstack@keystone.service[80338]: Jul 21 19:29:44.716117 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e9a8a-6606-40f7-9ecd-f1687851dbea admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:29:44.728151 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 756/1496] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:29:44.736300 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be5c186-10fa-41f5-9d7d-386e90a8deca None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:29:44.745440 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be5c186-10fa-41f5-9d7d-386e90a8deca None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:29:44.805951 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:29:44.839427 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fd26e-2da5-4cf8-9b62-8e58551638c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:29:44.840128 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fd26e-2da5-4cf8-9b62-8e58551638c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:29:44.840619 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fd26e-2da5-4cf8-9b62-8e58551638c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:29:44.840941 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fd26e-2da5-4cf8-9b62-8e58551638c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:29:44.841831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0fd26e-2da5-4cf8-9b62-8e58551638c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:29:44.843914 dv-cinder-749155-9-smb devstack@keystone.service[80339]: WARNING py.warnings [None req-3d0fd26e-2da5-4cf8-9b62-8e58551638c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 19:29:44.843914 dv-cinder-749155-9-smb devstack@keystone.service[80339]: warnings.warn(msg) Jul 21 19:29:44.843914 dv-cinder-749155-9-smb devstack@keystone.service[80339]: Jul 21 19:29:44.845106 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0fd26e-2da5-4cf8-9b62-8e58551638c8 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:29:44.975913 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 741/1497] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:29:44 2022] POST /identity/v3/projects => generated 377 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:29:44.980238 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e9a8a-6606-40f7-9ecd-f1687851dbea admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:29:44.981779 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-d87e9a8a-6606-40f7-9ecd-f1687851dbea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:29:45.015031 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e9a8a-6606-40f7-9ecd-f1687851dbea admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:29:45.110596 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1ae85-e5bf-4917-ae52-095691de017a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:29:45.111179 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1ae85-e5bf-4917-ae52-095691de017a admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:29:45.111490 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1ae85-e5bf-4917-ae52-095691de017a admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:29:45.111768 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1ae85-e5bf-4917-ae52-095691de017a admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:29:45.112622 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d1ae85-e5bf-4917-ae52-095691de017a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:29:45.113678 dv-cinder-749155-9-smb devstack@keystone.service[80338]: WARNING py.warnings [None req-95d1ae85-e5bf-4917-ae52-095691de017a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 19:29:45.113678 dv-cinder-749155-9-smb devstack@keystone.service[80338]: warnings.warn(msg) Jul 21 19:29:45.113678 dv-cinder-749155-9-smb devstack@keystone.service[80338]: Jul 21 19:29:45.114880 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d1ae85-e5bf-4917-ae52-095691de017a admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:29:45.327881 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 757/1498] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:29:44 2022] POST /identity/v3/users => generated 289 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:29:45.332524 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fd26e-2da5-4cf8-9b62-8e58551638c8 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:29:45.334019 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-3d0fd26e-2da5-4cf8-9b62-8e58551638c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:29:45.394712 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fd26e-2da5-4cf8-9b62-8e58551638c8 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:29:45.478025 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:29:45.488929 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86436b3-5f3d-4b5b-9dad-96dc8518637e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:29:45.489592 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86436b3-5f3d-4b5b-9dad-96dc8518637e admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:29:45.489875 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86436b3-5f3d-4b5b-9dad-96dc8518637e admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:29:45.490150 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86436b3-5f3d-4b5b-9dad-96dc8518637e admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:29:45.490867 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86436b3-5f3d-4b5b-9dad-96dc8518637e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:29:45.491903 dv-cinder-749155-9-smb devstack@keystone.service[80339]: WARNING py.warnings [None req-d86436b3-5f3d-4b5b-9dad-96dc8518637e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 19:29:45.491903 dv-cinder-749155-9-smb devstack@keystone.service[80339]: warnings.warn(msg) Jul 21 19:29:45.491903 dv-cinder-749155-9-smb devstack@keystone.service[80339]: Jul 21 19:29:45.492783 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86436b3-5f3d-4b5b-9dad-96dc8518637e admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:29:45.506320 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 742/1499] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 19:29:45.510400 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1ae85-e5bf-4917-ae52-095691de017a admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:29:45.511950 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-95d1ae85-e5bf-4917-ae52-095691de017a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:29:45.523595 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1ae85-e5bf-4917-ae52-095691de017a admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:29:45.548421 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:29:45.617254 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d64581-1f48-429c-a6c6-90ca713de1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:29:45.617937 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d64581-1f48-429c-a6c6-90ca713de1c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:29:45.618213 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d64581-1f48-429c-a6c6-90ca713de1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:29:45.618482 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d64581-1f48-429c-a6c6-90ca713de1c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:29:45.619269 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d64581-1f48-429c-a6c6-90ca713de1c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:29:45.620301 dv-cinder-749155-9-smb devstack@keystone.service[80338]: WARNING py.warnings [None req-12d64581-1f48-429c-a6c6-90ca713de1c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 19:29:45.620301 dv-cinder-749155-9-smb devstack@keystone.service[80338]: warnings.warn(msg) Jul 21 19:29:45.620301 dv-cinder-749155-9-smb devstack@keystone.service[80338]: Jul 21 19:29:45.621174 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d64581-1f48-429c-a6c6-90ca713de1c9 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:29:45.635008 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 758/1500] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:29:45.639094 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86436b3-5f3d-4b5b-9dad-96dc8518637e admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:29:45.640649 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-d86436b3-5f3d-4b5b-9dad-96dc8518637e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:29:45.673429 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86436b3-5f3d-4b5b-9dad-96dc8518637e admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:29:45.767373 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef1e25-0a78-4280-8cf8-007a3a8b878c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:29:45.768322 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef1e25-0a78-4280-8cf8-007a3a8b878c admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:29:45.768784 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef1e25-0a78-4280-8cf8-007a3a8b878c admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:29:45.769063 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef1e25-0a78-4280-8cf8-007a3a8b878c admin admin] PATH_INFO: `/v3/projects/5cce2a278a424fbcbdadea6ccaaacb52/users/95466a2bda6e47a1a18a9af650510006/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:29:45.790440 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef1e25-0a78-4280-8cf8-007a3a8b878c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cce2a278a424fbcbdadea6ccaaacb52, user_id=95466a2bda6e47a1a18a9af650510006, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:29:45.791483 dv-cinder-749155-9-smb devstack@keystone.service[80339]: WARNING py.warnings [None req-f1ef1e25-0a78-4280-8cf8-007a3a8b878c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 19:29:45.791483 dv-cinder-749155-9-smb devstack@keystone.service[80339]: warnings.warn(msg) Jul 21 19:29:45.791483 dv-cinder-749155-9-smb devstack@keystone.service[80339]: Jul 21 19:29:45.793405 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef1e25-0a78-4280-8cf8-007a3a8b878c admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:29:45.870616 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 743/1501] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:29:45 2022] PUT /identity/v3/projects/5cce2a278a424fbcbdadea6ccaaacb52/users/95466a2bda6e47a1a18a9af650510006/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:29:45.882879 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c28570-5ead-4010-8bf2-7b277d4e00f7 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:29:45.883159 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c28570-5ead-4010-8bf2-7b277d4e00f7 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:29:45.883489 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c28570-5ead-4010-8bf2-7b277d4e00f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:29:45.939005 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-69c28570-5ead-4010-8bf2-7b277d4e00f7 None None] MFA Rules not processed for user `95466a2bda6e47a1a18a9af650510006`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:29:45.940199 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-69c28570-5ead-4010-8bf2-7b277d4e00f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:29:46.017331 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 759/1502] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:29:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:29:46.030922 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b4334-af6a-4365-84ce-1e6928592453 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:29:46.031221 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b4334-af6a-4365-84ce-1e6928592453 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:29:46.031549 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b4334-af6a-4365-84ce-1e6928592453 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:29:46.032899 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 744/1503] 10.222.0.60 () {54 vars in 964 bytes} [Thu Jul 21 19:29:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:29:46.038349 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88959c67-a578-4759-bbf4-2f578b0ff091 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:29:46.038635 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88959c67-a578-4759-bbf4-2f578b0ff091 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:29:46.038910 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88959c67-a578-4759-bbf4-2f578b0ff091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:29:46.068813 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:29:46.111547 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-88959c67-a578-4759-bbf4-2f578b0ff091 None None] MFA Rules not processed for user `591016b95ab24d3a8de83089a141d914`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:29:46.113449 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-88959c67-a578-4759-bbf4-2f578b0ff091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:29:46.190159 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 760/1504] 10.222.0.60 () {58 vars in 1061 bytes} [Thu Jul 21 19:29:46 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:29:46.198061 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b4334-af6a-4365-84ce-1e6928592453 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:29:46.199594 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-570b4334-af6a-4365-84ce-1e6928592453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:29:46.248598 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:29:46.301199 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b4334-af6a-4365-84ce-1e6928592453 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:29:46.372772 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea8a11-0c1f-4915-ba05-890a7ad95b3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:29:46.373451 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea8a11-0c1f-4915-ba05-890a7ad95b3b service cinder] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:29:46.373735 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea8a11-0c1f-4915-ba05-890a7ad95b3b service cinder] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:29:46.374013 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea8a11-0c1f-4915-ba05-890a7ad95b3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:29:46.375673 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-c9ea8a11-0c1f-4915-ba05-890a7ad95b3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:29:46.475088 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea8a11-0c1f-4915-ba05-890a7ad95b3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:29:46.476507 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea8a11-0c1f-4915-ba05-890a7ad95b3b service cinder] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:29:46.480059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:29:46.494608 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 745/1505] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:29:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:29:46.537086 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096113d-88cf-4a05-9783-22d3f3e2544d None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:29:46.537506 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096113d-88cf-4a05-9783-22d3f3e2544d None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:29:46.537652 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096113d-88cf-4a05-9783-22d3f3e2544d None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:29:46.538932 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 761/1506] 10.222.0.60 () {52 vars in 829 bytes} [Thu Jul 21 19:29:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:29:46.542585 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea8a11-0c1f-4915-ba05-890a7ad95b3b service cinder] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:29:46.543818 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-c9ea8a11-0c1f-4915-ba05-890a7ad95b3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:29:46.639982 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea8a11-0c1f-4915-ba05-890a7ad95b3b service cinder] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:29:46.732425 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd01c6d-a26f-4607-9821-095fa0266ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:29:46.733218 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd01c6d-a26f-4607-9821-095fa0266ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:29:46.733500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd01c6d-a26f-4607-9821-095fa0266ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:29:46.733779 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd01c6d-a26f-4607-9821-095fa0266ffb admin admin] PATH_INFO: `/v3/users/95466a2bda6e47a1a18a9af650510006` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:29:46.745652 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd01c6d-a26f-4607-9821-095fa0266ffb admin admin] RBAC: Authorizing `identity:delete_user(user_id=95466a2bda6e47a1a18a9af650510006)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:29:46.746676 dv-cinder-749155-9-smb devstack@keystone.service[80339]: WARNING py.warnings [None req-3cd01c6d-a26f-4607-9821-095fa0266ffb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 19:29:46.746676 dv-cinder-749155-9-smb devstack@keystone.service[80339]: warnings.warn(msg) Jul 21 19:29:46.746676 dv-cinder-749155-9-smb devstack@keystone.service[80339]: Jul 21 19:29:46.747916 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd01c6d-a26f-4607-9821-095fa0266ffb admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:29:46.757818 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:29:46.972025 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-3cd01c6d-a26f-4607-9821-095fa0266ffb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95466a2bda6e47a1a18a9af650510006'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:29:47.045583 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-3cd01c6d-a26f-4607-9821-095fa0266ffb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95466a2bda6e47a1a18a9af650510006'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:29:47.064345 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-3cd01c6d-a26f-4607-9821-095fa0266ffb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95466a2bda6e47a1a18a9af650510006'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:29:47.066708 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-3cd01c6d-a26f-4607-9821-095fa0266ffb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95466a2bda6e47a1a18a9af650510006'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:29:47.077408 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-3cd01c6d-a26f-4607-9821-095fa0266ffb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95466a2bda6e47a1a18a9af650510006'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:29:47.083143 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 746/1507] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:29:46 2022] DELETE /identity/v3/users/95466a2bda6e47a1a18a9af650510006 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:29:47.087731 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80f6c1-4057-4891-aab7-b5150c56876d None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:29:47.088029 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80f6c1-4057-4891-aab7-b5150c56876d None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:29:47.088315 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80f6c1-4057-4891-aab7-b5150c56876d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:29:47.143264 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-ab80f6c1-4057-4891-aab7-b5150c56876d None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:29:47.144578 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ab80f6c1-4057-4891-aab7-b5150c56876d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:29:47.221855 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:29:47.234285 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 762/1508] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:29:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:29:47.249122 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd01c6d-a26f-4607-9821-095fa0266ffb admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:29:47.250409 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-3cd01c6d-a26f-4607-9821-095fa0266ffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:29:47.384805 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd01c6d-a26f-4607-9821-095fa0266ffb admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:29:47.417879 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:29:47.538193 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216d8d0-2427-47d6-bd48-8cec6a2baeae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:29:47.538193 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216d8d0-2427-47d6-bd48-8cec6a2baeae service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:29:47.538193 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216d8d0-2427-47d6-bd48-8cec6a2baeae service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:29:47.538193 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216d8d0-2427-47d6-bd48-8cec6a2baeae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:29:47.539083 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-c216d8d0-2427-47d6-bd48-8cec6a2baeae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:29:47.552799 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216d8d0-2427-47d6-bd48-8cec6a2baeae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:29:47.554243 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216d8d0-2427-47d6-bd48-8cec6a2baeae service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:29:47.572975 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 747/1509] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:29:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:29:48.117707 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80f6c1-4057-4891-aab7-b5150c56876d None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:29:48.118979 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ab80f6c1-4057-4891-aab7-b5150c56876d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:29:48.131353 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80f6c1-4057-4891-aab7-b5150c56876d None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:29:48.229476 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe192b7-3a47-43ff-893f-b711f667b955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:29:48.230365 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe192b7-3a47-43ff-893f-b711f667b955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:29:48.230651 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe192b7-3a47-43ff-893f-b711f667b955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:29:48.230925 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe192b7-3a47-43ff-893f-b711f667b955 admin admin] PATH_INFO: `/v3/projects/5cce2a278a424fbcbdadea6ccaaacb52` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:29:48.240996 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe192b7-3a47-43ff-893f-b711f667b955 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cce2a278a424fbcbdadea6ccaaacb52)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:29:48.242038 dv-cinder-749155-9-smb devstack@keystone.service[80338]: WARNING py.warnings [None req-afe192b7-3a47-43ff-893f-b711f667b955 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 19:29:48.242038 dv-cinder-749155-9-smb devstack@keystone.service[80338]: warnings.warn(msg) Jul 21 19:29:48.242038 dv-cinder-749155-9-smb devstack@keystone.service[80338]: Jul 21 19:29:48.243223 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe192b7-3a47-43ff-893f-b711f667b955 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:29:48.377778 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-afe192b7-3a47-43ff-893f-b711f667b955 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cce2a278a424fbcbdadea6ccaaacb52', 'request_id': 'req-afe192b7-3a47-43ff-893f-b711f667b955'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:29:48.391979 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-afe192b7-3a47-43ff-893f-b711f667b955 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cce2a278a424fbcbdadea6ccaaacb52', 'request_id': 'req-afe192b7-3a47-43ff-893f-b711f667b955'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:29:48.505104 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-afe192b7-3a47-43ff-893f-b711f667b955 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cce2a278a424fbcbdadea6ccaaacb52', 'request_id': 'req-afe192b7-3a47-43ff-893f-b711f667b955'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:29:48.529539 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-afe192b7-3a47-43ff-893f-b711f667b955 admin admin] The token cache is being invalidate because project 5cce2a278a424fbcbdadea6ccaaacb52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:29:48.529831 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-afe192b7-3a47-43ff-893f-b711f667b955 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:29:48.530365 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-afe192b7-3a47-43ff-893f-b711f667b955 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:29:48.531776 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 763/1510] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:29:48 2022] DELETE /identity/v3/projects/5cce2a278a424fbcbdadea6ccaaacb52 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:29:57.784998 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=62 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:29:58.527496 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:31:35.418700 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f24447-f5af-4871-bac8-8f9354b5b40c None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:31:35.419305 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f24447-f5af-4871-bac8-8f9354b5b40c None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:31:35.419305 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f24447-f5af-4871-bac8-8f9354b5b40c None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:31:35.420718 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 748/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 19:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:31:35.425961 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5655856-2f6f-41ab-a454-0cbae32ab28d None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:31:35.426391 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5655856-2f6f-41ab-a454-0cbae32ab28d None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:31:35.426556 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5655856-2f6f-41ab-a454-0cbae32ab28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:31:35.506346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-d5655856-2f6f-41ab-a454-0cbae32ab28d None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:31:35.507657 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-d5655856-2f6f-41ab-a454-0cbae32ab28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:31:35.612941 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 764/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 19:31:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:31:35.765322 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f24447-f5af-4871-bac8-8f9354b5b40c None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:31:35.767557 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-a0f24447-f5af-4871-bac8-8f9354b5b40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:31:35.883036 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f24447-f5af-4871-bac8-8f9354b5b40c None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:31:35.888465 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be0bdd-4452-4127-b21a-993d66e0802a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:31:35.889109 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be0bdd-4452-4127-b21a-993d66e0802a service nova] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:31:35.889393 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be0bdd-4452-4127-b21a-993d66e0802a service nova] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:31:35.889667 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be0bdd-4452-4127-b21a-993d66e0802a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:31:35.897572 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be0bdd-4452-4127-b21a-993d66e0802a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:31:35.899134 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be0bdd-4452-4127-b21a-993d66e0802a service nova] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:31:35.908731 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 749/1513] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:31:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:31:36.739875 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc23de-97f0-433f-ad70-d0c4a3681d70 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:31:36.740408 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc23de-97f0-433f-ad70-d0c4a3681d70 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:31:36.740408 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc23de-97f0-433f-ad70-d0c4a3681d70 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:31:36.741774 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 765/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 19:31:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:31:36.746778 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eeb97c-12ab-43a9-808c-acbe36f41c3f None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:31:36.747202 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eeb97c-12ab-43a9-808c-acbe36f41c3f None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:31:36.747343 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eeb97c-12ab-43a9-808c-acbe36f41c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:31:36.765938 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-f9eeb97c-12ab-43a9-808c-acbe36f41c3f None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:31:36.767147 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-f9eeb97c-12ab-43a9-808c-acbe36f41c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:31:36.775028 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 750/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 19:31:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:31:36.930440 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc23de-97f0-433f-ad70-d0c4a3681d70 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:31:36.946575 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc23de-97f0-433f-ad70-d0c4a3681d70 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:31:36.953082 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226f5a3-b149-43fd-9dcb-112c9edf0182 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:31:36.953725 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226f5a3-b149-43fd-9dcb-112c9edf0182 service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:31:36.954010 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226f5a3-b149-43fd-9dcb-112c9edf0182 service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:31:36.954291 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226f5a3-b149-43fd-9dcb-112c9edf0182 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:31:36.963043 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226f5a3-b149-43fd-9dcb-112c9edf0182 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:31:36.964733 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226f5a3-b149-43fd-9dcb-112c9edf0182 service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:31:36.974482 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 766/1516] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:31:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:31:37.245689 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027bc4bb-e3a0-416c-b6a3-c681674c3e99 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:31:37.245968 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027bc4bb-e3a0-416c-b6a3-c681674c3e99 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:31:37.246258 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027bc4bb-e3a0-416c-b6a3-c681674c3e99 None None] PATH_INFO: `/v3` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:31:37.247623 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 751/1517] 10.222.0.47 () {54 vars in 925 bytes} [Thu Jul 21 19:31:37 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:31:37.253608 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9196252-b765-4ece-bd5d-9b66f225c651 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:31:37.253966 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9196252-b765-4ece-bd5d-9b66f225c651 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:31:37.254250 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9196252-b765-4ece-bd5d-9b66f225c651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:31:37.311244 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-b9196252-b765-4ece-bd5d-9b66f225c651 None None] MFA Rules not processed for user `bcc5eefc2f7c419190e96b46b163fedd`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:31:37.312402 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-b9196252-b765-4ece-bd5d-9b66f225c651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:31:37.329186 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:31:37.384028 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 767/1518] 10.222.0.47 () {58 vars in 1015 bytes} [Thu Jul 21 19:31:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:31:41.389449 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31b458-66c8-4996-a7e9-50ccb038cd6f None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:31:41.389991 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31b458-66c8-4996-a7e9-50ccb038cd6f None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:31:41.389991 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31b458-66c8-4996-a7e9-50ccb038cd6f None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:31:41.391344 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 752/1519] 10.222.0.60 () {54 vars in 961 bytes} [Thu Jul 21 19:31:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:31:41.396490 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877e741-1d21-45ac-8053-f4f0548701f5 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:31:41.396919 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877e741-1d21-45ac-8053-f4f0548701f5 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:31:41.397052 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877e741-1d21-45ac-8053-f4f0548701f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:31:41.415354 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-5877e741-1d21-45ac-8053-f4f0548701f5 None None] MFA Rules not processed for user `bcc5eefc2f7c419190e96b46b163fedd`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:31:41.416572 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-5877e741-1d21-45ac-8053-f4f0548701f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:31:41.426220 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 768/1520] 10.222.0.60 () {58 vars in 1058 bytes} [Thu Jul 21 19:31:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:31:41.433640 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31b458-66c8-4996-a7e9-50ccb038cd6f None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:31:41.447048 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31b458-66c8-4996-a7e9-50ccb038cd6f None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:31:41.452454 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ab454-9090-49ea-aafa-cb8ecb100a5c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcc5eefc2f7c419190e96b46b163fedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:31:41.453091 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ab454-9090-49ea-aafa-cb8ecb100a5c service placement] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:31:41.453407 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ab454-9090-49ea-aafa-cb8ecb100a5c service placement] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:31:41.453686 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ab454-9090-49ea-aafa-cb8ecb100a5c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:31:41.461886 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ab454-9090-49ea-aafa-cb8ecb100a5c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:31:41.463450 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ab454-9090-49ea-aafa-cb8ecb100a5c service placement] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:31:41.473548 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 753/1521] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:31:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 19:31:48.225044 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193bc246-1400-4bab-85cd-2a81848adfc6 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:31:48.225658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193bc246-1400-4bab-85cd-2a81848adfc6 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:31:48.225658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193bc246-1400-4bab-85cd-2a81848adfc6 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:31:48.226981 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 769/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 19:31:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:31:48.231785 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887ba8d-d20e-46df-836a-238d399636fe None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:31:48.232227 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887ba8d-d20e-46df-836a-238d399636fe None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:31:48.232378 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887ba8d-d20e-46df-836a-238d399636fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:31:48.250449 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-0887ba8d-d20e-46df-836a-238d399636fe None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:31:48.251661 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-0887ba8d-d20e-46df-836a-238d399636fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:31:48.259733 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 754/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 19:31:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:31:48.414011 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193bc246-1400-4bab-85cd-2a81848adfc6 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:31:48.429278 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193bc246-1400-4bab-85cd-2a81848adfc6 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:31:48.435235 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b65aabb-cae4-4fe7-8213-297e31a2de98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:31:48.435990 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b65aabb-cae4-4fe7-8213-297e31a2de98 service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:31:48.436191 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b65aabb-cae4-4fe7-8213-297e31a2de98 service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:31:48.436472 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b65aabb-cae4-4fe7-8213-297e31a2de98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:31:48.445305 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b65aabb-cae4-4fe7-8213-297e31a2de98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:31:48.446918 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b65aabb-cae4-4fe7-8213-297e31a2de98 service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:31:48.457310 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 770/1524] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:31:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:31:49.278234 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2917c-8eef-447a-96bc-5247a2856d94 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:31:49.278802 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2917c-8eef-447a-96bc-5247a2856d94 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:31:49.278802 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2917c-8eef-447a-96bc-5247a2856d94 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:31:49.280317 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 755/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 19:31:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 19:31:49.285195 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d51a90-c9ed-4a9e-829a-55ab6566d36d None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:31:49.285638 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d51a90-c9ed-4a9e-829a-55ab6566d36d None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:31:49.285785 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d51a90-c9ed-4a9e-829a-55ab6566d36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:31:49.304023 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-21d51a90-c9ed-4a9e-829a-55ab6566d36d None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:31:49.305218 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-21d51a90-c9ed-4a9e-829a-55ab6566d36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:31:49.314044 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 771/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 19:31:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:31:49.464389 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2917c-8eef-447a-96bc-5247a2856d94 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:31:49.478468 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2917c-8eef-447a-96bc-5247a2856d94 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:31:49.484468 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700964d-d682-45ac-8bcd-3c44b19438a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:31:49.485099 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700964d-d682-45ac-8bcd-3c44b19438a1 service nova] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:31:49.485388 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700964d-d682-45ac-8bcd-3c44b19438a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:31:49.485663 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700964d-d682-45ac-8bcd-3c44b19438a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:31:49.493639 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700964d-d682-45ac-8bcd-3c44b19438a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:31:49.495243 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700964d-d682-45ac-8bcd-3c44b19438a1 service nova] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:31:49.505424 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 756/1527] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:31:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:31:53.521490 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab3530-fbd8-4da5-8218-5824ddd1080b None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:31:53.522017 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab3530-fbd8-4da5-8218-5824ddd1080b None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:31:53.522144 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab3530-fbd8-4da5-8218-5824ddd1080b None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:31:53.523419 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 772/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 19:31:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:31:53.528815 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1ff9f-dca5-49e9-8f29-11379298e305 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:31:53.529248 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1ff9f-dca5-49e9-8f29-11379298e305 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:31:53.529384 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1ff9f-dca5-49e9-8f29-11379298e305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:31:53.547052 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-b6c1ff9f-dca5-49e9-8f29-11379298e305 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:31:53.548282 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-b6c1ff9f-dca5-49e9-8f29-11379298e305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:31:53.556168 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 757/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 19:31:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:31:53.630829 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeab3530-fbd8-4da5-8218-5824ddd1080b None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:31:53.632559 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-aeab3530-fbd8-4da5-8218-5824ddd1080b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:31:53.711236 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeab3530-fbd8-4da5-8218-5824ddd1080b None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:31:53.714832 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249a303-ef51-49b0-ab39-84039b676609 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:31:53.715545 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249a303-ef51-49b0-ab39-84039b676609 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:31:53.715824 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249a303-ef51-49b0-ab39-84039b676609 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:31:53.716105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249a303-ef51-49b0-ab39-84039b676609 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:31:53.725097 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0249a303-ef51-49b0-ab39-84039b676609 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:31:53.726540 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0249a303-ef51-49b0-ab39-84039b676609 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:31:53.736485 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 773/1530] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:31:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:31:55.776395 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2a863-b55c-4464-916c-2b91d741d610 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:31:55.776944 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2a863-b55c-4464-916c-2b91d741d610 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:31:55.776944 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2a863-b55c-4464-916c-2b91d741d610 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:31:55.778884 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 758/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 19:31:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:31:55.784234 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b56afc-dc02-4b67-af08-f7d73fa3b5f3 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:31:55.784652 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b56afc-dc02-4b67-af08-f7d73fa3b5f3 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:31:55.784801 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b56afc-dc02-4b67-af08-f7d73fa3b5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:31:55.802888 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-b6b56afc-dc02-4b67-af08-f7d73fa3b5f3 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:31:55.804114 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-b6b56afc-dc02-4b67-af08-f7d73fa3b5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:31:55.812086 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 774/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 19:31:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:31:55.848334 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2a863-b55c-4464-916c-2b91d741d610 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:31:55.859555 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2a863-b55c-4464-916c-2b91d741d610 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:31:55.863015 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ba43e-9403-4a59-bcc8-b285cd364011 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:31:55.863688 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ba43e-9403-4a59-bcc8-b285cd364011 service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:31:55.863969 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ba43e-9403-4a59-bcc8-b285cd364011 service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:31:55.864250 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ba43e-9403-4a59-bcc8-b285cd364011 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:31:55.872908 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ba43e-9403-4a59-bcc8-b285cd364011 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:31:55.874352 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ba43e-9403-4a59-bcc8-b285cd364011 service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:31:55.883492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 759/1533] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:31:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:31:59.483790 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e284de2-8ed5-4cc0-bfa8-d371347761fa None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:31:59.484358 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e284de2-8ed5-4cc0-bfa8-d371347761fa None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:31:59.484358 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e284de2-8ed5-4cc0-bfa8-d371347761fa None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:31:59.485736 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 775/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 19:31:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:31:59.490950 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf93b0-9e30-4484-8273-b6ade5e1368f None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:31:59.491348 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf93b0-9e30-4484-8273-b6ade5e1368f None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:31:59.491573 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf93b0-9e30-4484-8273-b6ade5e1368f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:31:59.498279 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=81 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:31:59.509767 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-74bf93b0-9e30-4484-8273-b6ade5e1368f None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:31:59.517440 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-74bf93b0-9e30-4484-8273-b6ade5e1368f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:31:59.519458 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 760/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 19:31:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:31:59.821365 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e284de2-8ed5-4cc0-bfa8-d371347761fa None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:31:59.823052 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-9e284de2-8ed5-4cc0-bfa8-d371347761fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:31:59.889046 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:31:59.902346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e284de2-8ed5-4cc0-bfa8-d371347761fa None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:31:59.906230 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27956bd1-32b8-44ce-861d-bf17ff07b086 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:31:59.906948 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27956bd1-32b8-44ce-861d-bf17ff07b086 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:31:59.907231 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27956bd1-32b8-44ce-861d-bf17ff07b086 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:31:59.907534 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27956bd1-32b8-44ce-861d-bf17ff07b086 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:31:59.916587 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27956bd1-32b8-44ce-861d-bf17ff07b086 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:31:59.918007 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27956bd1-32b8-44ce-861d-bf17ff07b086 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:31:59.928028 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 776/1536] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:31:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:32:01.979822 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932542e-f59d-4b15-a154-fd1f4bc1d983 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:32:01.980363 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932542e-f59d-4b15-a154-fd1f4bc1d983 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:32:01.980363 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932542e-f59d-4b15-a154-fd1f4bc1d983 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:32:01.982157 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 761/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 19:32:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:32:01.987769 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0bdb7-8cea-4da5-b282-a85d9b1a7cd2 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:32:01.988244 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0bdb7-8cea-4da5-b282-a85d9b1a7cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:32:01.988326 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0bdb7-8cea-4da5-b282-a85d9b1a7cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:32:02.006705 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-4ee0bdb7-8cea-4da5-b282-a85d9b1a7cd2 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:32:02.007934 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-4ee0bdb7-8cea-4da5-b282-a85d9b1a7cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:32:02.016197 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 777/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 19:32:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:32:02.321850 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932542e-f59d-4b15-a154-fd1f4bc1d983 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:32:02.323601 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-7932542e-f59d-4b15-a154-fd1f4bc1d983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:32:02.336546 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932542e-f59d-4b15-a154-fd1f4bc1d983 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:32:02.340007 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed40cf-d166-49b9-a9c3-fe2da1af9d2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:32:02.341220 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed40cf-d166-49b9-a9c3-fe2da1af9d2f service cinder] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:32:02.341711 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed40cf-d166-49b9-a9c3-fe2da1af9d2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:32:02.341988 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed40cf-d166-49b9-a9c3-fe2da1af9d2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:32:02.350742 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed40cf-d166-49b9-a9c3-fe2da1af9d2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:32:02.352178 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed40cf-d166-49b9-a9c3-fe2da1af9d2f service cinder] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:32:02.362077 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 762/1539] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:32:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:32:12.001942 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=11 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:32:12.358014 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=8 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:33:34.897896 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbcf5b-65e2-408d-9705-5a13e25db2c0 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:34.898593 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbcf5b-65e2-408d-9705-5a13e25db2c0 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:34.898593 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbcf5b-65e2-408d-9705-5a13e25db2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:34.921479 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-dcdbcf5b-65e2-408d-9705-5a13e25db2c0 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:34.922680 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-dcdbcf5b-65e2-408d-9705-5a13e25db2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:34.936418 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 778/1540] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:34.946009 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe7e56-3e81-405b-bcb3-0f4a1633c70a None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:34.946613 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe7e56-3e81-405b-bcb3-0f4a1633c70a None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:34.946613 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe7e56-3e81-405b-bcb3-0f4a1633c70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:34.966544 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-bffe7e56-3e81-405b-bcb3-0f4a1633c70a None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:34.967980 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-bffe7e56-3e81-405b-bcb3-0f4a1633c70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:34.981860 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 763/1541] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:34.987076 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdbcf5b-65e2-408d-9705-5a13e25db2c0 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:35.002781 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdbcf5b-65e2-408d-9705-5a13e25db2c0 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:35.010988 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20495f32-0016-47ab-a910-f98e2b79f160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:35.011698 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20495f32-0016-47ab-a910-f98e2b79f160 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:35.011980 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20495f32-0016-47ab-a910-f98e2b79f160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:35.012252 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20495f32-0016-47ab-a910-f98e2b79f160 admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:35.012984 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20495f32-0016-47ab-a910-f98e2b79f160 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:33:35.013470 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20495f32-0016-47ab-a910-f98e2b79f160 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:35.015139 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20495f32-0016-47ab-a910-f98e2b79f160 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:35.032513 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 779/1542] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:33:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:33:35.040288 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe7e56-3e81-405b-bcb3-0f4a1633c70a None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:35.051156 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe7e56-3e81-405b-bcb3-0f4a1633c70a None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:35.060061 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a478f8-fa93-4040-8b3d-d6ac54b1423f None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:35.060987 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a478f8-fa93-4040-8b3d-d6ac54b1423f None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:35.061154 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a478f8-fa93-4040-8b3d-d6ac54b1423f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:35.064696 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f69bc-07c2-49f4-afc7-9f86e33c1e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:35.065361 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f69bc-07c2-49f4-afc7-9f86e33c1e18 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:35.066175 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f69bc-07c2-49f4-afc7-9f86e33c1e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:35.066469 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f69bc-07c2-49f4-afc7-9f86e33c1e18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:35.067154 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f69bc-07c2-49f4-afc7-9f86e33c1e18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:35.069136 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f69bc-07c2-49f4-afc7-9f86e33c1e18 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:35.102886 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-b6a478f8-fa93-4040-8b3d-d6ac54b1423f None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:35.104276 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-b6a478f8-fa93-4040-8b3d-d6ac54b1423f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:35.125687 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 780/1543] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:33:35.144766 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abeb779-646d-4854-a189-6e153262d5f9 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:35.145118 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abeb779-646d-4854-a189-6e153262d5f9 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:35.145334 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abeb779-646d-4854-a189-6e153262d5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:35.183631 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-1abeb779-646d-4854-a189-6e153262d5f9 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:35.184797 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-1abeb779-646d-4854-a189-6e153262d5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:35.196192 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 781/1544] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:33:35.201794 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abeb779-646d-4854-a189-6e153262d5f9 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:35.214901 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abeb779-646d-4854-a189-6e153262d5f9 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:35.218836 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 764/1545] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:33:35 2022] POST /identity/v3/projects => generated 385 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:33:35.227014 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed53376-bc39-43e1-8d43-5878e1460d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:35.227748 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed53376-bc39-43e1-8d43-5878e1460d00 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:35.228007 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f69bc-07c2-49f4-afc7-9f86e33c1e18 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:35.228136 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed53376-bc39-43e1-8d43-5878e1460d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:35.228313 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed53376-bc39-43e1-8d43-5878e1460d00 admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:35.229335 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed53376-bc39-43e1-8d43-5878e1460d00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:33:35.229650 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed53376-bc39-43e1-8d43-5878e1460d00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:35.231449 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed53376-bc39-43e1-8d43-5878e1460d00 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:35.250870 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 782/1546] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:33:35.258932 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed53376-bc39-43e1-8d43-5878e1460d00 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:35.280933 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed53376-bc39-43e1-8d43-5878e1460d00 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:35.362592 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f69bc-07c2-49f4-afc7-9f86e33c1e18 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:35.377418 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16e9cc-c7dc-4b98-8c66-a1864a559e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:35.378107 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16e9cc-c7dc-4b98-8c66-a1864a559e09 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:35.378395 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16e9cc-c7dc-4b98-8c66-a1864a559e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:35.378673 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16e9cc-c7dc-4b98-8c66-a1864a559e09 admin admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:35.379370 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de16e9cc-c7dc-4b98-8c66-a1864a559e09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:35.380446 dv-cinder-749155-9-smb devstack@keystone.service[80339]: WARNING py.warnings [None req-de16e9cc-c7dc-4b98-8c66-a1864a559e09 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 19:33:35.380446 dv-cinder-749155-9-smb devstack@keystone.service[80339]: warnings.warn(msg) Jul 21 19:33:35.380446 dv-cinder-749155-9-smb devstack@keystone.service[80339]: Jul 21 19:33:35.382040 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de16e9cc-c7dc-4b98-8c66-a1864a559e09 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:35.403024 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d4b1c-f892-4637-9752-3fd31fb080ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:35.403730 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d4b1c-f892-4637-9752-3fd31fb080ea admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:35.404132 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d4b1c-f892-4637-9752-3fd31fb080ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:35.404364 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d4b1c-f892-4637-9752-3fd31fb080ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:35.405036 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114d4b1c-f892-4637-9752-3fd31fb080ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:35.406102 dv-cinder-749155-9-smb devstack@keystone.service[80338]: WARNING py.warnings [None req-114d4b1c-f892-4637-9752-3fd31fb080ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 19:33:35.406102 dv-cinder-749155-9-smb devstack@keystone.service[80338]: warnings.warn(msg) Jul 21 19:33:35.406102 dv-cinder-749155-9-smb devstack@keystone.service[80338]: Jul 21 19:33:35.407315 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114d4b1c-f892-4637-9752-3fd31fb080ea admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:35.482736 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 765/1547] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:33:35 2022] POST /identity/v3/users => generated 293 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 19:33:35.484073 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8965209-25f3-424e-beed-776a224dd643 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:35.484371 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8965209-25f3-424e-beed-776a224dd643 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:35.484858 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8965209-25f3-424e-beed-776a224dd643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:35.512603 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-c8965209-25f3-424e-beed-776a224dd643 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:35.514635 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-c8965209-25f3-424e-beed-776a224dd643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:35.530781 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 766/1548] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:35.531647 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8965209-25f3-424e-beed-776a224dd643 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:35.545339 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8965209-25f3-424e-beed-776a224dd643 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:35.552859 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e3191-8a24-4288-b1fd-a8bc9c36f56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:35.553667 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e3191-8a24-4288-b1fd-a8bc9c36f56c admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:35.553958 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e3191-8a24-4288-b1fd-a8bc9c36f56c admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:35.554237 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e3191-8a24-4288-b1fd-a8bc9c36f56c admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:35.554964 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e3191-8a24-4288-b1fd-a8bc9c36f56c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:35.556644 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e3191-8a24-4288-b1fd-a8bc9c36f56c admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:35.568191 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 783/1549] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:33:35 2022] POST /identity/v3/projects => generated 375 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 19:33:35.571300 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96793631-9405-441c-a5e2-150650c1d083 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:35.571300 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96793631-9405-441c-a5e2-150650c1d083 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:35.571300 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96793631-9405-441c-a5e2-150650c1d083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:35.573613 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 767/1550] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:33:35.577324 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508bd76-8943-4738-ade4-82c165006653 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:35.577630 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508bd76-8943-4738-ade4-82c165006653 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:35.577918 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508bd76-8943-4738-ade4-82c165006653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:35.608157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-96793631-9405-441c-a5e2-150650c1d083 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:35.609544 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-96793631-9405-441c-a5e2-150650c1d083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:35.612507 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-d508bd76-8943-4738-ade4-82c165006653 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:35.613703 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-d508bd76-8943-4738-ade4-82c165006653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:35.699122 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 784/1551] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:35.699122 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96793631-9405-441c-a5e2-150650c1d083 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:35.710112 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96793631-9405-441c-a5e2-150650c1d083 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:35.712210 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4baee96-72c2-427d-bb55-c0e9a7b68263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:35.712889 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baee96-72c2-427d-bb55-c0e9a7b68263 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:35.713252 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baee96-72c2-427d-bb55-c0e9a7b68263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:35.713547 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baee96-72c2-427d-bb55-c0e9a7b68263 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:35.714238 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4baee96-72c2-427d-bb55-c0e9a7b68263 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:35.716197 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4baee96-72c2-427d-bb55-c0e9a7b68263 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:35.719843 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 768/1552] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:35.721483 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d508bd76-8943-4738-ade4-82c165006653 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:35.731655 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d508bd76-8943-4738-ade4-82c165006653 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:35.737369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d6dc3-2bc0-4b4b-af24-e16b7916e4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:35.737983 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d6dc3-2bc0-4b4b-af24-e16b7916e4b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:35.738273 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d6dc3-2bc0-4b4b-af24-e16b7916e4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:35.738550 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d6dc3-2bc0-4b4b-af24-e16b7916e4b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:35.739273 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d6dc3-2bc0-4b4b-af24-e16b7916e4b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:35.740904 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d6dc3-2bc0-4b4b-af24-e16b7916e4b1 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:35.751593 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 769/1553] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:33:35.754153 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892c339-5317-48bb-8106-6ed9ffb5af33 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:35.754153 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892c339-5317-48bb-8106-6ed9ffb5af33 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:35.754153 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892c339-5317-48bb-8106-6ed9ffb5af33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:35.770780 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-1892c339-5317-48bb-8106-6ed9ffb5af33 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:35.772009 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-1892c339-5317-48bb-8106-6ed9ffb5af33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:35.780085 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 770/1554] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:35.781263 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a826bcd-0a9c-4a5b-9901-6f767cec1e3d None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:35.781567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a826bcd-0a9c-4a5b-9901-6f767cec1e3d None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:35.781828 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a826bcd-0a9c-4a5b-9901-6f767cec1e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:35.799457 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-9a826bcd-0a9c-4a5b-9901-6f767cec1e3d None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:35.802480 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-9a826bcd-0a9c-4a5b-9901-6f767cec1e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:35.808572 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 771/1555] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:35.809740 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cd61d-0998-474a-b5d3-72739a8e74f4 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:35.810067 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cd61d-0998-474a-b5d3-72739a8e74f4 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:35.810954 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cd61d-0998-474a-b5d3-72739a8e74f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:35.830138 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-405cd61d-0998-474a-b5d3-72739a8e74f4 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:35.831334 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-405cd61d-0998-474a-b5d3-72739a8e74f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:35.833315 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 785/1556] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:33:35 2022] POST /identity/v3/users => generated 288 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:33:35.834621 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aefd88-5581-4348-b589-f5e05b6e8cb5 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:35.837097 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aefd88-5581-4348-b589-f5e05b6e8cb5 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:35.837097 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aefd88-5581-4348-b589-f5e05b6e8cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:35.839821 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 772/1557] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:35.841044 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019135f4-9d63-4477-b332-753fd3dffc4b None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:35.841365 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019135f4-9d63-4477-b332-753fd3dffc4b None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:35.841646 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019135f4-9d63-4477-b332-753fd3dffc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:35.849600 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:33:35.854964 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-92aefd88-5581-4348-b589-f5e05b6e8cb5 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:35.856191 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-92aefd88-5581-4348-b589-f5e05b6e8cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:35.860677 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-019135f4-9d63-4477-b332-753fd3dffc4b None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:35.861826 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-019135f4-9d63-4477-b332-753fd3dffc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:35.864644 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 786/1558] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:35.865417 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aefd88-5581-4348-b589-f5e05b6e8cb5 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:35.871184 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 773/1559] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:35.874986 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019135f4-9d63-4477-b332-753fd3dffc4b None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:35.882037 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019135f4-9d63-4477-b332-753fd3dffc4b None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:35.884272 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aefd88-5581-4348-b589-f5e05b6e8cb5 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:35.886617 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d0e66-3997-4e76-9cb3-206e6a7d3991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:35.887528 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d0e66-3997-4e76-9cb3-206e6a7d3991 admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:35.887810 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d0e66-3997-4e76-9cb3-206e6a7d3991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:35.888078 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d0e66-3997-4e76-9cb3-206e6a7d3991 admin admin] PATH_INFO: `/v3/projects/237ee628013a4ae399a473db47e089f7/users/46f0fd56b2e2436aa0ab9f5f1baacab1/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:35.889270 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a5c49-55c4-4c73-964d-02d2b8fa7c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:35.889928 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a5c49-55c4-4c73-964d-02d2b8fa7c50 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:35.890210 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a5c49-55c4-4c73-964d-02d2b8fa7c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:35.890492 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a5c49-55c4-4c73-964d-02d2b8fa7c50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:35.891217 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a5c49-55c4-4c73-964d-02d2b8fa7c50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:33:35.891571 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a5c49-55c4-4c73-964d-02d2b8fa7c50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:35.893162 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a5c49-55c4-4c73-964d-02d2b8fa7c50 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:35.903025 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d0e66-3997-4e76-9cb3-206e6a7d3991 admin admin] RBAC: Authorizing `identity:create_grant(project_id=237ee628013a4ae399a473db47e089f7, user_id=46f0fd56b2e2436aa0ab9f5f1baacab1, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:35.912961 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d0e66-3997-4e76-9cb3-206e6a7d3991 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:35.913119 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 787/1560] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:33:35.913119 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c643934-7113-4b0b-9e45-a08355c2aaa8 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:35.913119 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c643934-7113-4b0b-9e45-a08355c2aaa8 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:35.913119 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c643934-7113-4b0b-9e45-a08355c2aaa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:35.914423 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:33:35.926788 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-8c643934-7113-4b0b-9e45-a08355c2aaa8 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:35.928006 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-8c643934-7113-4b0b-9e45-a08355c2aaa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:35.936107 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 788/1561] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:35.938083 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c58d1-93e7-4e66-bf76-d243e84ac543 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:35.938371 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c58d1-93e7-4e66-bf76-d243e84ac543 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:35.938651 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c58d1-93e7-4e66-bf76-d243e84ac543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:35.956769 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-ea6c58d1-93e7-4e66-bf76-d243e84ac543 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:35.957989 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ea6c58d1-93e7-4e66-bf76-d243e84ac543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:35.965826 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 789/1562] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:35.967202 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c58d1-93e7-4e66-bf76-d243e84ac543 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:35.974205 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 774/1563] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:33:35 2022] PUT /identity/v3/projects/237ee628013a4ae399a473db47e089f7/users/46f0fd56b2e2436aa0ab9f5f1baacab1/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:33:35.975415 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d0e66-3997-4e76-9cb3-206e6a7d3991 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:35.977450 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c58d1-93e7-4e66-bf76-d243e84ac543 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:36.037144 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88710f45-935a-49cc-91f8-5f28c1b641e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:36.037735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88710f45-935a-49cc-91f8-5f28c1b641e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:36.038021 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88710f45-935a-49cc-91f8-5f28c1b641e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:36.038299 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88710f45-935a-49cc-91f8-5f28c1b641e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:36.039027 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88710f45-935a-49cc-91f8-5f28c1b641e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:36.040679 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88710f45-935a-49cc-91f8-5f28c1b641e1 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:36.045666 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d0e66-3997-4e76-9cb3-206e6a7d3991 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:36.050951 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd8add-1f58-4faf-b59b-c38fc8f5679d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:36.054468 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 790/1564] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:33:36.054616 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd8add-1f58-4faf-b59b-c38fc8f5679d admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:36.054616 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd8add-1f58-4faf-b59b-c38fc8f5679d admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:36.054616 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd8add-1f58-4faf-b59b-c38fc8f5679d admin admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:36.054908 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b84e8-6862-4db8-814a-8d4701c24809 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:36.055005 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd8add-1f58-4faf-b59b-c38fc8f5679d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:33:36.055093 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b84e8-6862-4db8-814a-8d4701c24809 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:36.055187 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd8add-1f58-4faf-b59b-c38fc8f5679d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:36.055282 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b84e8-6862-4db8-814a-8d4701c24809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:36.055380 dv-cinder-749155-9-smb devstack@keystone.service[80339]: WARNING py.warnings [None req-88fd8add-1f58-4faf-b59b-c38fc8f5679d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 19:33:36.055380 dv-cinder-749155-9-smb devstack@keystone.service[80339]: warnings.warn(msg) Jul 21 19:33:36.055380 dv-cinder-749155-9-smb devstack@keystone.service[80339]: Jul 21 19:33:36.055380 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd8add-1f58-4faf-b59b-c38fc8f5679d admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:36.067182 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 775/1565] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:33:36.068289 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc18521-7a96-44b3-b400-1bd0f64efa8d None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:36.068580 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc18521-7a96-44b3-b400-1bd0f64efa8d None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:36.068854 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc18521-7a96-44b3-b400-1bd0f64efa8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:36.079829 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-fa9b84e8-6862-4db8-814a-8d4701c24809 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:36.081100 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-fa9b84e8-6862-4db8-814a-8d4701c24809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:36.085968 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-5bc18521-7a96-44b3-b400-1bd0f64efa8d None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:36.087120 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-5bc18521-7a96-44b3-b400-1bd0f64efa8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:36.089387 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 791/1566] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:36.090146 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b84e8-6862-4db8-814a-8d4701c24809 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:36.099531 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 776/1567] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:36.100231 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b84e8-6862-4db8-814a-8d4701c24809 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:36.100469 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc18521-7a96-44b3-b400-1bd0f64efa8d None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:36.104748 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbdd2de-51ea-49f9-82ba-cca999d15c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:36.105391 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdd2de-51ea-49f9-82ba-cca999d15c91 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:36.105677 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdd2de-51ea-49f9-82ba-cca999d15c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:36.105953 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdd2de-51ea-49f9-82ba-cca999d15c91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:36.106630 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbdd2de-51ea-49f9-82ba-cca999d15c91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:36.108789 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbdd2de-51ea-49f9-82ba-cca999d15c91 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:36.110249 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc18521-7a96-44b3-b400-1bd0f64efa8d None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:36.114914 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece77552-24c8-436b-a87c-415862340d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:36.115661 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece77552-24c8-436b-a87c-415862340d67 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:36.116024 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece77552-24c8-436b-a87c-415862340d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:36.116378 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece77552-24c8-436b-a87c-415862340d67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:36.117206 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece77552-24c8-436b-a87c-415862340d67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:33:36.117517 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece77552-24c8-436b-a87c-415862340d67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:36.119101 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece77552-24c8-436b-a87c-415862340d67 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:36.131709 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 777/1568] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:33:36.134477 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece77552-24c8-436b-a87c-415862340d67 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:36.142575 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece77552-24c8-436b-a87c-415862340d67 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:36.147205 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5223b46-1fb1-47d3-9726-d8c70d660145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:36.147879 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5223b46-1fb1-47d3-9726-d8c70d660145 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:36.148164 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5223b46-1fb1-47d3-9726-d8c70d660145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:36.148440 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5223b46-1fb1-47d3-9726-d8c70d660145 admin admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:36.149144 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5223b46-1fb1-47d3-9726-d8c70d660145 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:33:36.149452 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5223b46-1fb1-47d3-9726-d8c70d660145 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:36.151062 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5223b46-1fb1-47d3-9726-d8c70d660145 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:36.163738 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 778/1569] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:33:36.164890 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18241199-b123-4b39-9307-27316661bbf4 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:36.165175 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18241199-b123-4b39-9307-27316661bbf4 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:36.165449 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18241199-b123-4b39-9307-27316661bbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:36.182837 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 792/1570] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:33:36 2022] POST /identity/v3/projects => generated 393 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:33:36.192095 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbdd2de-51ea-49f9-82ba-cca999d15c91 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:36.192242 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-18241199-b123-4b39-9307-27316661bbf4 None None] MFA Rules not processed for user `46f0fd56b2e2436aa0ab9f5f1baacab1`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:36.192943 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-18241199-b123-4b39-9307-27316661bbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:36.249679 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbdd2de-51ea-49f9-82ba-cca999d15c91 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:36.255214 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e256d8-47bc-45d9-9a8f-eb1e0f9d857a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:36.256219 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e256d8-47bc-45d9-9a8f-eb1e0f9d857a admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:36.256506 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e256d8-47bc-45d9-9a8f-eb1e0f9d857a admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:36.256811 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e256d8-47bc-45d9-9a8f-eb1e0f9d857a admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:36.257544 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e256d8-47bc-45d9-9a8f-eb1e0f9d857a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:36.259077 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 779/1571] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:36.259247 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e256d8-47bc-45d9-9a8f-eb1e0f9d857a admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:36.260031 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18241199-b123-4b39-9307-27316661bbf4 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:36.270468 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 793/1572] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:33:36.271596 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e256d8-47bc-45d9-9a8f-eb1e0f9d857a admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:36.277040 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18241199-b123-4b39-9307-27316661bbf4 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:36.281360 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e256d8-47bc-45d9-9a8f-eb1e0f9d857a admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:36.282421 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee917d5-1b8f-4484-8bd6-19505e9f9c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:36.283196 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee917d5-1b8f-4484-8bd6-19505e9f9c94 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:36.283576 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee917d5-1b8f-4484-8bd6-19505e9f9c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:36.283861 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee917d5-1b8f-4484-8bd6-19505e9f9c94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:36.284598 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee917d5-1b8f-4484-8bd6-19505e9f9c94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:36.286242 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e528f-0b8e-48f3-a338-53dedc3b6b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:36.286596 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee917d5-1b8f-4484-8bd6-19505e9f9c94 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:36.286891 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e528f-0b8e-48f3-a338-53dedc3b6b56 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:36.287360 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e528f-0b8e-48f3-a338-53dedc3b6b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:36.288050 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e528f-0b8e-48f3-a338-53dedc3b6b56 admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:36.288569 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e528f-0b8e-48f3-a338-53dedc3b6b56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:33:36.288876 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e528f-0b8e-48f3-a338-53dedc3b6b56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:36.290845 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e528f-0b8e-48f3-a338-53dedc3b6b56 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:36.313178 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 794/1573] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:33:36.313178 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e528f-0b8e-48f3-a338-53dedc3b6b56 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:36.317297 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e528f-0b8e-48f3-a338-53dedc3b6b56 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:36.321845 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a478c9-5f6a-4aae-a58e-932eb8da67a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:36.322487 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a478c9-5f6a-4aae-a58e-932eb8da67a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:36.322772 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a478c9-5f6a-4aae-a58e-932eb8da67a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:36.323050 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a478c9-5f6a-4aae-a58e-932eb8da67a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:36.323797 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a478c9-5f6a-4aae-a58e-932eb8da67a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:33:36.324106 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a478c9-5f6a-4aae-a58e-932eb8da67a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:36.325783 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a478c9-5f6a-4aae-a58e-932eb8da67a0 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:36.337454 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 795/1574] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:33:36.338345 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a478c9-5f6a-4aae-a58e-932eb8da67a0 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:36.348432 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a478c9-5f6a-4aae-a58e-932eb8da67a0 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:36.353237 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a7316a-4e0f-4145-8973-4e28d93e2cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:36.353885 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7316a-4e0f-4145-8973-4e28d93e2cb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:36.354176 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7316a-4e0f-4145-8973-4e28d93e2cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:36.361620 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7316a-4e0f-4145-8973-4e28d93e2cb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:36.361620 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a7316a-4e0f-4145-8973-4e28d93e2cb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:36.361918 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 780/1575] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:33:36 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:33:36.361918 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee917d5-1b8f-4484-8bd6-19505e9f9c94 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:36.362077 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a7316a-4e0f-4145-8973-4e28d93e2cb5 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:36.362160 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:33:36.422663 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee917d5-1b8f-4484-8bd6-19505e9f9c94 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:36.427557 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b28f8-d418-4e14-9042-74918ad9a0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:36.428253 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b28f8-d418-4e14-9042-74918ad9a0dc admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:36.428534 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b28f8-d418-4e14-9042-74918ad9a0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:36.428843 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b28f8-d418-4e14-9042-74918ad9a0dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:36.429527 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b28f8-d418-4e14-9042-74918ad9a0dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:36.431534 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b28f8-d418-4e14-9042-74918ad9a0dc admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:36.446517 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 796/1576] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:33:36 2022] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:33:36.447172 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a7316a-4e0f-4145-8973-4e28d93e2cb5 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:36.453051 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:33:36.507370 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a7316a-4e0f-4145-8973-4e28d93e2cb5 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:36.511966 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255cb09-8c5d-4f99-8f80-19667f90cb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:36.512622 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255cb09-8c5d-4f99-8f80-19667f90cb9f admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:36.512902 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255cb09-8c5d-4f99-8f80-19667f90cb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:36.513686 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255cb09-8c5d-4f99-8f80-19667f90cb9f admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:36.514508 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255cb09-8c5d-4f99-8f80-19667f90cb9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:36.516470 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255cb09-8c5d-4f99-8f80-19667f90cb9f admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:36.548694 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 781/1577] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:33:36 2022] POST /identity/v3/projects => generated 375 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:33:36.549449 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b28f8-d418-4e14-9042-74918ad9a0dc admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:36.608997 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b28f8-d418-4e14-9042-74918ad9a0dc admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:36.613695 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 797/1578] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:33:36 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:33:36.613695 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de1d71-daec-4db1-8bc2-5a43a9291636 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:36.613695 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de1d71-daec-4db1-8bc2-5a43a9291636 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:36.613695 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de1d71-daec-4db1-8bc2-5a43a9291636 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:36.614262 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 798/1579] 10.222.0.60 () {54 vars in 962 bytes} [Thu Jul 21 19:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:33:36.617547 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c21c4-0406-44ad-a7a6-15948411b277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:36.619775 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c21c4-0406-44ad-a7a6-15948411b277 admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:36.619775 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c21c4-0406-44ad-a7a6-15948411b277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:36.619991 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de1d71-daec-4db1-8bc2-5a43a9291636 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:36.620080 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c21c4-0406-44ad-a7a6-15948411b277 admin admin] PATH_INFO: `/v3/projects/49d8cb9232e6425681988949eb40432f/users/44076ea4ef504e6a957e84dcb83c5d09/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:36.631261 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de1d71-daec-4db1-8bc2-5a43a9291636 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:36.634052 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c21c4-0406-44ad-a7a6-15948411b277 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49d8cb9232e6425681988949eb40432f, user_id=44076ea4ef504e6a957e84dcb83c5d09, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:36.636008 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850a0cf-8d85-49bd-aea9-2cc5b2a4e89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:36.636624 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850a0cf-8d85-49bd-aea9-2cc5b2a4e89f admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:36.636763 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c21c4-0406-44ad-a7a6-15948411b277 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:36.636912 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850a0cf-8d85-49bd-aea9-2cc5b2a4e89f admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:36.637193 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850a0cf-8d85-49bd-aea9-2cc5b2a4e89f admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:36.637909 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4850a0cf-8d85-49bd-aea9-2cc5b2a4e89f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:36.640634 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4850a0cf-8d85-49bd-aea9-2cc5b2a4e89f admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:36.707691 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 782/1580] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:33:36 2022] PUT /identity/v3/projects/49d8cb9232e6425681988949eb40432f/users/44076ea4ef504e6a957e84dcb83c5d09/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:33:36.708719 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c21c4-0406-44ad-a7a6-15948411b277 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:36.731256 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 799/1581] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:33:36 2022] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:33:36.731256 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850a0cf-8d85-49bd-aea9-2cc5b2a4e89f admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:36.771809 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c21c4-0406-44ad-a7a6-15948411b277 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:36.784105 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:33:36.794250 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850a0cf-8d85-49bd-aea9-2cc5b2a4e89f admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:36.799326 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f12972-24c7-40e2-81dd-fb52911d3fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:36.799963 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f12972-24c7-40e2-81dd-fb52911d3fbc admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:36.800248 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f12972-24c7-40e2-81dd-fb52911d3fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:36.800523 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f12972-24c7-40e2-81dd-fb52911d3fbc admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:36.801207 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f12972-24c7-40e2-81dd-fb52911d3fbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:36.803135 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f12972-24c7-40e2-81dd-fb52911d3fbc admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:36.829088 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6265aefe-a8ef-4128-9e06-e94ef00bfbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:36.829747 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265aefe-a8ef-4128-9e06-e94ef00bfbf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:36.830029 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265aefe-a8ef-4128-9e06-e94ef00bfbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:36.830304 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265aefe-a8ef-4128-9e06-e94ef00bfbf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:36.830990 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6265aefe-a8ef-4128-9e06-e94ef00bfbf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:36.833099 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6265aefe-a8ef-4128-9e06-e94ef00bfbf5 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:36.912859 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 800/1582] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:33:36 2022] POST /identity/v3/users => generated 294 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:33:36.913687 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f12972-24c7-40e2-81dd-fb52911d3fbc admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:36.924548 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f12972-24c7-40e2-81dd-fb52911d3fbc admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:36.930770 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e3c0a-d445-4ae4-b6e9-43555e7f29ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:36.931548 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e3c0a-d445-4ae4-b6e9-43555e7f29ac admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:36.931837 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e3c0a-d445-4ae4-b6e9-43555e7f29ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:36.932125 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e3c0a-d445-4ae4-b6e9-43555e7f29ac admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:36.932809 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e3c0a-d445-4ae4-b6e9-43555e7f29ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:36.934809 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e3c0a-d445-4ae4-b6e9-43555e7f29ac admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:36.938885 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 783/1583] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:33:36 2022] POST /identity/v3/projects => generated 365 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:33:36.938885 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6265aefe-a8ef-4128-9e06-e94ef00bfbf5 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:36.998972 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6265aefe-a8ef-4128-9e06-e94ef00bfbf5 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:37.003971 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe7dae-3b8c-4552-bb5c-de7333450178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:37.004638 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe7dae-3b8c-4552-bb5c-de7333450178 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:37.004927 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe7dae-3b8c-4552-bb5c-de7333450178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:37.005204 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe7dae-3b8c-4552-bb5c-de7333450178 admin admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:37.005893 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebe7dae-3b8c-4552-bb5c-de7333450178 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:37.007949 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 801/1584] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:33:36 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:33:37.008074 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebe7dae-3b8c-4552-bb5c-de7333450178 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:37.008772 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e3c0a-d445-4ae4-b6e9-43555e7f29ac admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:37.018644 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e3c0a-d445-4ae4-b6e9-43555e7f29ac admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:37.023256 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24018344-ad12-4691-8eab-17c9f734dd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:37.023935 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24018344-ad12-4691-8eab-17c9f734dd6e admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:37.024220 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24018344-ad12-4691-8eab-17c9f734dd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:37.024498 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24018344-ad12-4691-8eab-17c9f734dd6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:37.025210 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24018344-ad12-4691-8eab-17c9f734dd6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:37.026807 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24018344-ad12-4691-8eab-17c9f734dd6e admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:37.037125 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 802/1585] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:33:37.038427 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b9b39-47e2-4a2f-aabb-4ee97a746747 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:37.043936 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b9b39-47e2-4a2f-aabb-4ee97a746747 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:37.043936 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b9b39-47e2-4a2f-aabb-4ee97a746747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:37.076113 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-7a8b9b39-47e2-4a2f-aabb-4ee97a746747 None None] MFA Rules not processed for user `6b4d98e967814e5f84f5f0d67ebb3c17`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:37.077283 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-7a8b9b39-47e2-4a2f-aabb-4ee97a746747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:37.090115 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:33:37.097350 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 784/1586] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:33:36 2022] POST /identity/v3/users => generated 288 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:33:37.097350 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0053e-8861-41e1-960a-a5a9927f2f87 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:37.097350 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0053e-8861-41e1-960a-a5a9927f2f87 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:37.097350 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0053e-8861-41e1-960a-a5a9927f2f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:37.114292 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-ede0053e-8861-41e1-960a-a5a9927f2f87 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:37.115520 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-ede0053e-8861-41e1-960a-a5a9927f2f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:37.123572 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 785/1587] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:37.124342 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0053e-8861-41e1-960a-a5a9927f2f87 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:37.133658 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0053e-8861-41e1-960a-a5a9927f2f87 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:37.139018 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf5d25-a3a4-4401-a0b8-e22003e04763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:37.139708 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf5d25-a3a4-4401-a0b8-e22003e04763 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:37.139994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf5d25-a3a4-4401-a0b8-e22003e04763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:37.140272 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf5d25-a3a4-4401-a0b8-e22003e04763 admin admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:37.140960 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf5d25-a3a4-4401-a0b8-e22003e04763 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:37.142858 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf5d25-a3a4-4401-a0b8-e22003e04763 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:37.147188 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 803/1588] 10.222.0.60 () {58 vars in 1059 bytes} [Thu Jul 21 19:33:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:37.148092 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b9b39-47e2-4a2f-aabb-4ee97a746747 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:37.159839 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b9b39-47e2-4a2f-aabb-4ee97a746747 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:37.164666 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f45bd8-9ce8-4490-81e7-2e6f751f8cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:37.165111 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f45bd8-9ce8-4490-81e7-2e6f751f8cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:37.165395 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f45bd8-9ce8-4490-81e7-2e6f751f8cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:37.165671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f45bd8-9ce8-4490-81e7-2e6f751f8cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:37.166394 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f45bd8-9ce8-4490-81e7-2e6f751f8cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:37.168039 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f45bd8-9ce8-4490-81e7-2e6f751f8cd5 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:37.178302 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 804/1589] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:33:37.179140 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f45bd8-9ce8-4490-81e7-2e6f751f8cd5 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:37.189386 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f45bd8-9ce8-4490-81e7-2e6f751f8cd5 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:37.194093 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32edc190-30c4-4431-bb28-8d804043a7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:37.194719 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32edc190-30c4-4431-bb28-8d804043a7a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:37.195005 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32edc190-30c4-4431-bb28-8d804043a7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:37.195281 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32edc190-30c4-4431-bb28-8d804043a7a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:37.196004 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32edc190-30c4-4431-bb28-8d804043a7a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:37.197867 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32edc190-30c4-4431-bb28-8d804043a7a1 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:37.244603 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 786/1590] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:33:37 2022] POST /identity/v3/users => generated 289 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:33:37.245434 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf5d25-a3a4-4401-a0b8-e22003e04763 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:37.255106 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf5d25-a3a4-4401-a0b8-e22003e04763 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:37.259697 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db75bf79-08cb-4980-8378-08a0ac0e3ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:37.260334 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75bf79-08cb-4980-8378-08a0ac0e3ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:37.260661 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75bf79-08cb-4980-8378-08a0ac0e3ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:37.260946 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75bf79-08cb-4980-8378-08a0ac0e3ee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:37.261661 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db75bf79-08cb-4980-8378-08a0ac0e3ee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:37.264002 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db75bf79-08cb-4980-8378-08a0ac0e3ee3 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:37.274113 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 787/1591] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:33:37.274938 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db75bf79-08cb-4980-8378-08a0ac0e3ee3 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:37.284837 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db75bf79-08cb-4980-8378-08a0ac0e3ee3 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:37.289383 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8351aee-7b95-442e-93b7-daaa90119830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:37.289994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8351aee-7b95-442e-93b7-daaa90119830 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:37.290282 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8351aee-7b95-442e-93b7-daaa90119830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:37.290567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8351aee-7b95-442e-93b7-daaa90119830 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:37.291263 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8351aee-7b95-442e-93b7-daaa90119830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:37.292938 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8351aee-7b95-442e-93b7-daaa90119830 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:37.303443 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 788/1592] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:33:37.304208 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8351aee-7b95-442e-93b7-daaa90119830 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:37.313953 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8351aee-7b95-442e-93b7-daaa90119830 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:37.314822 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 805/1593] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:33:37 2022] POST /identity/v3/users => generated 283 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:33:37.315763 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32edc190-30c4-4431-bb28-8d804043a7a1 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:37.320148 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b8565-06b9-49be-b5af-9655e65be963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:37.324089 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b8565-06b9-49be-b5af-9655e65be963 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:37.324089 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b8565-06b9-49be-b5af-9655e65be963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:37.324089 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b8565-06b9-49be-b5af-9655e65be963 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:37.324089 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b8565-06b9-49be-b5af-9655e65be963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:37.324089 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b8565-06b9-49be-b5af-9655e65be963 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:37.337724 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 789/1594] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:33:37.337724 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b8565-06b9-49be-b5af-9655e65be963 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:37.353273 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b8565-06b9-49be-b5af-9655e65be963 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:37.360924 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c706fd-35a7-461e-9214-3b2387bb5689 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:37.361562 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c706fd-35a7-461e-9214-3b2387bb5689 service nova] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:37.361847 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c706fd-35a7-461e-9214-3b2387bb5689 service nova] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:37.362126 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c706fd-35a7-461e-9214-3b2387bb5689 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:37.375998 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32edc190-30c4-4431-bb28-8d804043a7a1 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:37.379686 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c528c-e5de-4eaf-9a3d-d255115c57ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:37.380334 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c528c-e5de-4eaf-9a3d-d255115c57ea service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:37.380626 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c528c-e5de-4eaf-9a3d-d255115c57ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:37.380906 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c528c-e5de-4eaf-9a3d-d255115c57ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:37.390952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c528c-e5de-4eaf-9a3d-d255115c57ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:37.392516 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c528c-e5de-4eaf-9a3d-d255115c57ea service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:37.394306 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:33:37.402591 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 806/1595] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:33:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:33:37.404278 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c528c-e5de-4eaf-9a3d-d255115c57ea service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:37.412911 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c528c-e5de-4eaf-9a3d-d255115c57ea service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:37.418205 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c706fd-35a7-461e-9214-3b2387bb5689 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:37.419980 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493ae2e-cf67-4a70-8a7c-6c52c655cb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:37.422940 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493ae2e-cf67-4a70-8a7c-6c52c655cb4d admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:37.423065 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c706fd-35a7-461e-9214-3b2387bb5689 service nova] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:37.423186 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493ae2e-cf67-4a70-8a7c-6c52c655cb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:37.423186 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493ae2e-cf67-4a70-8a7c-6c52c655cb4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:37.423186 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493ae2e-cf67-4a70-8a7c-6c52c655cb4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:37.423968 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493ae2e-cf67-4a70-8a7c-6c52c655cb4d admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:37.435999 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 790/1596] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:33:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:33:37.438698 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c706fd-35a7-461e-9214-3b2387bb5689 service nova] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:37.444996 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 807/1597] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:33:37.446188 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493ae2e-cf67-4a70-8a7c-6c52c655cb4d admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:37.449403 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c706fd-35a7-461e-9214-3b2387bb5689 service nova] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:37.454819 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab02c33-4b24-4633-9574-42c892783b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:37.455855 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab02c33-4b24-4633-9574-42c892783b89 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:37.456322 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab02c33-4b24-4633-9574-42c892783b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:37.456735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493ae2e-cf67-4a70-8a7c-6c52c655cb4d admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:37.456972 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab02c33-4b24-4633-9574-42c892783b89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:37.457976 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab02c33-4b24-4633-9574-42c892783b89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:37.460022 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab02c33-4b24-4633-9574-42c892783b89 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:37.461287 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590797a-9e17-412a-b101-15f491272dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:37.461936 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590797a-9e17-412a-b101-15f491272dcf admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:37.462221 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590797a-9e17-412a-b101-15f491272dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:37.462497 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590797a-9e17-412a-b101-15f491272dcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:37.463204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0590797a-9e17-412a-b101-15f491272dcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:37.464820 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0590797a-9e17-412a-b101-15f491272dcf admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:37.472881 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 791/1598] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:33:37.473920 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab02c33-4b24-4633-9574-42c892783b89 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:37.478427 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 808/1599] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:33:37.478427 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590797a-9e17-412a-b101-15f491272dcf admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:37.487802 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590797a-9e17-412a-b101-15f491272dcf admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:37.490188 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab02c33-4b24-4633-9574-42c892783b89 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:37.492421 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf87cac6-05f5-49df-abed-5f2c65a15f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:37.493075 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87cac6-05f5-49df-abed-5f2c65a15f33 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:37.493363 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87cac6-05f5-49df-abed-5f2c65a15f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:37.493636 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87cac6-05f5-49df-abed-5f2c65a15f33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:37.494345 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf87cac6-05f5-49df-abed-5f2c65a15f33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:37.495289 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396f875-f496-4cd4-8420-464f169a1502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:37.495957 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf87cac6-05f5-49df-abed-5f2c65a15f33 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:37.496376 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396f875-f496-4cd4-8420-464f169a1502 admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:37.496734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396f875-f496-4cd4-8420-464f169a1502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:37.497183 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396f875-f496-4cd4-8420-464f169a1502 admin admin] PATH_INFO: `/v3/projects/8661e778c49a4a34963e5d6c48b72797/users/d9f276efb89f4e869e7c58b2c492a0f0/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:37.507193 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 809/1600] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:33:37.507977 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf87cac6-05f5-49df-abed-5f2c65a15f33 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:37.514607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1396f875-f496-4cd4-8420-464f169a1502 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8661e778c49a4a34963e5d6c48b72797, user_id=d9f276efb89f4e869e7c58b2c492a0f0, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:37.519014 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1396f875-f496-4cd4-8420-464f169a1502 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:37.529605 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf87cac6-05f5-49df-abed-5f2c65a15f33 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:37.540117 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609fa22-dbcf-4280-a126-e48628fba083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:37.540876 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609fa22-dbcf-4280-a126-e48628fba083 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:37.541220 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609fa22-dbcf-4280-a126-e48628fba083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:37.541559 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609fa22-dbcf-4280-a126-e48628fba083 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:37.542388 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e609fa22-dbcf-4280-a126-e48628fba083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:37.544274 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e609fa22-dbcf-4280-a126-e48628fba083 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:37.558903 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 810/1601] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:33:37.558903 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609fa22-dbcf-4280-a126-e48628fba083 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:37.570455 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609fa22-dbcf-4280-a126-e48628fba083 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:37.575776 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ebbee9-2530-41b5-80cb-c963cd04bdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:37.576761 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebbee9-2530-41b5-80cb-c963cd04bdac admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:37.577110 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebbee9-2530-41b5-80cb-c963cd04bdac admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:37.577451 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebbee9-2530-41b5-80cb-c963cd04bdac admin admin] PATH_INFO: `/v3/projects/10cd5ec162104cf7aed88c015a3db767/users/42b8bcddb4a24befbad0a5f4ac7ad925/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:37.594174 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ebbee9-2530-41b5-80cb-c963cd04bdac admin admin] RBAC: Authorizing `identity:create_grant(project_id=10cd5ec162104cf7aed88c015a3db767, user_id=42b8bcddb4a24befbad0a5f4ac7ad925, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:37.595064 dv-cinder-749155-9-smb devstack@keystone.service[80338]: WARNING py.warnings [None req-09ebbee9-2530-41b5-80cb-c963cd04bdac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 19:33:37.595064 dv-cinder-749155-9-smb devstack@keystone.service[80338]: warnings.warn(msg) Jul 21 19:33:37.595064 dv-cinder-749155-9-smb devstack@keystone.service[80338]: Jul 21 19:33:37.597446 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ebbee9-2530-41b5-80cb-c963cd04bdac admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:37.609153 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 792/1602] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:33:37 2022] PUT /identity/v3/projects/8661e778c49a4a34963e5d6c48b72797/users/d9f276efb89f4e869e7c58b2c492a0f0/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:33:37.610459 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396f875-f496-4cd4-8420-464f169a1502 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:37.674087 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396f875-f496-4cd4-8420-464f169a1502 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:37.678905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba5c54-13f9-4967-a481-6a5766eabfa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:37.679605 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba5c54-13f9-4967-a481-6a5766eabfa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:37.679893 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba5c54-13f9-4967-a481-6a5766eabfa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:37.680238 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba5c54-13f9-4967-a481-6a5766eabfa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:37.680996 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ba5c54-13f9-4967-a481-6a5766eabfa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:37.682729 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ba5c54-13f9-4967-a481-6a5766eabfa2 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:37.697099 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 793/1603] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:33:37.697099 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba5c54-13f9-4967-a481-6a5766eabfa2 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:37.697695 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 811/1604] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:33:37 2022] PUT /identity/v3/projects/10cd5ec162104cf7aed88c015a3db767/users/42b8bcddb4a24befbad0a5f4ac7ad925/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:33:37.702033 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ebbee9-2530-41b5-80cb-c963cd04bdac admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:37.710424 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba5c54-13f9-4967-a481-6a5766eabfa2 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:37.725252 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:33:37.777565 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ebbee9-2530-41b5-80cb-c963cd04bdac admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:37.782039 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f5671-5768-4f80-b695-fbd8ec23177a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:37.782715 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f5671-5768-4f80-b695-fbd8ec23177a admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:37.782998 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f5671-5768-4f80-b695-fbd8ec23177a admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:37.783746 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f5671-5768-4f80-b695-fbd8ec23177a admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:37.784051 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f5671-5768-4f80-b695-fbd8ec23177a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:37.785690 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f5671-5768-4f80-b695-fbd8ec23177a admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:37.787404 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a24f3b4-c912-4fb2-821b-04cd28d56dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:37.788339 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24f3b4-c912-4fb2-821b-04cd28d56dcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:37.788629 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24f3b4-c912-4fb2-821b-04cd28d56dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:37.788924 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24f3b4-c912-4fb2-821b-04cd28d56dcc admin admin] PATH_INFO: `/v3/projects/5b19fbc3ef2b481e9a2201bc57c74b09/users/ca1f44332fc54eda99fd6c1926e76a74/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:37.800599 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 812/1605] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:33:37.806324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f5671-5768-4f80-b695-fbd8ec23177a admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:37.810947 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a24f3b4-c912-4fb2-821b-04cd28d56dcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b19fbc3ef2b481e9a2201bc57c74b09, user_id=ca1f44332fc54eda99fd6c1926e76a74, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:37.812185 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f5671-5768-4f80-b695-fbd8ec23177a admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:37.813998 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a24f3b4-c912-4fb2-821b-04cd28d56dcc admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:37.817332 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aff7d1-6c22-46da-b07c-9e95d6803edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:37.818250 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aff7d1-6c22-46da-b07c-9e95d6803edd admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:37.818531 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aff7d1-6c22-46da-b07c-9e95d6803edd admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:37.818802 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aff7d1-6c22-46da-b07c-9e95d6803edd admin admin] PATH_INFO: `/v3/projects/5677178939ed49b78053012db12fc841/users/df42c0240d5946dda2ce676ae80edfe8/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:37.834271 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aff7d1-6c22-46da-b07c-9e95d6803edd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5677178939ed49b78053012db12fc841, user_id=df42c0240d5946dda2ce676ae80edfe8, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:37.836945 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aff7d1-6c22-46da-b07c-9e95d6803edd admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:37.911477 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 813/1607] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:33:37 2022] PUT /identity/v3/projects/5677178939ed49b78053012db12fc841/users/df42c0240d5946dda2ce676ae80edfe8/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:33:37.912797 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0edee-e48b-4b92-87ee-afc7437325a6 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:37.913088 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0edee-e48b-4b92-87ee-afc7437325a6 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:37.913368 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0edee-e48b-4b92-87ee-afc7437325a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:37.914601 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 794/1607] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:33:37 2022] PUT /identity/v3/projects/5b19fbc3ef2b481e9a2201bc57c74b09/users/ca1f44332fc54eda99fd6c1926e76a74/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:33:37.916061 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b99a94-3828-43ad-9eb9-4e3994d5fd9e None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:37.918106 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b99a94-3828-43ad-9eb9-4e3994d5fd9e None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:37.918106 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b99a94-3828-43ad-9eb9-4e3994d5fd9e None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:37.918106 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 795/1608] 10.222.0.60 () {54 vars in 912 bytes} [Thu Jul 21 19:33:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:33:37.921051 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b99a94-3828-43ad-9eb9-4e3994d5fd9e None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:37.937581 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-32e0edee-e48b-4b92-87ee-afc7437325a6 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:37.942612 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-32e0edee-e48b-4b92-87ee-afc7437325a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:37.959593 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:33:38.012867 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 814/1609] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:38.014360 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38a720-df3e-4482-88d5-6c7d198c0884 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:38.015511 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38a720-df3e-4482-88d5-6c7d198c0884 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:38.015958 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38a720-df3e-4482-88d5-6c7d198c0884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:38.036359 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-bd38a720-df3e-4482-88d5-6c7d198c0884 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:38.037653 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-bd38a720-df3e-4482-88d5-6c7d198c0884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:38.045013 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b99a94-3828-43ad-9eb9-4e3994d5fd9e None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:38.046226 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 815/1610] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:38.046990 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38a720-df3e-4482-88d5-6c7d198c0884 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:38.060044 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a9100-06af-406a-84dc-3d188b6db9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:38.060800 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38a720-df3e-4482-88d5-6c7d198c0884 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:38.062784 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a9100-06af-406a-84dc-3d188b6db9d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:38.063828 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a9100-06af-406a-84dc-3d188b6db9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:38.067559 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a9100-06af-406a-84dc-3d188b6db9d1 admin admin] PATH_INFO: `/v3/projects/8059826b15f448dfa9a8be590b589334/users/445eaa80c49d4b77abe929421fa65d01/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:38.067690 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db37a9-b731-4159-8389-2d36925cae31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:38.067690 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db37a9-b731-4159-8389-2d36925cae31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:38.067690 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db37a9-b731-4159-8389-2d36925cae31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:38.067986 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db37a9-b731-4159-8389-2d36925cae31 admin admin] PATH_INFO: `/v3/projects/59b409361a4e4261b1225a6be521ac58/users/571a30965f74451487dcf47d2d3e5735/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:38.084706 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8a9100-06af-406a-84dc-3d188b6db9d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8059826b15f448dfa9a8be590b589334, user_id=445eaa80c49d4b77abe929421fa65d01, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:38.086315 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db37a9-b731-4159-8389-2d36925cae31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59b409361a4e4261b1225a6be521ac58, user_id=571a30965f74451487dcf47d2d3e5735, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:38.087355 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8a9100-06af-406a-84dc-3d188b6db9d1 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:38.089385 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db37a9-b731-4159-8389-2d36925cae31 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:38.204199 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 816/1611] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:33:38 2022] PUT /identity/v3/projects/59b409361a4e4261b1225a6be521ac58/users/571a30965f74451487dcf47d2d3e5735/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:33:38.204199 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a01921-6510-47e8-af37-bd219a23f2cd None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:38.204199 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a01921-6510-47e8-af37-bd219a23f2cd None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:38.204199 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a01921-6510-47e8-af37-bd219a23f2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:38.205133 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 796/1612] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:33:37 2022] PUT /identity/v3/projects/8059826b15f448dfa9a8be590b589334/users/445eaa80c49d4b77abe929421fa65d01/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:33:38.205133 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad897a-3c03-431a-8ba1-bb897e719e31 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:38.205133 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad897a-3c03-431a-8ba1-bb897e719e31 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:38.205133 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad897a-3c03-431a-8ba1-bb897e719e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:38.205668 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-c5a01921-6510-47e8-af37-bd219a23f2cd None None] MFA Rules not processed for user `6b4d98e967814e5f84f5f0d67ebb3c17`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:38.205668 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-c5a01921-6510-47e8-af37-bd219a23f2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:38.216930 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-80ad897a-3c03-431a-8ba1-bb897e719e31 None None] MFA Rules not processed for user `ca1f44332fc54eda99fd6c1926e76a74`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:38.219055 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-80ad897a-3c03-431a-8ba1-bb897e719e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:38.271031 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:33:38.290419 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 817/1613] 10.222.0.60 () {58 vars in 1009 bytes} [Thu Jul 21 19:33:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:38.292342 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f6dbe-5424-41d7-b8b8-fe59ea67f46d None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:38.293252 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f6dbe-5424-41d7-b8b8-fe59ea67f46d None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:38.293252 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f6dbe-5424-41d7-b8b8-fe59ea67f46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:38.296052 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 797/1614] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:38.297048 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad897a-3c03-431a-8ba1-bb897e719e31 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:38.343083 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-3e7f6dbe-5424-41d7-b8b8-fe59ea67f46d None None] MFA Rules not processed for user `df42c0240d5946dda2ce676ae80edfe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:38.345267 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3e7f6dbe-5424-41d7-b8b8-fe59ea67f46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:38.364207 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad897a-3c03-431a-8ba1-bb897e719e31 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:38.368331 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ca7d8-fb9e-4a73-aa7c-ae85a76f3c1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:38.368984 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ca7d8-fb9e-4a73-aa7c-ae85a76f3c1f service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:38.369276 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ca7d8-fb9e-4a73-aa7c-ae85a76f3c1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:38.369713 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ca7d8-fb9e-4a73-aa7c-ae85a76f3c1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:38.418127 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 818/1615] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:38.420470 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f6dbe-5424-41d7-b8b8-fe59ea67f46d None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:38.426828 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:33:38.435728 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f6dbe-5424-41d7-b8b8-fe59ea67f46d None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:38.440012 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b1961-2ce4-4290-8bb3-473d80f51094 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:38.441073 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b1961-2ce4-4290-8bb3-473d80f51094 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:38.441585 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b1961-2ce4-4290-8bb3-473d80f51094 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:38.442124 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b1961-2ce4-4290-8bb3-473d80f51094 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:38.447976 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5ca7d8-fb9e-4a73-aa7c-ae85a76f3c1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:38.449957 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5ca7d8-fb9e-4a73-aa7c-ae85a76f3c1f service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:38.456413 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b1961-2ce4-4290-8bb3-473d80f51094 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:38.458444 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b1961-2ce4-4290-8bb3-473d80f51094 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:38.461265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 798/1616] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:33:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:33:38.462578 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c509b8c-0248-4053-a6fa-775bf8df707d None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:38.462921 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c509b8c-0248-4053-a6fa-775bf8df707d None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:38.463208 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c509b8c-0248-4053-a6fa-775bf8df707d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:38.474252 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 819/1617] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:33:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:33:38.477805 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29347378-4afd-421a-8286-cec9be881ace None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:38.477805 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29347378-4afd-421a-8286-cec9be881ace None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:38.477805 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29347378-4afd-421a-8286-cec9be881ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:38.503623 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-8c509b8c-0248-4053-a6fa-775bf8df707d None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:38.506379 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-8c509b8c-0248-4053-a6fa-775bf8df707d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:38.510470 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-29347378-4afd-421a-8286-cec9be881ace None None] MFA Rules not processed for user `571a30965f74451487dcf47d2d3e5735`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:38.511964 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-29347378-4afd-421a-8286-cec9be881ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:38.529883 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 799/1618] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:38.530845 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c509b8c-0248-4053-a6fa-775bf8df707d None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:38.595608 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c509b8c-0248-4053-a6fa-775bf8df707d None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:38.599795 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d2f50-867b-4f6d-bac7-cdfc4afbc3c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:38.600580 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d2f50-867b-4f6d-bac7-cdfc4afbc3c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:38.600932 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d2f50-867b-4f6d-bac7-cdfc4afbc3c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:38.601360 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d2f50-867b-4f6d-bac7-cdfc4afbc3c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:38.603381 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 820/1619] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:38 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:38.604775 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450a5ef-ed48-4f2d-9cbf-32df313c0a71 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:38.605209 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450a5ef-ed48-4f2d-9cbf-32df313c0a71 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:38.605553 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450a5ef-ed48-4f2d-9cbf-32df313c0a71 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:38.607482 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 821/1620] 10.222.0.60 () {54 vars in 962 bytes} [Thu Jul 21 19:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:33:38.608895 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450a5ef-ed48-4f2d-9cbf-32df313c0a71 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:38.615524 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d2f50-867b-4f6d-bac7-cdfc4afbc3c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:38.621289 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d2f50-867b-4f6d-bac7-cdfc4afbc3c3 service cinder] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:38.623632 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450a5ef-ed48-4f2d-9cbf-32df313c0a71 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:38.628379 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a5893-2aee-485b-88cf-df69a4961324 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:38.629254 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a5893-2aee-485b-88cf-df69a4961324 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:38.629478 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a5893-2aee-485b-88cf-df69a4961324 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:38.629886 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a5893-2aee-485b-88cf-df69a4961324 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:38.630997 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 800/1621] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:33:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:33:38.632744 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2c8e6-6b8f-4540-bfaa-e4249c920fc1 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:38.632886 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2c8e6-6b8f-4540-bfaa-e4249c920fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:38.633372 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2c8e6-6b8f-4540-bfaa-e4249c920fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:38.644481 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a5893-2aee-485b-88cf-df69a4961324 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:38.644481 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a5893-2aee-485b-88cf-df69a4961324 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:38.655317 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-53a2c8e6-6b8f-4540-bfaa-e4249c920fc1 None None] MFA Rules not processed for user `6b4d98e967814e5f84f5f0d67ebb3c17`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:38.656871 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 822/1622] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:33:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:33:38.657027 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-53a2c8e6-6b8f-4540-bfaa-e4249c920fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:38.658231 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a5893-2aee-485b-88cf-df69a4961324 service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:38.668783 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 801/1623] 10.222.0.60 () {58 vars in 1059 bytes} [Thu Jul 21 19:33:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:38.670127 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a5893-2aee-485b-88cf-df69a4961324 service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:38.675988 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395757c0-0831-44da-8692-00ed42e37e56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:38.676642 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395757c0-0831-44da-8692-00ed42e37e56 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:38.676927 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395757c0-0831-44da-8692-00ed42e37e56 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:38.677204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395757c0-0831-44da-8692-00ed42e37e56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:38.680088 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a2c8e6-6b8f-4540-bfaa-e4249c920fc1 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:38.687885 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395757c0-0831-44da-8692-00ed42e37e56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:38.689822 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395757c0-0831-44da-8692-00ed42e37e56 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:38.697245 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a2c8e6-6b8f-4540-bfaa-e4249c920fc1 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:38.703664 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 823/1624] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:33:38 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:33:38.707037 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85cdb2-45d2-43ca-be8f-8f65bd1c549f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:38.707657 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85cdb2-45d2-43ca-be8f-8f65bd1c549f service nova] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:38.707942 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85cdb2-45d2-43ca-be8f-8f65bd1c549f service nova] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:38.708270 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85cdb2-45d2-43ca-be8f-8f65bd1c549f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:38.717555 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed85cdb2-45d2-43ca-be8f-8f65bd1c549f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:38.719664 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed85cdb2-45d2-43ca-be8f-8f65bd1c549f service nova] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:38.730519 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 802/1625] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:33:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 19:33:39.073051 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3301b-fb93-43c9-b0e4-b108ee944a1d None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:39.073654 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3301b-fb93-43c9-b0e4-b108ee944a1d None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:39.073654 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3301b-fb93-43c9-b0e4-b108ee944a1d None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:39.075262 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 824/1626] 10.222.0.60 () {54 vars in 912 bytes} [Thu Jul 21 19:33:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:33:39.082043 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a5561-23ce-422f-9f12-d849c57a2657 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:39.082968 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a5561-23ce-422f-9f12-d849c57a2657 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:39.083526 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a5561-23ce-422f-9f12-d849c57a2657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:39.111928 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-9c6a5561-23ce-422f-9f12-d849c57a2657 None None] MFA Rules not processed for user `6b4d98e967814e5f84f5f0d67ebb3c17`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:39.117056 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-9c6a5561-23ce-422f-9f12-d849c57a2657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:39.127707 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 803/1627] 10.222.0.60 () {58 vars in 1009 bytes} [Thu Jul 21 19:33:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:39.757814 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3301b-fb93-43c9-b0e4-b108ee944a1d None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:39.772041 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3301b-fb93-43c9-b0e4-b108ee944a1d None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:39.775787 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f2b4c-e137-46a1-a9ea-3a0d162ad548 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:39.776426 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f2b4c-e137-46a1-a9ea-3a0d162ad548 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:39.776712 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f2b4c-e137-46a1-a9ea-3a0d162ad548 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:39.776991 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f2b4c-e137-46a1-a9ea-3a0d162ad548 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:39.790412 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379f2b4c-e137-46a1-a9ea-3a0d162ad548 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:39.792054 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379f2b4c-e137-46a1-a9ea-3a0d162ad548 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:39.825257 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 825/1628] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:33:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:33:40.023175 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a5561-23ce-422f-9f12-d849c57a2657 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:40.039240 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a5561-23ce-422f-9f12-d849c57a2657 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:40.055051 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f93264-0f1a-4942-8def-17eb9f06a3c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:40.055751 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f93264-0f1a-4942-8def-17eb9f06a3c3 service nova] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:40.056043 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f93264-0f1a-4942-8def-17eb9f06a3c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:40.056320 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f93264-0f1a-4942-8def-17eb9f06a3c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:40.072662 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f93264-0f1a-4942-8def-17eb9f06a3c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:40.074298 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f93264-0f1a-4942-8def-17eb9f06a3c3 service nova] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:40.099798 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 804/1629] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:33:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:33:40.555849 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f2b4c-e137-46a1-a9ea-3a0d162ad548 service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:40.555849 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f2b4c-e137-46a1-a9ea-3a0d162ad548 service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:40.555849 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540d565-a365-4c88-a3c0-c3d4fba495eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:40.555849 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540d565-a365-4c88-a3c0-c3d4fba495eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:40.573050 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540d565-a365-4c88-a3c0-c3d4fba495eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:40.573050 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540d565-a365-4c88-a3c0-c3d4fba495eb admin admin] PATH_INFO: `/v3/users/df42c0240d5946dda2ce676ae80edfe8` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:40.573050 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2540d565-a365-4c88-a3c0-c3d4fba495eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=df42c0240d5946dda2ce676ae80edfe8)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:40.573050 dv-cinder-749155-9-smb devstack@keystone.service[80338]: WARNING py.warnings [None req-2540d565-a365-4c88-a3c0-c3d4fba495eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 19:33:40.573050 dv-cinder-749155-9-smb devstack@keystone.service[80338]: warnings.warn(msg) Jul 21 19:33:40.573050 dv-cinder-749155-9-smb devstack@keystone.service[80338]: Jul 21 19:33:40.573050 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2540d565-a365-4c88-a3c0-c3d4fba495eb admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:40.817786 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:33:40.907401 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-2540d565-a365-4c88-a3c0-c3d4fba495eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df42c0240d5946dda2ce676ae80edfe8'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:41.150820 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-2540d565-a365-4c88-a3c0-c3d4fba495eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df42c0240d5946dda2ce676ae80edfe8'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:41.151485 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-2540d565-a365-4c88-a3c0-c3d4fba495eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df42c0240d5946dda2ce676ae80edfe8'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:41.167565 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-2540d565-a365-4c88-a3c0-c3d4fba495eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df42c0240d5946dda2ce676ae80edfe8'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:41.193774 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-2540d565-a365-4c88-a3c0-c3d4fba495eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df42c0240d5946dda2ce676ae80edfe8'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:41.200970 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 826/1630] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:33:40 2022] DELETE /identity/v3/users/df42c0240d5946dda2ce676ae80edfe8 => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:33:41.205704 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cca62-d72b-4b3a-99c9-9c8cd723932b None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:41.206166 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cca62-d72b-4b3a-99c9-9c8cd723932b None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:41.206282 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cca62-d72b-4b3a-99c9-9c8cd723932b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:41.244036 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-446cca62-d72b-4b3a-99c9-9c8cd723932b None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:41.244579 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-446cca62-d72b-4b3a-99c9-9c8cd723932b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:41.335891 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 805/1631] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:41.355286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540d565-a365-4c88-a3c0-c3d4fba495eb admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:41.357037 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-2540d565-a365-4c88-a3c0-c3d4fba495eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:41.453267 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540d565-a365-4c88-a3c0-c3d4fba495eb admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:41.456935 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e0df2-cb60-4bea-bed0-7937f16de4e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:41.458654 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e0df2-cb60-4bea-bed0-7937f16de4e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:41.458943 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e0df2-cb60-4bea-bed0-7937f16de4e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:41.459218 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e0df2-cb60-4bea-bed0-7937f16de4e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:41.479144 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1e0df2-cb60-4bea-bed0-7937f16de4e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:41.479144 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1e0df2-cb60-4bea-bed0-7937f16de4e8 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:41.487107 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 827/1632] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:33:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 19:33:42.492436 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446cca62-d72b-4b3a-99c9-9c8cd723932b None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:42.493829 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-446cca62-d72b-4b3a-99c9-9c8cd723932b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:42.515764 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446cca62-d72b-4b3a-99c9-9c8cd723932b None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:42.547380 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ec679-1f93-4919-ab26-a5666fc4453e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:42.549496 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ec679-1f93-4919-ab26-a5666fc4453e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:42.549496 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ec679-1f93-4919-ab26-a5666fc4453e admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:42.549496 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ec679-1f93-4919-ab26-a5666fc4453e admin admin] PATH_INFO: `/v3/projects/5677178939ed49b78053012db12fc841` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:42.552216 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ec679-1f93-4919-ab26-a5666fc4453e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5677178939ed49b78053012db12fc841)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:42.560011 dv-cinder-749155-9-smb devstack@keystone.service[80339]: WARNING py.warnings [None req-bc3ec679-1f93-4919-ab26-a5666fc4453e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 19:33:42.560011 dv-cinder-749155-9-smb devstack@keystone.service[80339]: warnings.warn(msg) Jul 21 19:33:42.560011 dv-cinder-749155-9-smb devstack@keystone.service[80339]: Jul 21 19:33:42.567171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ec679-1f93-4919-ab26-a5666fc4453e admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:42.727577 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:33:42.768253 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-bc3ec679-1f93-4919-ab26-a5666fc4453e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5677178939ed49b78053012db12fc841', 'request_id': 'req-bc3ec679-1f93-4919-ab26-a5666fc4453e'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:42.907172 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-bc3ec679-1f93-4919-ab26-a5666fc4453e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5677178939ed49b78053012db12fc841', 'request_id': 'req-bc3ec679-1f93-4919-ab26-a5666fc4453e'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:42.917940 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-bc3ec679-1f93-4919-ab26-a5666fc4453e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5677178939ed49b78053012db12fc841', 'request_id': 'req-bc3ec679-1f93-4919-ab26-a5666fc4453e'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:42.976705 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-bc3ec679-1f93-4919-ab26-a5666fc4453e admin admin] The token cache is being invalidate because project 5677178939ed49b78053012db12fc841 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:33:42.977094 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-bc3ec679-1f93-4919-ab26-a5666fc4453e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:42.978769 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-bc3ec679-1f93-4919-ab26-a5666fc4453e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:42.982320 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 806/1633] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:33:42 2022] DELETE /identity/v3/projects/5677178939ed49b78053012db12fc841 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:33:42.994050 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3e0b1-0b4a-4428-a23c-09bf63dfcf2f None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:43.001252 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3e0b1-0b4a-4428-a23c-09bf63dfcf2f None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:43.001252 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3e0b1-0b4a-4428-a23c-09bf63dfcf2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:43.044801 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-2ff3e0b1-0b4a-4428-a23c-09bf63dfcf2f None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:43.048268 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-2ff3e0b1-0b4a-4428-a23c-09bf63dfcf2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:43.212133 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 828/1634] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:43.221341 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50654bd-eba8-4e37-86d0-749f5eb13913 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:43.221872 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50654bd-eba8-4e37-86d0-749f5eb13913 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:43.222318 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50654bd-eba8-4e37-86d0-749f5eb13913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:43.303077 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-c50654bd-eba8-4e37-86d0-749f5eb13913 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:43.306231 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-c50654bd-eba8-4e37-86d0-749f5eb13913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:43.325143 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 807/1635] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:43.330503 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3e0b1-0b4a-4428-a23c-09bf63dfcf2f None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:43.349983 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3e0b1-0b4a-4428-a23c-09bf63dfcf2f None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:43.370614 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56a909-dfba-4a91-8208-9ea9fe2d034d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:43.371320 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56a909-dfba-4a91-8208-9ea9fe2d034d admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:43.371643 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56a909-dfba-4a91-8208-9ea9fe2d034d admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:43.371930 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56a909-dfba-4a91-8208-9ea9fe2d034d admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:43.372773 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56a909-dfba-4a91-8208-9ea9fe2d034d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:33:43.373090 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56a909-dfba-4a91-8208-9ea9fe2d034d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:43.375186 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56a909-dfba-4a91-8208-9ea9fe2d034d admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:43.404906 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 829/1636] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:33:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:33:43.405636 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50654bd-eba8-4e37-86d0-749f5eb13913 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:43.428314 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50654bd-eba8-4e37-86d0-749f5eb13913 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:43.442405 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d62e64-10ec-4ec1-a0bf-31a532f728e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:43.443300 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d62e64-10ec-4ec1-a0bf-31a532f728e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:43.444136 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d62e64-10ec-4ec1-a0bf-31a532f728e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:43.445517 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d62e64-10ec-4ec1-a0bf-31a532f728e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:43.447021 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d62e64-10ec-4ec1-a0bf-31a532f728e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:43.455168 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d62e64-10ec-4ec1-a0bf-31a532f728e7 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:43.612710 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56a909-dfba-4a91-8208-9ea9fe2d034d admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:43.618912 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 808/1637] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:33:43 2022] POST /identity/v3/projects => generated 371 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:33:43.626288 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56a909-dfba-4a91-8208-9ea9fe2d034d admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:43.660637 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:33:43.793087 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68253060-794b-41cb-93b0-30ddfa37dccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:43.797072 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68253060-794b-41cb-93b0-30ddfa37dccf admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:43.797072 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68253060-794b-41cb-93b0-30ddfa37dccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:43.797072 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68253060-794b-41cb-93b0-30ddfa37dccf admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:43.797072 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68253060-794b-41cb-93b0-30ddfa37dccf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:43.801761 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68253060-794b-41cb-93b0-30ddfa37dccf admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:43.867265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d62e64-10ec-4ec1-a0bf-31a532f728e7 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:43.869141 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-48d62e64-10ec-4ec1-a0bf-31a532f728e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:43.896858 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d62e64-10ec-4ec1-a0bf-31a532f728e7 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:43.922862 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224aa63-e906-4313-8edd-adf8c73fda07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:43.936282 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 830/1638] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:33:43 2022] POST /identity/v3/users => generated 286 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 19:33:43.941341 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68253060-794b-41cb-93b0-30ddfa37dccf admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:43.941915 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224aa63-e906-4313-8edd-adf8c73fda07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:43.951625 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224aa63-e906-4313-8edd-adf8c73fda07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:43.951977 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224aa63-e906-4313-8edd-adf8c73fda07 admin admin] PATH_INFO: `/v3/users/ca1f44332fc54eda99fd6c1926e76a74` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:43.956854 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224aa63-e906-4313-8edd-adf8c73fda07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca1f44332fc54eda99fd6c1926e76a74)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:43.977547 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224aa63-e906-4313-8edd-adf8c73fda07 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:43.996743 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68253060-794b-41cb-93b0-30ddfa37dccf admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:44.031543 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a983bb-3c34-452f-9281-fa940c628ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:44.032567 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a983bb-3c34-452f-9281-fa940c628ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:44.033001 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a983bb-3c34-452f-9281-fa940c628ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:44.035640 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a983bb-3c34-452f-9281-fa940c628ad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:44.038540 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a983bb-3c34-452f-9281-fa940c628ad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:44.038540 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a983bb-3c34-452f-9281-fa940c628ad8 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:44.072005 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 831/1639] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:33:43 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:33:44.073156 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a983bb-3c34-452f-9281-fa940c628ad8 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:44.084354 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a983bb-3c34-452f-9281-fa940c628ad8 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:44.090553 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524223e9-f0c2-41e9-abf4-e6e57b9a6fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:44.092328 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524223e9-f0c2-41e9-abf4-e6e57b9a6fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:44.092774 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524223e9-f0c2-41e9-abf4-e6e57b9a6fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:44.093213 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524223e9-f0c2-41e9-abf4-e6e57b9a6fc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:44.094161 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524223e9-f0c2-41e9-abf4-e6e57b9a6fc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:44.096049 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524223e9-f0c2-41e9-abf4-e6e57b9a6fc1 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:44.114746 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 832/1640] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:33:44.116489 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524223e9-f0c2-41e9-abf4-e6e57b9a6fc1 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:44.132772 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524223e9-f0c2-41e9-abf4-e6e57b9a6fc1 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:44.138685 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f7f8d-baa9-4027-97b6-ae505d91970c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:44.140696 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f7f8d-baa9-4027-97b6-ae505d91970c admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:44.141165 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f7f8d-baa9-4027-97b6-ae505d91970c admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:44.141668 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f7f8d-baa9-4027-97b6-ae505d91970c admin admin] PATH_INFO: `/v3/projects/04ada436a5f94e918b4e6764f6663c3d/users/9836ac53cbaf4616b63f1a7db4083bae/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:44.164144 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f7f8d-baa9-4027-97b6-ae505d91970c admin admin] RBAC: Authorizing `identity:create_grant(project_id=04ada436a5f94e918b4e6764f6663c3d, user_id=9836ac53cbaf4616b63f1a7db4083bae, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:44.167196 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f7f8d-baa9-4027-97b6-ae505d91970c admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:44.304032 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 833/1641] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:33:44 2022] PUT /identity/v3/projects/04ada436a5f94e918b4e6764f6663c3d/users/9836ac53cbaf4616b63f1a7db4083bae/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:33:44.305990 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a710ce-370c-4b06-8e50-20a1b2d230bb None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:44.305990 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a710ce-370c-4b06-8e50-20a1b2d230bb None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:44.306162 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a710ce-370c-4b06-8e50-20a1b2d230bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:44.324641 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-3224aa63-e906-4313-8edd-adf8c73fda07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca1f44332fc54eda99fd6c1926e76a74'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:44.358625 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-25a710ce-370c-4b06-8e50-20a1b2d230bb None None] MFA Rules not processed for user `9836ac53cbaf4616b63f1a7db4083bae`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:44.360687 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-25a710ce-370c-4b06-8e50-20a1b2d230bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:44.421543 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-3224aa63-e906-4313-8edd-adf8c73fda07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca1f44332fc54eda99fd6c1926e76a74'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:44.440901 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-3224aa63-e906-4313-8edd-adf8c73fda07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca1f44332fc54eda99fd6c1926e76a74'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:44.441858 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-3224aa63-e906-4313-8edd-adf8c73fda07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca1f44332fc54eda99fd6c1926e76a74'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:44.459783 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-3224aa63-e906-4313-8edd-adf8c73fda07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca1f44332fc54eda99fd6c1926e76a74'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:44.489944 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 809/1642] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:33:43 2022] DELETE /identity/v3/users/ca1f44332fc54eda99fd6c1926e76a74 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:33:44.489944 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645409c4-25a2-4a67-a214-9d0c2c4ec193 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:44.489944 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645409c4-25a2-4a67-a214-9d0c2c4ec193 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:44.489944 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645409c4-25a2-4a67-a214-9d0c2c4ec193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:44.491769 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 834/1643] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:44.498943 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a710ce-370c-4b06-8e50-20a1b2d230bb None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:44.501975 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-25a710ce-370c-4b06-8e50-20a1b2d230bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:44.535296 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-645409c4-25a2-4a67-a214-9d0c2c4ec193 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:44.538819 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-645409c4-25a2-4a67-a214-9d0c2c4ec193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:44.680635 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a710ce-370c-4b06-8e50-20a1b2d230bb None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:44.725347 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 810/1644] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:44.778357 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed104082-2349-4a83-a015-e6268e78fe67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:44.779173 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed104082-2349-4a83-a015-e6268e78fe67 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:44.779520 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed104082-2349-4a83-a015-e6268e78fe67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:44.780840 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed104082-2349-4a83-a015-e6268e78fe67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:44.780840 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed104082-2349-4a83-a015-e6268e78fe67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:44.782428 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed104082-2349-4a83-a015-e6268e78fe67 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:44.821690 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645409c4-25a2-4a67-a214-9d0c2c4ec193 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:44.823626 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-645409c4-25a2-4a67-a214-9d0c2c4ec193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:44.851545 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:33:44.885425 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 835/1645] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:33:44 2022] POST /identity/v3/projects => generated 371 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:33:44.893200 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed104082-2349-4a83-a015-e6268e78fe67 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:45.061958 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed104082-2349-4a83-a015-e6268e78fe67 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:45.065987 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645409c4-25a2-4a67-a214-9d0c2c4ec193 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:45.115057 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af715233-00d8-40ee-8828-2fdaed9bdfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:45.116511 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af715233-00d8-40ee-8828-2fdaed9bdfd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:45.116913 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af715233-00d8-40ee-8828-2fdaed9bdfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:45.117380 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af715233-00d8-40ee-8828-2fdaed9bdfd6 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:45.118261 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af715233-00d8-40ee-8828-2fdaed9bdfd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:45.121967 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af715233-00d8-40ee-8828-2fdaed9bdfd6 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:45.223555 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 836/1646] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:33:44 2022] POST /identity/v3/users => generated 292 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:33:45.225931 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af715233-00d8-40ee-8828-2fdaed9bdfd6 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:45.234409 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f906a1-2653-4c1c-a921-7763c1b486dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:45.238265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f906a1-2653-4c1c-a921-7763c1b486dd service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:45.238265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f906a1-2653-4c1c-a921-7763c1b486dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:45.238265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f906a1-2653-4c1c-a921-7763c1b486dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:45.261513 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af715233-00d8-40ee-8828-2fdaed9bdfd6 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:45.267288 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f906a1-2653-4c1c-a921-7763c1b486dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:45.273232 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f906a1-2653-4c1c-a921-7763c1b486dd service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:45.276319 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1dbc92-1068-4ec2-bccd-84764d326e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:45.278085 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1dbc92-1068-4ec2-bccd-84764d326e8a admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:45.279682 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1dbc92-1068-4ec2-bccd-84764d326e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:45.281144 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1dbc92-1068-4ec2-bccd-84764d326e8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:45.281943 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1dbc92-1068-4ec2-bccd-84764d326e8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:45.287548 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1dbc92-1068-4ec2-bccd-84764d326e8a admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:45.302580 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 811/1647] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:33:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 19:33:45.310579 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 837/1648] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:33:45.315101 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f906a1-2653-4c1c-a921-7763c1b486dd service neutron] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:45.330161 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f906a1-2653-4c1c-a921-7763c1b486dd service neutron] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:45.339196 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f2d9a-8317-46a1-a8be-d5ddcb0d0409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:45.340538 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f2d9a-8317-46a1-a8be-d5ddcb0d0409 admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:45.342647 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f2d9a-8317-46a1-a8be-d5ddcb0d0409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:45.360688 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f2d9a-8317-46a1-a8be-d5ddcb0d0409 admin admin] PATH_INFO: `/v3/projects/ebdd0a48fe364e98a224c2321c20153e/users/b8532dbb8ce04eae88161ff563fdbb77/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:45.413834 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f2d9a-8317-46a1-a8be-d5ddcb0d0409 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebdd0a48fe364e98a224c2321c20153e, user_id=b8532dbb8ce04eae88161ff563fdbb77, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:45.433739 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f2d9a-8317-46a1-a8be-d5ddcb0d0409 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:45.527769 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 812/1649] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:33:45 2022] PUT /identity/v3/projects/ebdd0a48fe364e98a224c2321c20153e/users/b8532dbb8ce04eae88161ff563fdbb77/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:33:45.532257 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1dbc92-1068-4ec2-bccd-84764d326e8a admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:45.546849 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1dbc92-1068-4ec2-bccd-84764d326e8a admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:45.572219 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:33:45.683216 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879ff72-6e51-4992-a417-e7fe7d40cc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:45.684209 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879ff72-6e51-4992-a417-e7fe7d40cc16 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:45.685179 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879ff72-6e51-4992-a417-e7fe7d40cc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:45.685614 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879ff72-6e51-4992-a417-e7fe7d40cc16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:45.686559 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6879ff72-6e51-4992-a417-e7fe7d40cc16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:45.688240 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6879ff72-6e51-4992-a417-e7fe7d40cc16 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:45.713092 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 838/1650] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:33:45.717855 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f2d9a-8317-46a1-a8be-d5ddcb0d0409 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:45.744224 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f2d9a-8317-46a1-a8be-d5ddcb0d0409 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:45.750174 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb553c55-d3ef-4b0f-86ed-e008df888abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:45.751181 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb553c55-d3ef-4b0f-86ed-e008df888abb admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:45.751485 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb553c55-d3ef-4b0f-86ed-e008df888abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:45.751769 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb553c55-d3ef-4b0f-86ed-e008df888abb admin admin] PATH_INFO: `/v3/projects/ebdd0a48fe364e98a224c2321c20153e/users/b8532dbb8ce04eae88161ff563fdbb77/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:45.757407 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb553c55-d3ef-4b0f-86ed-e008df888abb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebdd0a48fe364e98a224c2321c20153e, user_id=b8532dbb8ce04eae88161ff563fdbb77, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:45.766756 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb553c55-d3ef-4b0f-86ed-e008df888abb admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:45.807970 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 813/1651] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:33:45 2022] PUT /identity/v3/projects/ebdd0a48fe364e98a224c2321c20153e/users/b8532dbb8ce04eae88161ff563fdbb77/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:33:45.809228 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456e805-058f-42e6-97b9-4c0974aa23d3 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:45.809526 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456e805-058f-42e6-97b9-4c0974aa23d3 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:45.809944 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456e805-058f-42e6-97b9-4c0974aa23d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:45.874884 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-0456e805-058f-42e6-97b9-4c0974aa23d3 None None] MFA Rules not processed for user `b8532dbb8ce04eae88161ff563fdbb77`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:45.876191 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-0456e805-058f-42e6-97b9-4c0974aa23d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:46.034305 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 839/1652] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:45 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:33:46.047767 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb553c55-d3ef-4b0f-86ed-e008df888abb admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:46.049749 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-fb553c55-d3ef-4b0f-86ed-e008df888abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:46.183095 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb553c55-d3ef-4b0f-86ed-e008df888abb admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:46.188783 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7edaf-8972-453f-820b-7f3af8377722 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:46.189963 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7edaf-8972-453f-820b-7f3af8377722 service cinder] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:46.190343 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7edaf-8972-453f-820b-7f3af8377722 service cinder] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:46.190683 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7edaf-8972-453f-820b-7f3af8377722 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:46.202517 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f7edaf-8972-453f-820b-7f3af8377722 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:46.204242 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f7edaf-8972-453f-820b-7f3af8377722 service cinder] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:46.217855 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 814/1653] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:33:46 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:33:46.957003 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:33:47.489370 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456e805-058f-42e6-97b9-4c0974aa23d3 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:47.500745 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-0456e805-058f-42e6-97b9-4c0974aa23d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:47.681006 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456e805-058f-42e6-97b9-4c0974aa23d3 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:47.697044 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f419c2f-71ab-4804-a1ac-1c0d867fef5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:47.698989 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f419c2f-71ab-4804-a1ac-1c0d867fef5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:47.699702 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f419c2f-71ab-4804-a1ac-1c0d867fef5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:47.701126 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f419c2f-71ab-4804-a1ac-1c0d867fef5b admin admin] PATH_INFO: `/v3/projects/5b19fbc3ef2b481e9a2201bc57c74b09` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:47.703853 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f419c2f-71ab-4804-a1ac-1c0d867fef5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b19fbc3ef2b481e9a2201bc57c74b09)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:47.706003 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f419c2f-71ab-4804-a1ac-1c0d867fef5b admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:47.857233 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7edaf-8972-453f-820b-7f3af8377722 service cinder] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:47.870251 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7edaf-8972-453f-820b-7f3af8377722 service cinder] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:47.909293 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-0f419c2f-71ab-4804-a1ac-1c0d867fef5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b19fbc3ef2b481e9a2201bc57c74b09', 'request_id': 'req-0f419c2f-71ab-4804-a1ac-1c0d867fef5b'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:47.921780 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-0f419c2f-71ab-4804-a1ac-1c0d867fef5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b19fbc3ef2b481e9a2201bc57c74b09', 'request_id': 'req-0f419c2f-71ab-4804-a1ac-1c0d867fef5b'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:47.965608 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:33:48.015847 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-0f419c2f-71ab-4804-a1ac-1c0d867fef5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b19fbc3ef2b481e9a2201bc57c74b09', 'request_id': 'req-0f419c2f-71ab-4804-a1ac-1c0d867fef5b'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:48.040383 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-0f419c2f-71ab-4804-a1ac-1c0d867fef5b admin admin] The token cache is being invalidate because project 5b19fbc3ef2b481e9a2201bc57c74b09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:33:48.040944 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-0f419c2f-71ab-4804-a1ac-1c0d867fef5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:48.043395 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-0f419c2f-71ab-4804-a1ac-1c0d867fef5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:48.052976 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 840/1654] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:33:47 2022] DELETE /identity/v3/projects/5b19fbc3ef2b481e9a2201bc57c74b09 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:33:48.058649 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48e3ab-5c6a-4c69-be9a-5db252c44dd5 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:48.058862 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48e3ab-5c6a-4c69-be9a-5db252c44dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:48.060275 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc925d-4ce0-43f1-ba6e-1e28f3314fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:48.061785 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48e3ab-5c6a-4c69-be9a-5db252c44dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:48.062472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc925d-4ce0-43f1-ba6e-1e28f3314fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:48.064708 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc925d-4ce0-43f1-ba6e-1e28f3314fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:48.068868 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc925d-4ce0-43f1-ba6e-1e28f3314fe2 admin admin] PATH_INFO: `/v3/users/9836ac53cbaf4616b63f1a7db4083bae` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:48.072820 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cc925d-4ce0-43f1-ba6e-1e28f3314fe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9836ac53cbaf4616b63f1a7db4083bae)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:48.080578 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cc925d-4ce0-43f1-ba6e-1e28f3314fe2 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:48.157227 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-fd48e3ab-5c6a-4c69-be9a-5db252c44dd5 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:48.159306 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-fd48e3ab-5c6a-4c69-be9a-5db252c44dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:48.196868 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 841/1655] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:48.215482 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2681a6-e356-40dd-9bd6-b81a48d3f10f None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:48.217175 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2681a6-e356-40dd-9bd6-b81a48d3f10f None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:48.217652 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2681a6-e356-40dd-9bd6-b81a48d3f10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:48.270824 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-9a2681a6-e356-40dd-9bd6-b81a48d3f10f None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:48.276226 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-9a2681a6-e356-40dd-9bd6-b81a48d3f10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:48.286276 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 842/1656] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:48.304260 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2681a6-e356-40dd-9bd6-b81a48d3f10f None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:48.319329 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:33:48.326485 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2681a6-e356-40dd-9bd6-b81a48d3f10f None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:48.342532 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-40cc925d-4ce0-43f1-ba6e-1e28f3314fe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9836ac53cbaf4616b63f1a7db4083bae'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:48.343097 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b27df8-9148-49d1-949d-c9c2de20d91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:48.344076 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b27df8-9148-49d1-949d-c9c2de20d91a admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:48.344993 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b27df8-9148-49d1-949d-c9c2de20d91a admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:48.345489 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b27df8-9148-49d1-949d-c9c2de20d91a admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:48.346440 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b27df8-9148-49d1-949d-c9c2de20d91a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:33:48.347008 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b27df8-9148-49d1-949d-c9c2de20d91a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:48.348927 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b27df8-9148-49d1-949d-c9c2de20d91a admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:48.368820 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 843/1657] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:33:48.370366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b27df8-9148-49d1-949d-c9c2de20d91a admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:48.380913 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-11b27df8-9148-49d1-949d-c9c2de20d91a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:48.432976 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-40cc925d-4ce0-43f1-ba6e-1e28f3314fe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9836ac53cbaf4616b63f1a7db4083bae'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:48.442851 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b27df8-9148-49d1-949d-c9c2de20d91a admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:48.459307 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6206f-d0dd-48bf-b023-186ffff4a36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:48.461100 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6206f-d0dd-48bf-b023-186ffff4a36b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:48.461640 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6206f-d0dd-48bf-b023-186ffff4a36b admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:48.462141 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6206f-d0dd-48bf-b023-186ffff4a36b admin admin] PATH_INFO: `/v3/users/46f0fd56b2e2436aa0ab9f5f1baacab1` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:48.471346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb6206f-d0dd-48bf-b023-186ffff4a36b admin admin] RBAC: Authorizing `identity:delete_user(user_id=46f0fd56b2e2436aa0ab9f5f1baacab1)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:48.473724 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb6206f-d0dd-48bf-b023-186ffff4a36b admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:48.473859 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-40cc925d-4ce0-43f1-ba6e-1e28f3314fe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9836ac53cbaf4616b63f1a7db4083bae'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:48.475601 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-40cc925d-4ce0-43f1-ba6e-1e28f3314fe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9836ac53cbaf4616b63f1a7db4083bae'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:48.502999 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-40cc925d-4ce0-43f1-ba6e-1e28f3314fe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9836ac53cbaf4616b63f1a7db4083bae'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:48.520367 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 815/1658] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:33:47 2022] DELETE /identity/v3/users/9836ac53cbaf4616b63f1a7db4083bae => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:33:48.524269 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc925d-4ce0-43f1-ba6e-1e28f3314fe2 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:48.528286 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-40cc925d-4ce0-43f1-ba6e-1e28f3314fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:48.718610 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc925d-4ce0-43f1-ba6e-1e28f3314fe2 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:48.732951 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf074a-9265-4d64-a48c-65411bae2dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:48.734201 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf074a-9265-4d64-a48c-65411bae2dde admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:48.734201 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf074a-9265-4d64-a48c-65411bae2dde admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:48.735381 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf074a-9265-4d64-a48c-65411bae2dde admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:48.736159 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbf074a-9265-4d64-a48c-65411bae2dde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:48.742751 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbf074a-9265-4d64-a48c-65411bae2dde admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:48.769279 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-7bb6206f-d0dd-48bf-b023-186ffff4a36b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46f0fd56b2e2436aa0ab9f5f1baacab1'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:48.913305 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-7bb6206f-d0dd-48bf-b023-186ffff4a36b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46f0fd56b2e2436aa0ab9f5f1baacab1'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:48.916025 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-7bb6206f-d0dd-48bf-b023-186ffff4a36b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46f0fd56b2e2436aa0ab9f5f1baacab1'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:48.925118 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-7bb6206f-d0dd-48bf-b023-186ffff4a36b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46f0fd56b2e2436aa0ab9f5f1baacab1'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:48.985985 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 816/1659] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:33:48 2022] POST /identity/v3/projects => generated 405 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:33:48.986503 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-7bb6206f-d0dd-48bf-b023-186ffff4a36b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46f0fd56b2e2436aa0ab9f5f1baacab1'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:48.988921 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335de1c2-49db-45d8-bc04-dae6dc034c09 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:48.992276 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335de1c2-49db-45d8-bc04-dae6dc034c09 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:48.992805 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335de1c2-49db-45d8-bc04-dae6dc034c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:49.008758 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 844/1660] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:33:48 2022] DELETE /identity/v3/users/46f0fd56b2e2436aa0ab9f5f1baacab1 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:33:49.012873 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6206f-d0dd-48bf-b023-186ffff4a36b admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:49.013593 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-7bb6206f-d0dd-48bf-b023-186ffff4a36b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:49.048777 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-335de1c2-49db-45d8-bc04-dae6dc034c09 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:49.050425 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-335de1c2-49db-45d8-bc04-dae6dc034c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:49.202716 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:33:49.249529 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6206f-d0dd-48bf-b023-186ffff4a36b admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:49.263144 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ae3f2-74d8-4f81-bf14-d221da290d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:49.272433 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ae3f2-74d8-4f81-bf14-d221da290d27 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:49.272433 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ae3f2-74d8-4f81-bf14-d221da290d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:49.272433 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ae3f2-74d8-4f81-bf14-d221da290d27 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:49.272433 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ae3f2-74d8-4f81-bf14-d221da290d27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:49.272733 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 817/1661] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:49.272733 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f1875-a4ed-401f-bf14-687c875593c5 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:49.272733 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f1875-a4ed-401f-bf14-687c875593c5 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:49.272733 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f1875-a4ed-401f-bf14-687c875593c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:49.275480 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ae3f2-74d8-4f81-bf14-d221da290d27 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:49.321890 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-d23f1875-a4ed-401f-bf14-687c875593c5 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:49.324503 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-d23f1875-a4ed-401f-bf14-687c875593c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:49.353830 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 818/1662] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:49.408752 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 845/1663] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:33:49 2022] POST /identity/v3/users => generated 303 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:33:49.415516 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f1875-a4ed-401f-bf14-687c875593c5 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:49.430729 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f1875-a4ed-401f-bf14-687c875593c5 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:49.447277 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444dd482-50db-4b77-a6b4-6dffa20c1073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:49.447277 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444dd482-50db-4b77-a6b4-6dffa20c1073 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:49.447277 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444dd482-50db-4b77-a6b4-6dffa20c1073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:49.447277 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444dd482-50db-4b77-a6b4-6dffa20c1073 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:49.448090 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444dd482-50db-4b77-a6b4-6dffa20c1073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:49.453638 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444dd482-50db-4b77-a6b4-6dffa20c1073 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:49.456275 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ae3f2-74d8-4f81-bf14-d221da290d27 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:49.458050 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-4b4ae3f2-74d8-4f81-bf14-d221da290d27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:49.492074 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 819/1664] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:33:49.497972 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444dd482-50db-4b77-a6b4-6dffa20c1073 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:49.500860 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-444dd482-50db-4b77-a6b4-6dffa20c1073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:49.589645 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ae3f2-74d8-4f81-bf14-d221da290d27 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:49.600651 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb56b66-7664-4b27-aead-92573280c28a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:49.601670 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb56b66-7664-4b27-aead-92573280c28a service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:49.602110 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb56b66-7664-4b27-aead-92573280c28a service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:49.602701 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb56b66-7664-4b27-aead-92573280c28a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:49.628763 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb56b66-7664-4b27-aead-92573280c28a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:49.630503 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb56b66-7664-4b27-aead-92573280c28a service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:49.657494 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 846/1665] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:33:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 19:33:49.658664 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb56b66-7664-4b27-aead-92573280c28a service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:49.676007 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444dd482-50db-4b77-a6b4-6dffa20c1073 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:49.687444 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959ef6a-abc9-4d49-8336-d67d965d9d93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:49.688236 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959ef6a-abc9-4d49-8336-d67d965d9d93 service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:49.688683 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959ef6a-abc9-4d49-8336-d67d965d9d93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:49.689059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959ef6a-abc9-4d49-8336-d67d965d9d93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:49.695725 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb56b66-7664-4b27-aead-92573280c28a service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:49.711919 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a23547-bdcc-46ad-9dd8-a586f98129e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:49.712882 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a23547-bdcc-46ad-9dd8-a586f98129e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:49.713324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a23547-bdcc-46ad-9dd8-a586f98129e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:49.713904 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a23547-bdcc-46ad-9dd8-a586f98129e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:49.714913 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a23547-bdcc-46ad-9dd8-a586f98129e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:49.716618 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5959ef6a-abc9-4d49-8336-d67d965d9d93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:49.717673 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a23547-bdcc-46ad-9dd8-a586f98129e8 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:49.718312 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5959ef6a-abc9-4d49-8336-d67d965d9d93 service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:49.742285 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 820/1666] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:33:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:33:49.746581 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 847/1667] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:33:49.751173 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959ef6a-abc9-4d49-8336-d67d965d9d93 service neutron] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:49.768047 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959ef6a-abc9-4d49-8336-d67d965d9d93 service neutron] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:49.783636 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a73b4-f473-4100-95b0-bcbfcba48c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:49.784614 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a73b4-f473-4100-95b0-bcbfcba48c07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:49.784999 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a73b4-f473-4100-95b0-bcbfcba48c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:49.785381 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a73b4-f473-4100-95b0-bcbfcba48c07 admin admin] PATH_INFO: `/v3/projects/42197ee0fd1a45aaa1b2c414e724b176/users/466eac612e9c44c994d3007f4583c4c3/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:49.822914 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a73b4-f473-4100-95b0-bcbfcba48c07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42197ee0fd1a45aaa1b2c414e724b176, user_id=466eac612e9c44c994d3007f4583c4c3, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:49.828652 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a73b4-f473-4100-95b0-bcbfcba48c07 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:49.961623 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 821/1668] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:33:49 2022] PUT /identity/v3/projects/42197ee0fd1a45aaa1b2c414e724b176/users/466eac612e9c44c994d3007f4583c4c3/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:33:49.963834 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c61e2-e875-46e3-a884-0e81fc79910f None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:49.964127 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c61e2-e875-46e3-a884-0e81fc79910f None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:49.964760 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c61e2-e875-46e3-a884-0e81fc79910f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:50.002959 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-fd9c61e2-e875-46e3-a884-0e81fc79910f None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:50.004559 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-fd9c61e2-e875-46e3-a884-0e81fc79910f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:50.128320 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:33:50.152510 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 848/1669] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:50.185627 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a73b4-f473-4100-95b0-bcbfcba48c07 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:50.194309 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-a28a73b4-f473-4100-95b0-bcbfcba48c07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:50.315556 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a73b4-f473-4100-95b0-bcbfcba48c07 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:50.322211 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f54d118-33fb-4c69-b927-3eed154b8b4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:50.323108 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54d118-33fb-4c69-b927-3eed154b8b4e service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:50.323637 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54d118-33fb-4c69-b927-3eed154b8b4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:50.324072 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54d118-33fb-4c69-b927-3eed154b8b4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:50.344423 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f54d118-33fb-4c69-b927-3eed154b8b4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:50.346184 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f54d118-33fb-4c69-b927-3eed154b8b4e service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:50.366564 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 822/1670] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:33:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:33:51.637084 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c61e2-e875-46e3-a884-0e81fc79910f None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:51.639187 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-fd9c61e2-e875-46e3-a884-0e81fc79910f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:51.665394 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c61e2-e875-46e3-a884-0e81fc79910f None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:51.682851 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009957c3-dd9a-4dfb-b3bb-e8857c1145b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:51.686445 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009957c3-dd9a-4dfb-b3bb-e8857c1145b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:51.686445 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009957c3-dd9a-4dfb-b3bb-e8857c1145b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:51.686857 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009957c3-dd9a-4dfb-b3bb-e8857c1145b3 admin admin] PATH_INFO: `/v3/projects/237ee628013a4ae399a473db47e089f7` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:51.692622 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009957c3-dd9a-4dfb-b3bb-e8857c1145b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=237ee628013a4ae399a473db47e089f7)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:51.694778 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009957c3-dd9a-4dfb-b3bb-e8857c1145b3 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:51.909372 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-009957c3-dd9a-4dfb-b3bb-e8857c1145b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '237ee628013a4ae399a473db47e089f7', 'request_id': 'req-009957c3-dd9a-4dfb-b3bb-e8857c1145b3'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:51.917515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-009957c3-dd9a-4dfb-b3bb-e8857c1145b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '237ee628013a4ae399a473db47e089f7', 'request_id': 'req-009957c3-dd9a-4dfb-b3bb-e8857c1145b3'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:51.994004 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-009957c3-dd9a-4dfb-b3bb-e8857c1145b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '237ee628013a4ae399a473db47e089f7', 'request_id': 'req-009957c3-dd9a-4dfb-b3bb-e8857c1145b3'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:52.013656 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-009957c3-dd9a-4dfb-b3bb-e8857c1145b3 admin admin] The token cache is being invalidate because project 237ee628013a4ae399a473db47e089f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:33:52.014297 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-009957c3-dd9a-4dfb-b3bb-e8857c1145b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:52.024021 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-009957c3-dd9a-4dfb-b3bb-e8857c1145b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:52.025885 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 849/1671] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:33:51 2022] DELETE /identity/v3/projects/237ee628013a4ae399a473db47e089f7 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:33:52.031417 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4c126-7b2d-4763-8e89-3f1bf7f9dfa1 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:52.032341 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4c126-7b2d-4763-8e89-3f1bf7f9dfa1 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:52.032762 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4c126-7b2d-4763-8e89-3f1bf7f9dfa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:52.073963 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-b2f4c126-7b2d-4763-8e89-3f1bf7f9dfa1 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:52.076191 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-b2f4c126-7b2d-4763-8e89-3f1bf7f9dfa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:52.076969 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009957c3-dd9a-4dfb-b3bb-e8857c1145b3 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:52.083456 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-009957c3-dd9a-4dfb-b3bb-e8857c1145b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:52.158812 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:33:52.235891 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 823/1672] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:52.261260 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffbb1c8-b50b-4b50-82a2-5045b4f77e4c None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:52.263156 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffbb1c8-b50b-4b50-82a2-5045b4f77e4c None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:52.263867 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffbb1c8-b50b-4b50-82a2-5045b4f77e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:52.323856 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009957c3-dd9a-4dfb-b3bb-e8857c1145b3 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:52.332845 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-dffbb1c8-b50b-4b50-82a2-5045b4f77e4c None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:52.335273 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-dffbb1c8-b50b-4b50-82a2-5045b4f77e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:52.337612 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379f0be-f0aa-4c6d-ab2b-08c34c2a3814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:52.344106 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379f0be-f0aa-4c6d-ab2b-08c34c2a3814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:52.344403 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379f0be-f0aa-4c6d-ab2b-08c34c2a3814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:52.344854 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379f0be-f0aa-4c6d-ab2b-08c34c2a3814 admin admin] PATH_INFO: `/v3/projects/04ada436a5f94e918b4e6764f6663c3d` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:52.347401 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 824/1673] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:52.351147 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f379f0be-f0aa-4c6d-ab2b-08c34c2a3814 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04ada436a5f94e918b4e6764f6663c3d)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:52.351545 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffbb1c8-b50b-4b50-82a2-5045b4f77e4c None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:52.359377 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f379f0be-f0aa-4c6d-ab2b-08c34c2a3814 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:52.368610 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffbb1c8-b50b-4b50-82a2-5045b4f77e4c None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:52.373936 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82215a1f-49e3-4e6b-930b-6284dbeeb171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:52.374495 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:33:52.375043 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82215a1f-49e3-4e6b-930b-6284dbeeb171 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:52.376803 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82215a1f-49e3-4e6b-930b-6284dbeeb171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:52.377273 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82215a1f-49e3-4e6b-930b-6284dbeeb171 admin admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:52.379734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82215a1f-49e3-4e6b-930b-6284dbeeb171 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:33:52.380341 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82215a1f-49e3-4e6b-930b-6284dbeeb171 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:52.383697 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82215a1f-49e3-4e6b-930b-6284dbeeb171 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:52.411559 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 825/1674] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:33:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:33:52.415612 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82215a1f-49e3-4e6b-930b-6284dbeeb171 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:52.440858 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82215a1f-49e3-4e6b-930b-6284dbeeb171 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:52.447238 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0015808f-a773-48c4-885f-4c91ac5f0e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:52.448368 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015808f-a773-48c4-885f-4c91ac5f0e90 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:52.448806 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015808f-a773-48c4-885f-4c91ac5f0e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:52.449260 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015808f-a773-48c4-885f-4c91ac5f0e90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:52.451380 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0015808f-a773-48c4-885f-4c91ac5f0e90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:52.455139 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0015808f-a773-48c4-885f-4c91ac5f0e90 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:52.599039 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-f379f0be-f0aa-4c6d-ab2b-08c34c2a3814 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04ada436a5f94e918b4e6764f6663c3d', 'request_id': 'req-f379f0be-f0aa-4c6d-ab2b-08c34c2a3814'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:52.608373 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 826/1675] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:33:52 2022] POST /identity/v3/projects => generated 377 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:33:52.609723 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0015808f-a773-48c4-885f-4c91ac5f0e90 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:52.630701 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-f379f0be-f0aa-4c6d-ab2b-08c34c2a3814 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04ada436a5f94e918b4e6764f6663c3d', 'request_id': 'req-f379f0be-f0aa-4c6d-ab2b-08c34c2a3814'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:52.734259 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-f379f0be-f0aa-4c6d-ab2b-08c34c2a3814 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04ada436a5f94e918b4e6764f6663c3d', 'request_id': 'req-f379f0be-f0aa-4c6d-ab2b-08c34c2a3814'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:52.744338 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0015808f-a773-48c4-885f-4c91ac5f0e90 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:52.750639 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-f379f0be-f0aa-4c6d-ab2b-08c34c2a3814 admin admin] The token cache is being invalidate because project 04ada436a5f94e918b4e6764f6663c3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:33:52.751648 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-f379f0be-f0aa-4c6d-ab2b-08c34c2a3814 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:52.752679 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6b2fb-ebda-4ede-9275-2c7f1d01dce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:52.753275 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-f379f0be-f0aa-4c6d-ab2b-08c34c2a3814 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:52.754088 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6b2fb-ebda-4ede-9275-2c7f1d01dce1 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:52.754516 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6b2fb-ebda-4ede-9275-2c7f1d01dce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:52.754804 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6b2fb-ebda-4ede-9275-2c7f1d01dce1 admin admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:52.755657 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6b2fb-ebda-4ede-9275-2c7f1d01dce1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:52.762130 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 850/1676] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:33:52 2022] DELETE /identity/v3/projects/04ada436a5f94e918b4e6764f6663c3d => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:33:52.763295 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379f0be-f0aa-4c6d-ab2b-08c34c2a3814 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:52.764825 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f379f0be-f0aa-4c6d-ab2b-08c34c2a3814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:52.769693 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6b2fb-ebda-4ede-9275-2c7f1d01dce1 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:52.892095 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 827/1677] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:33:52 2022] POST /identity/v3/users => generated 289 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:33:52.893843 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce06f0-21b0-42c8-affd-fb1c50f0af69 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:52.895259 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce06f0-21b0-42c8-affd-fb1c50f0af69 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:52.895763 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce06f0-21b0-42c8-affd-fb1c50f0af69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:52.915078 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379f0be-f0aa-4c6d-ab2b-08c34c2a3814 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:52.924564 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706be944-c573-4ab6-b7c9-fa4a4573bcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:52.925753 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706be944-c573-4ab6-b7c9-fa4a4573bcb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:52.926233 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706be944-c573-4ab6-b7c9-fa4a4573bcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:52.926726 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706be944-c573-4ab6-b7c9-fa4a4573bcb1 admin admin] PATH_INFO: `/v3/users/b8532dbb8ce04eae88161ff563fdbb77` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:52.929778 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706be944-c573-4ab6-b7c9-fa4a4573bcb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8532dbb8ce04eae88161ff563fdbb77)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:52.935590 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706be944-c573-4ab6-b7c9-fa4a4573bcb1 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:52.984558 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-93ce06f0-21b0-42c8-affd-fb1c50f0af69 None None] MFA Rules not processed for user `44076ea4ef504e6a957e84dcb83c5d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:52.988812 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-93ce06f0-21b0-42c8-affd-fb1c50f0af69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:53.168400 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-706be944-c573-4ab6-b7c9-fa4a4573bcb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8532dbb8ce04eae88161ff563fdbb77'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:53.202407 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 828/1678] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:53.204057 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce06f0-21b0-42c8-affd-fb1c50f0af69 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:53.207729 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-93ce06f0-21b0-42c8-affd-fb1c50f0af69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:53.257374 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-706be944-c573-4ab6-b7c9-fa4a4573bcb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8532dbb8ce04eae88161ff563fdbb77'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:53.257374 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-706be944-c573-4ab6-b7c9-fa4a4573bcb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8532dbb8ce04eae88161ff563fdbb77'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:53.257534 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce06f0-21b0-42c8-affd-fb1c50f0af69 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:53.267866 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ccdfe0-12f3-4881-b98c-113ad484fe8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:53.268109 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-706be944-c573-4ab6-b7c9-fa4a4573bcb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8532dbb8ce04eae88161ff563fdbb77'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:53.270141 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ccdfe0-12f3-4881-b98c-113ad484fe8b admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:53.270436 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ccdfe0-12f3-4881-b98c-113ad484fe8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:53.270718 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ccdfe0-12f3-4881-b98c-113ad484fe8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:53.271510 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ccdfe0-12f3-4881-b98c-113ad484fe8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:53.273155 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ccdfe0-12f3-4881-b98c-113ad484fe8b admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:53.299647 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 829/1679] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:33:53.301460 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ccdfe0-12f3-4881-b98c-113ad484fe8b admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:53.306380 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-49ccdfe0-12f3-4881-b98c-113ad484fe8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:53.315757 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-706be944-c573-4ab6-b7c9-fa4a4573bcb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8532dbb8ce04eae88161ff563fdbb77'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:53.323732 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 851/1680] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:33:52 2022] DELETE /identity/v3/users/b8532dbb8ce04eae88161ff563fdbb77 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:33:53.328482 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706be944-c573-4ab6-b7c9-fa4a4573bcb1 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:53.332245 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-706be944-c573-4ab6-b7c9-fa4a4573bcb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:53.353692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:33:53.476367 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ccdfe0-12f3-4881-b98c-113ad484fe8b admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:53.535698 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706be944-c573-4ab6-b7c9-fa4a4573bcb1 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:53.542708 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:33:53.544333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6101f-28d3-4cf5-bfd6-44c16af2d5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:53.546938 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6101f-28d3-4cf5-bfd6-44c16af2d5aa admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:53.546938 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6101f-28d3-4cf5-bfd6-44c16af2d5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:53.546938 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6101f-28d3-4cf5-bfd6-44c16af2d5aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:53.548595 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e6101f-28d3-4cf5-bfd6-44c16af2d5aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:53.550621 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e6101f-28d3-4cf5-bfd6-44c16af2d5aa admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:53.565358 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 852/1681] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:33:53.573020 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038871e-521b-4714-b91b-37d9a71fa970 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:53.579752 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038871e-521b-4714-b91b-37d9a71fa970 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:53.579752 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038871e-521b-4714-b91b-37d9a71fa970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:53.632685 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b415d-b6a7-4d1a-a93e-99c680a7ecf3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:53.633429 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b415d-b6a7-4d1a-a93e-99c680a7ecf3 service nova] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:53.633700 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b415d-b6a7-4d1a-a93e-99c680a7ecf3 service nova] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:53.633976 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b415d-b6a7-4d1a-a93e-99c680a7ecf3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:53.640527 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-275b415d-b6a7-4d1a-a93e-99c680a7ecf3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:53.647059 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-8038871e-521b-4714-b91b-37d9a71fa970 None None] MFA Rules not processed for user `42b8bcddb4a24befbad0a5f4ac7ad925`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:53.648453 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-8038871e-521b-4714-b91b-37d9a71fa970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:53.754518 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b415d-b6a7-4d1a-a93e-99c680a7ecf3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:53.756370 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b415d-b6a7-4d1a-a93e-99c680a7ecf3 service nova] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:53.772088 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 830/1682] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:33:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:33:53.773372 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b415d-b6a7-4d1a-a93e-99c680a7ecf3 service nova] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:53.808619 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b415d-b6a7-4d1a-a93e-99c680a7ecf3 service nova] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:53.814602 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42711e35-13d7-4da7-8d4f-ff52fa69966e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:53.815540 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42711e35-13d7-4da7-8d4f-ff52fa69966e admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:53.815833 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42711e35-13d7-4da7-8d4f-ff52fa69966e admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:53.816824 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42711e35-13d7-4da7-8d4f-ff52fa69966e admin admin] PATH_INFO: `/v3/projects/d72078bfc5be4aee803b12781f4eb728/users/4b993cba59d94d72b4f5635dc8fe6755/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:53.825193 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 853/1683] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:53.826756 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038871e-521b-4714-b91b-37d9a71fa970 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:53.831243 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-8038871e-521b-4714-b91b-37d9a71fa970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:53.837009 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42711e35-13d7-4da7-8d4f-ff52fa69966e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d72078bfc5be4aee803b12781f4eb728, user_id=4b993cba59d94d72b4f5635dc8fe6755, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:53.839981 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42711e35-13d7-4da7-8d4f-ff52fa69966e admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:53.854908 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038871e-521b-4714-b91b-37d9a71fa970 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:53.866561 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2187f8-43ec-42ab-8671-bc0d6f7c5f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:53.867501 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2187f8-43ec-42ab-8671-bc0d6f7c5f8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:53.869236 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2187f8-43ec-42ab-8671-bc0d6f7c5f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:53.869532 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2187f8-43ec-42ab-8671-bc0d6f7c5f8e admin admin] PATH_INFO: `/v3/users/571a30965f74451487dcf47d2d3e5735` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:53.870942 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2187f8-43ec-42ab-8671-bc0d6f7c5f8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=571a30965f74451487dcf47d2d3e5735)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:53.873337 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2187f8-43ec-42ab-8671-bc0d6f7c5f8e admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:53.968171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 831/1684] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:33:53 2022] PUT /identity/v3/projects/d72078bfc5be4aee803b12781f4eb728/users/4b993cba59d94d72b4f5635dc8fe6755/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:33:53.970249 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdba83a-3328-4fba-8165-a421cf8adb6a None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:53.971802 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdba83a-3328-4fba-8165-a421cf8adb6a None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:53.972354 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdba83a-3328-4fba-8165-a421cf8adb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:54.026991 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-1bdba83a-3328-4fba-8165-a421cf8adb6a None None] MFA Rules not processed for user `d9f276efb89f4e869e7c58b2c492a0f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:54.028992 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-1bdba83a-3328-4fba-8165-a421cf8adb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:54.054493 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:33:54.158904 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-1a2187f8-43ec-42ab-8671-bc0d6f7c5f8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '571a30965f74451487dcf47d2d3e5735'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:54.180291 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 832/1685] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:54.181864 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdba83a-3328-4fba-8165-a421cf8adb6a None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:54.183972 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-1bdba83a-3328-4fba-8165-a421cf8adb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:54.241706 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-1a2187f8-43ec-42ab-8671-bc0d6f7c5f8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '571a30965f74451487dcf47d2d3e5735'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:54.242530 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-1a2187f8-43ec-42ab-8671-bc0d6f7c5f8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '571a30965f74451487dcf47d2d3e5735'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:54.255886 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-1a2187f8-43ec-42ab-8671-bc0d6f7c5f8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '571a30965f74451487dcf47d2d3e5735'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:54.298048 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-1a2187f8-43ec-42ab-8671-bc0d6f7c5f8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '571a30965f74451487dcf47d2d3e5735'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:54.315333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 854/1686] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:33:53 2022] DELETE /identity/v3/users/571a30965f74451487dcf47d2d3e5735 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:33:54.318252 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292363f0-b7f3-4fdb-9ed5-dfd8e6121f08 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:54.318642 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292363f0-b7f3-4fdb-9ed5-dfd8e6121f08 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:54.318933 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292363f0-b7f3-4fdb-9ed5-dfd8e6121f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:54.386291 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-292363f0-b7f3-4fdb-9ed5-dfd8e6121f08 None None] MFA Rules not processed for user `466eac612e9c44c994d3007f4583c4c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:54.389475 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-292363f0-b7f3-4fdb-9ed5-dfd8e6121f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:54.417968 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdba83a-3328-4fba-8165-a421cf8adb6a None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:54.543898 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 855/1687] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:54 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:54.543898 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5ea02-21d2-4ddd-81d0-310990ac9e5a None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:54.547164 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5ea02-21d2-4ddd-81d0-310990ac9e5a None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:54.547550 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5ea02-21d2-4ddd-81d0-310990ac9e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:54.604454 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-a1e5ea02-21d2-4ddd-81d0-310990ac9e5a None None] MFA Rules not processed for user `4b993cba59d94d72b4f5635dc8fe6755`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:54.605641 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-a1e5ea02-21d2-4ddd-81d0-310990ac9e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:54.607820 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028cfc95-3d57-47e6-89aa-1c095ef0271a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:54.608888 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028cfc95-3d57-47e6-89aa-1c095ef0271a service nova] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:54.609378 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028cfc95-3d57-47e6-89aa-1c095ef0271a service nova] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:54.609849 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028cfc95-3d57-47e6-89aa-1c095ef0271a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:54.612177 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-028cfc95-3d57-47e6-89aa-1c095ef0271a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:54.697781 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:33:54.730655 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 856/1688] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:54.732706 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53893a27-1ac4-4cb5-bacb-6555b70afdc5 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:54.733117 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53893a27-1ac4-4cb5-bacb-6555b70afdc5 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:54.734546 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53893a27-1ac4-4cb5-bacb-6555b70afdc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:54.737381 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028cfc95-3d57-47e6-89aa-1c095ef0271a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:54.742448 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028cfc95-3d57-47e6-89aa-1c095ef0271a service nova] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:54.751684 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 833/1689] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:33:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:33:54.754230 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5361fb-3c26-403b-961d-ca450a30de15 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:54.754538 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5361fb-3c26-403b-961d-ca450a30de15 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:54.754825 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5361fb-3c26-403b-961d-ca450a30de15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:54.787605 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-53893a27-1ac4-4cb5-bacb-6555b70afdc5 None None] MFA Rules not processed for user `d9f276efb89f4e869e7c58b2c492a0f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:54.789393 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-53893a27-1ac4-4cb5-bacb-6555b70afdc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:54.796671 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-ba5361fb-3c26-403b-961d-ca450a30de15 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:54.801488 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-ba5361fb-3c26-403b-961d-ca450a30de15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:54.876548 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 857/1690] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:54.876548 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53893a27-1ac4-4cb5-bacb-6555b70afdc5 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:54.876548 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-53893a27-1ac4-4cb5-bacb-6555b70afdc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:54.990159 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 834/1691] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:54.999641 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa46c0-4c7e-452b-99a7-60053a19309c None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:55.001703 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa46c0-4c7e-452b-99a7-60053a19309c None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:55.001703 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa46c0-4c7e-452b-99a7-60053a19309c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:55.006097 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:33:55.023592 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53893a27-1ac4-4cb5-bacb-6555b70afdc5 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:55.029228 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b678166e-f35a-4115-9323-4893b3191576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:55.030336 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678166e-f35a-4115-9323-4893b3191576 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:55.030724 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678166e-f35a-4115-9323-4893b3191576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:55.031129 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678166e-f35a-4115-9323-4893b3191576 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:55.032217 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b678166e-f35a-4115-9323-4893b3191576 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:55.034262 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b678166e-f35a-4115-9323-4893b3191576 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:55.068832 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-1ffa46c0-4c7e-452b-99a7-60053a19309c None None] MFA Rules not processed for user `445eaa80c49d4b77abe929421fa65d01`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:55.070104 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-1ffa46c0-4c7e-452b-99a7-60053a19309c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:55.185595 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 858/1692] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:33:54 2022] POST /identity/v3/projects => generated 403 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:33:55.185595 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b678166e-f35a-4115-9323-4893b3191576 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:55.192783 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-b678166e-f35a-4115-9323-4893b3191576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:55.221181 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 835/1693] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:55.222310 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa46c0-4c7e-452b-99a7-60053a19309c None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:55.223946 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-1ffa46c0-4c7e-452b-99a7-60053a19309c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:55.244878 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa46c0-4c7e-452b-99a7-60053a19309c None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:55.314586 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b678166e-f35a-4115-9323-4893b3191576 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:55.329274 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e17860f-abb2-4bcc-99cc-9cfdfb287594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:55.330173 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e17860f-abb2-4bcc-99cc-9cfdfb287594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:55.330460 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e17860f-abb2-4bcc-99cc-9cfdfb287594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:55.331040 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e17860f-abb2-4bcc-99cc-9cfdfb287594 admin admin] PATH_INFO: `/v3/projects/ebdd0a48fe364e98a224c2321c20153e` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:55.334750 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e17860f-abb2-4bcc-99cc-9cfdfb287594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebdd0a48fe364e98a224c2321c20153e)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:55.341072 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e17860f-abb2-4bcc-99cc-9cfdfb287594 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:55.416131 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5f096-7ec3-4556-988d-8c8a2e042ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:55.417012 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5f096-7ec3-4556-988d-8c8a2e042ab0 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:55.417399 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5f096-7ec3-4556-988d-8c8a2e042ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:55.417578 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5f096-7ec3-4556-988d-8c8a2e042ab0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:55.418342 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5f096-7ec3-4556-988d-8c8a2e042ab0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:55.437327 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5f096-7ec3-4556-988d-8c8a2e042ab0 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:55.536788 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-3e17860f-abb2-4bcc-99cc-9cfdfb287594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebdd0a48fe364e98a224c2321c20153e', 'request_id': 'req-3e17860f-abb2-4bcc-99cc-9cfdfb287594'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:55.549029 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-3e17860f-abb2-4bcc-99cc-9cfdfb287594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebdd0a48fe364e98a224c2321c20153e', 'request_id': 'req-3e17860f-abb2-4bcc-99cc-9cfdfb287594'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:55.562265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:33:55.576657 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 836/1694] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:33:55 2022] POST /identity/v3/projects => generated 375 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:33:55.576657 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5f096-7ec3-4556-988d-8c8a2e042ab0 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:55.577488 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-f1a5f096-7ec3-4556-988d-8c8a2e042ab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:55.642385 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-3e17860f-abb2-4bcc-99cc-9cfdfb287594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebdd0a48fe364e98a224c2321c20153e', 'request_id': 'req-3e17860f-abb2-4bcc-99cc-9cfdfb287594'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:55.661020 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-3e17860f-abb2-4bcc-99cc-9cfdfb287594 admin admin] The token cache is being invalidate because project ebdd0a48fe364e98a224c2321c20153e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:33:55.661329 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-3e17860f-abb2-4bcc-99cc-9cfdfb287594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:55.662481 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-3e17860f-abb2-4bcc-99cc-9cfdfb287594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:55.670813 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 859/1695] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:33:55 2022] DELETE /identity/v3/projects/ebdd0a48fe364e98a224c2321c20153e => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:33:55.680821 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e17860f-abb2-4bcc-99cc-9cfdfb287594 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:55.690453 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3e17860f-abb2-4bcc-99cc-9cfdfb287594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:55.785241 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5f096-7ec3-4556-988d-8c8a2e042ab0 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:55.801737 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd07824a-1fbe-4bce-818d-eeecde0f6500 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:55.802346 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07824a-1fbe-4bce-818d-eeecde0f6500 service nova] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:55.802639 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07824a-1fbe-4bce-818d-eeecde0f6500 service nova] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:55.802922 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07824a-1fbe-4bce-818d-eeecde0f6500 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:55.813877 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-fd07824a-1fbe-4bce-818d-eeecde0f6500 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:55.856651 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e17860f-abb2-4bcc-99cc-9cfdfb287594 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:55.941837 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199937a-515b-4c60-994f-3b8232301bbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:55.942665 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199937a-515b-4c60-994f-3b8232301bbb service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:55.943666 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199937a-515b-4c60-994f-3b8232301bbb service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:55.948706 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199937a-515b-4c60-994f-3b8232301bbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:55.948706 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-c199937a-515b-4c60-994f-3b8232301bbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:55.978763 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd07824a-1fbe-4bce-818d-eeecde0f6500 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:55.983744 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd07824a-1fbe-4bce-818d-eeecde0f6500 service nova] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:56.007497 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 837/1696] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:33:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:33:56.007497 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd07824a-1fbe-4bce-818d-eeecde0f6500 service nova] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:56.014555 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-fd07824a-1fbe-4bce-818d-eeecde0f6500 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:56.137303 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c199937a-515b-4c60-994f-3b8232301bbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:56.138779 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c199937a-515b-4c60-994f-3b8232301bbb service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:56.161205 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 860/1697] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:33:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:33:56.165410 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04b108-b4e9-468f-9f74-6d96ad767b22 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:56.167275 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04b108-b4e9-468f-9f74-6d96ad767b22 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:56.167756 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04b108-b4e9-468f-9f74-6d96ad767b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:56.230700 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd07824a-1fbe-4bce-818d-eeecde0f6500 service nova] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:56.237725 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-ee04b108-b4e9-468f-9f74-6d96ad767b22 None None] MFA Rules not processed for user `445eaa80c49d4b77abe929421fa65d01`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:56.241929 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ee04b108-b4e9-468f-9f74-6d96ad767b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:56.259040 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360664a7-fb41-4935-bd67-fce9b99f3dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:56.259040 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360664a7-fb41-4935-bd67-fce9b99f3dac admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:56.259040 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360664a7-fb41-4935-bd67-fce9b99f3dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:56.259040 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360664a7-fb41-4935-bd67-fce9b99f3dac admin admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:56.263558 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360664a7-fb41-4935-bd67-fce9b99f3dac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:56.273273 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360664a7-fb41-4935-bd67-fce9b99f3dac admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:56.367204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 861/1698] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:56.368452 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04b108-b4e9-468f-9f74-6d96ad767b22 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:56.370222 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ee04b108-b4e9-468f-9f74-6d96ad767b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:56.395606 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04b108-b4e9-468f-9f74-6d96ad767b22 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:56.402369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 838/1699] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:33:56 2022] POST /identity/v3/users => generated 308 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:33:56.402369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc355f4-6df3-4410-bcb1-5a7ecb0bf3b2 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:56.402369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc355f4-6df3-4410-bcb1-5a7ecb0bf3b2 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:56.402369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc355f4-6df3-4410-bcb1-5a7ecb0bf3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:56.430500 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae8898-e9b4-452b-8439-c216088bd681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:56.431213 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae8898-e9b4-452b-8439-c216088bd681 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:56.431525 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae8898-e9b4-452b-8439-c216088bd681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:56.431805 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae8898-e9b4-452b-8439-c216088bd681 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:56.440735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae8898-e9b4-452b-8439-c216088bd681 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:56.448618 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae8898-e9b4-452b-8439-c216088bd681 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:56.468355 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-cdc355f4-6df3-4410-bcb1-5a7ecb0bf3b2 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:56.469614 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-cdc355f4-6df3-4410-bcb1-5a7ecb0bf3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:56.485165 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:33:56.498806 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 839/1700] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:56.500141 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc355f4-6df3-4410-bcb1-5a7ecb0bf3b2 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:56.512273 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-cdc355f4-6df3-4410-bcb1-5a7ecb0bf3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:56.545553 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc355f4-6df3-4410-bcb1-5a7ecb0bf3b2 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:56.560019 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03806005-6b4d-4e8a-b824-ec9eb7e0f2ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:56.560019 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03806005-6b4d-4e8a-b824-ec9eb7e0f2ae service nova] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:56.560019 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03806005-6b4d-4e8a-b824-ec9eb7e0f2ae service nova] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:56.560019 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03806005-6b4d-4e8a-b824-ec9eb7e0f2ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:56.561558 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-03806005-6b4d-4e8a-b824-ec9eb7e0f2ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:56.576896 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03806005-6b4d-4e8a-b824-ec9eb7e0f2ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:56.578871 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03806005-6b4d-4e8a-b824-ec9eb7e0f2ae service nova] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:56.598182 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 862/1701] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:33:56 2022] POST /identity/v3/users => generated 294 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:33:56.598380 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 840/1702] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:33:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:33:56.598654 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c7358-ae4a-4bed-8bc1-cc32871561e9 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:56.599073 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c7358-ae4a-4bed-8bc1-cc32871561e9 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:56.599543 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c7358-ae4a-4bed-8bc1-cc32871561e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:56.606002 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae8898-e9b4-452b-8439-c216088bd681 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:56.621394 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:33:56.642504 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae8898-e9b4-452b-8439-c216088bd681 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:56.651749 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-aa5c7358-ae4a-4bed-8bc1-cc32871561e9 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:56.653315 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-aa5c7358-ae4a-4bed-8bc1-cc32871561e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:56.660727 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add59668-2152-490c-abc3-56a4fb337725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:56.661095 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add59668-2152-490c-abc3-56a4fb337725 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:56.661418 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add59668-2152-490c-abc3-56a4fb337725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:56.661699 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add59668-2152-490c-abc3-56a4fb337725 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:56.662631 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add59668-2152-490c-abc3-56a4fb337725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:56.664279 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add59668-2152-490c-abc3-56a4fb337725 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:56.677869 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 841/1703] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:56.680407 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c7358-ae4a-4bed-8bc1-cc32871561e9 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:56.704132 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 863/1704] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:33:56.705463 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add59668-2152-490c-abc3-56a4fb337725 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:56.710096 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c7358-ae4a-4bed-8bc1-cc32871561e9 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:56.733145 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89a758-f2fa-440e-9843-2cb8f9288439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:56.733849 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89a758-f2fa-440e-9843-2cb8f9288439 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:56.734109 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89a758-f2fa-440e-9843-2cb8f9288439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:56.734381 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89a758-f2fa-440e-9843-2cb8f9288439 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:56.735111 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd89a758-f2fa-440e-9843-2cb8f9288439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:56.736747 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd89a758-f2fa-440e-9843-2cb8f9288439 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:56.741772 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add59668-2152-490c-abc3-56a4fb337725 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:56.755160 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b3711-8915-4ff2-8b4a-3fa5d6c27e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:56.756425 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b3711-8915-4ff2-8b4a-3fa5d6c27e5d admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:56.756866 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b3711-8915-4ff2-8b4a-3fa5d6c27e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:56.757130 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 842/1705] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:33:56.757434 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b3711-8915-4ff2-8b4a-3fa5d6c27e5d admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:56.758015 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89a758-f2fa-440e-9843-2cb8f9288439 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:56.758764 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0b3711-8915-4ff2-8b4a-3fa5d6c27e5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:33:56.759241 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0b3711-8915-4ff2-8b4a-3fa5d6c27e5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:56.761104 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0b3711-8915-4ff2-8b4a-3fa5d6c27e5d admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:56.767479 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:33:56.778711 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89a758-f2fa-440e-9843-2cb8f9288439 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:56.791555 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4208f-49ea-454a-bc90-3633cc2b37a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:56.792472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4208f-49ea-454a-bc90-3633cc2b37a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:56.794246 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4208f-49ea-454a-bc90-3633cc2b37a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:56.794246 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4208f-49ea-454a-bc90-3633cc2b37a2 admin admin] PATH_INFO: `/v3/projects/a11ae42df9ef487a9558e26dfcfa4190/users/77472ae05a004b89a9f7b0b4b352dd46/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:56.803408 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 864/1706] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:33:56.806166 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b3711-8915-4ff2-8b4a-3fa5d6c27e5d admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:56.820453 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f4208f-49ea-454a-bc90-3633cc2b37a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a11ae42df9ef487a9558e26dfcfa4190, user_id=77472ae05a004b89a9f7b0b4b352dd46, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:56.824701 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f4208f-49ea-454a-bc90-3633cc2b37a2 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:56.827952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b3711-8915-4ff2-8b4a-3fa5d6c27e5d admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:56.844055 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1744c8-6a19-40a7-b5c5-df13824afbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:56.844055 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1744c8-6a19-40a7-b5c5-df13824afbfb admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:56.844055 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1744c8-6a19-40a7-b5c5-df13824afbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:56.844055 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1744c8-6a19-40a7-b5c5-df13824afbfb admin admin] PATH_INFO: `/v3/projects/4312cd67c3be4fcc9ec5f217234fb9c4/users/a568112cc43440ae81c162a601539354/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:56.872296 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1744c8-6a19-40a7-b5c5-df13824afbfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4312cd67c3be4fcc9ec5f217234fb9c4, user_id=a568112cc43440ae81c162a601539354, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:56.875622 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1744c8-6a19-40a7-b5c5-df13824afbfb admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:56.905113 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 843/1707] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:33:56 2022] PUT /identity/v3/projects/a11ae42df9ef487a9558e26dfcfa4190/users/77472ae05a004b89a9f7b0b4b352dd46/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:33:56.906744 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4208f-49ea-454a-bc90-3633cc2b37a2 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:56.975013 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 865/1708] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:33:56 2022] PUT /identity/v3/projects/4312cd67c3be4fcc9ec5f217234fb9c4/users/a568112cc43440ae81c162a601539354/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:33:56.976431 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1744c8-6a19-40a7-b5c5-df13824afbfb admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:57.074280 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4208f-49ea-454a-bc90-3633cc2b37a2 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:57.113203 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1744c8-6a19-40a7-b5c5-df13824afbfb admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:57.119387 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17199f60-1b45-4702-99a7-8352051266d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:57.120110 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17199f60-1b45-4702-99a7-8352051266d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:57.120397 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17199f60-1b45-4702-99a7-8352051266d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:57.120675 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17199f60-1b45-4702-99a7-8352051266d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:57.122460 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17199f60-1b45-4702-99a7-8352051266d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:57.124170 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17199f60-1b45-4702-99a7-8352051266d3 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:57.149273 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 866/1709] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:33:57.149273 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17199f60-1b45-4702-99a7-8352051266d3 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:57.172220 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f191c876-f100-4d1f-b2a5-8e0012396637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:57.174032 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191c876-f100-4d1f-b2a5-8e0012396637 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:57.175607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191c876-f100-4d1f-b2a5-8e0012396637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:57.177191 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191c876-f100-4d1f-b2a5-8e0012396637 admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:57.180043 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f191c876-f100-4d1f-b2a5-8e0012396637 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:57.181418 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17199f60-1b45-4702-99a7-8352051266d3 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:57.188583 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f191c876-f100-4d1f-b2a5-8e0012396637 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:57.200270 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0e80c-a5fa-4d64-b31c-7c2707eb7626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:57.202472 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0e80c-a5fa-4d64-b31c-7c2707eb7626 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:57.202827 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0e80c-a5fa-4d64-b31c-7c2707eb7626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:57.205338 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0e80c-a5fa-4d64-b31c-7c2707eb7626 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:57.207748 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0e80c-a5fa-4d64-b31c-7c2707eb7626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:57.220159 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0e80c-a5fa-4d64-b31c-7c2707eb7626 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:57.249135 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 867/1710] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:33:57.251543 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ba6ed-15af-4023-8aba-22194a6279cd None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:57.252120 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ba6ed-15af-4023-8aba-22194a6279cd None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:57.252412 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ba6ed-15af-4023-8aba-22194a6279cd None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:57.253956 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 868/1711] 10.222.0.60 () {54 vars in 912 bytes} [Thu Jul 21 19:33:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:33:57.254772 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ba6ed-15af-4023-8aba-22194a6279cd None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:57.274259 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ba6ed-15af-4023-8aba-22194a6279cd None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:57.288603 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6c28b-9532-4f3f-be3e-49752473d0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:57.290808 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6c28b-9532-4f3f-be3e-49752473d0dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:57.292145 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6c28b-9532-4f3f-be3e-49752473d0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:57.292543 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6c28b-9532-4f3f-be3e-49752473d0dc admin admin] PATH_INFO: `/v3/projects/a11ae42df9ef487a9558e26dfcfa4190/users/77472ae05a004b89a9f7b0b4b352dd46/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:57.303688 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa6c28b-9532-4f3f-be3e-49752473d0dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a11ae42df9ef487a9558e26dfcfa4190, user_id=77472ae05a004b89a9f7b0b4b352dd46, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:57.314237 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa6c28b-9532-4f3f-be3e-49752473d0dc admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:57.355366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 869/1712] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:33:57 2022] PUT /identity/v3/projects/a11ae42df9ef487a9558e26dfcfa4190/users/77472ae05a004b89a9f7b0b4b352dd46/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:33:57.355366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6c28b-9532-4f3f-be3e-49752473d0dc admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:57.384848 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 844/1713] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:33:56 2022] POST /identity/v3/projects => generated 365 bytes in 479 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:33:57.388100 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5abe86-bc83-4ada-8509-c597f0a9e60b None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:57.393471 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5abe86-bc83-4ada-8509-c597f0a9e60b None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:57.393844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5abe86-bc83-4ada-8509-c597f0a9e60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:57.490756 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-ff5abe86-bc83-4ada-8509-c597f0a9e60b None None] MFA Rules not processed for user `b1908b2f87d5442da8ba826489cb2018`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:57.492902 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-ff5abe86-bc83-4ada-8509-c597f0a9e60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:57.533856 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6c28b-9532-4f3f-be3e-49752473d0dc admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:57.615812 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:33:57.620848 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 845/1714] 10.222.0.60 () {58 vars in 1009 bytes} [Thu Jul 21 19:33:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:57.621716 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5abe86-bc83-4ada-8509-c597f0a9e60b None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:57.644457 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05db40-00cd-4d90-8ba0-61e12f467823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:57.645382 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05db40-00cd-4d90-8ba0-61e12f467823 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:57.645677 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05db40-00cd-4d90-8ba0-61e12f467823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:57.646132 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05db40-00cd-4d90-8ba0-61e12f467823 admin admin] PATH_INFO: `/v3/projects/4312cd67c3be4fcc9ec5f217234fb9c4/users/a568112cc43440ae81c162a601539354/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:57.648356 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b05db40-00cd-4d90-8ba0-61e12f467823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4312cd67c3be4fcc9ec5f217234fb9c4, user_id=a568112cc43440ae81c162a601539354, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:57.651660 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b05db40-00cd-4d90-8ba0-61e12f467823 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:57.675337 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 870/1715] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:33:57 2022] PUT /identity/v3/projects/4312cd67c3be4fcc9ec5f217234fb9c4/users/a568112cc43440ae81c162a601539354/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:33:57.678195 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2189cd7-2449-4219-8787-769967a28870 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:57.678498 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2189cd7-2449-4219-8787-769967a28870 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:57.680949 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2189cd7-2449-4219-8787-769967a28870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:57.749920 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-d2189cd7-2449-4219-8787-769967a28870 None None] MFA Rules not processed for user `a568112cc43440ae81c162a601539354`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:57.751694 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-d2189cd7-2449-4219-8787-769967a28870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:57.808577 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5abe86-bc83-4ada-8509-c597f0a9e60b None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:57.884175 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 871/1716] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:57 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:57.884175 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968db5ad-8b5e-4271-9a25-089582bec9d8 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:57.884175 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968db5ad-8b5e-4271-9a25-089582bec9d8 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:57.884175 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968db5ad-8b5e-4271-9a25-089582bec9d8 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:57.890108 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 872/1717] 10.222.0.60 () {54 vars in 912 bytes} [Thu Jul 21 19:33:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:33:57.891943 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc1a7c-0f42-40c7-881d-c4ac1c05d69d None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:57.892360 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc1a7c-0f42-40c7-881d-c4ac1c05d69d None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:57.892763 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc1a7c-0f42-40c7-881d-c4ac1c05d69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:57.934396 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-76dc1a7c-0f42-40c7-881d-c4ac1c05d69d None None] MFA Rules not processed for user `b1908b2f87d5442da8ba826489cb2018`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:57.938418 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-76dc1a7c-0f42-40c7-881d-c4ac1c05d69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:57.952111 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31621685-5903-4704-8db4-1c6513e44081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:57.953954 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31621685-5903-4704-8db4-1c6513e44081 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:57.954614 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31621685-5903-4704-8db4-1c6513e44081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:57.956582 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31621685-5903-4704-8db4-1c6513e44081 admin admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:57.957445 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31621685-5903-4704-8db4-1c6513e44081 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:57.960218 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31621685-5903-4704-8db4-1c6513e44081 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:58.047200 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 873/1718] 10.222.0.60 () {58 vars in 1009 bytes} [Thu Jul 21 19:33:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:58.048963 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc1a7c-0f42-40c7-881d-c4ac1c05d69d None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:58.050877 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-76dc1a7c-0f42-40c7-881d-c4ac1c05d69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:58.097195 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 846/1719] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:33:57 2022] POST /identity/v3/users => generated 283 bytes in 476 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:33:58.098219 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31621685-5903-4704-8db4-1c6513e44081 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:58.121152 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31621685-5903-4704-8db4-1c6513e44081 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:58.131041 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06600935-15dc-4073-9c88-98d422928d75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:58.132662 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06600935-15dc-4073-9c88-98d422928d75 service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:58.134583 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06600935-15dc-4073-9c88-98d422928d75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:58.137039 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06600935-15dc-4073-9c88-98d422928d75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:58.160837 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06600935-15dc-4073-9c88-98d422928d75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:58.163533 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06600935-15dc-4073-9c88-98d422928d75 service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:58.185980 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 847/1720] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:33:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:33:58.188235 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06600935-15dc-4073-9c88-98d422928d75 service neutron] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:58.194031 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-06600935-15dc-4073-9c88-98d422928d75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:58.208615 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc1a7c-0f42-40c7-881d-c4ac1c05d69d None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:58.219250 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e8126-db1b-467b-91ea-461886fc29c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:58.220122 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e8126-db1b-467b-91ea-461886fc29c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:58.220586 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e8126-db1b-467b-91ea-461886fc29c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:58.220978 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e8126-db1b-467b-91ea-461886fc29c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:58.227789 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-399e8126-db1b-467b-91ea-461886fc29c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:58.234380 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06600935-15dc-4073-9c88-98d422928d75 service neutron] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:58.246057 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a3006-7ad5-4458-9f1a-81b59b6032e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:58.246893 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a3006-7ad5-4458-9f1a-81b59b6032e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:58.247324 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a3006-7ad5-4458-9f1a-81b59b6032e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:58.247868 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a3006-7ad5-4458-9f1a-81b59b6032e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:58.269175 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436a3006-7ad5-4458-9f1a-81b59b6032e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:58.270834 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436a3006-7ad5-4458-9f1a-81b59b6032e6 service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:58.294547 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 848/1721] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:33:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:33:58.296172 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a3006-7ad5-4458-9f1a-81b59b6032e6 service neutron] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:58.298491 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-436a3006-7ad5-4458-9f1a-81b59b6032e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:58.338955 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a3006-7ad5-4458-9f1a-81b59b6032e6 service neutron] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:58.348604 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dd2a86-e242-47ae-a59e-74bffa41a173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:58.350259 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd2a86-e242-47ae-a59e-74bffa41a173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:58.350690 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd2a86-e242-47ae-a59e-74bffa41a173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:58.351309 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd2a86-e242-47ae-a59e-74bffa41a173 admin admin] PATH_INFO: `/v3/projects/59b409361a4e4261b1225a6be521ac58` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:58.353130 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dd2a86-e242-47ae-a59e-74bffa41a173 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59b409361a4e4261b1225a6be521ac58)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:58.358300 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dd2a86-e242-47ae-a59e-74bffa41a173 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:58.371010 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399e8126-db1b-467b-91ea-461886fc29c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:58.377837 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399e8126-db1b-467b-91ea-461886fc29c8 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:58.388759 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:33:58.401537 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 874/1722] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:33:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:33:58.415094 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e8126-db1b-467b-91ea-461886fc29c8 service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:58.459395 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e8126-db1b-467b-91ea-461886fc29c8 service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:58.469102 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bead76-cb3a-4e28-8a94-0b1c38eb18a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:58.469102 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bead76-cb3a-4e28-8a94-0b1c38eb18a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:58.469102 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bead76-cb3a-4e28-8a94-0b1c38eb18a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:58.470422 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bead76-cb3a-4e28-8a94-0b1c38eb18a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:58.473180 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bead76-cb3a-4e28-8a94-0b1c38eb18a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:58.476730 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bead76-cb3a-4e28-8a94-0b1c38eb18a7 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:58.496077 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 875/1723] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:33:58.498138 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bead76-cb3a-4e28-8a94-0b1c38eb18a7 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:58.510619 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bead76-cb3a-4e28-8a94-0b1c38eb18a7 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:58.522618 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c356cf0-f5f9-4377-91d9-208a9e61485c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:58.525613 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c356cf0-f5f9-4377-91d9-208a9e61485c admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:58.525945 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c356cf0-f5f9-4377-91d9-208a9e61485c admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:58.527606 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c356cf0-f5f9-4377-91d9-208a9e61485c admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:58.530700 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c356cf0-f5f9-4377-91d9-208a9e61485c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:58.532376 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c356cf0-f5f9-4377-91d9-208a9e61485c admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:58.565183 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 876/1724] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:33:58.567881 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c356cf0-f5f9-4377-91d9-208a9e61485c admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:58.592387 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c356cf0-f5f9-4377-91d9-208a9e61485c admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:58.629276 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a091f3d-eff4-41ae-a3d1-2debaefa0287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:58.636508 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a091f3d-eff4-41ae-a3d1-2debaefa0287 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:58.636508 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a091f3d-eff4-41ae-a3d1-2debaefa0287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:58.639785 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a091f3d-eff4-41ae-a3d1-2debaefa0287 admin admin] PATH_INFO: `/v3/projects/b24e39a032ba47edb7e28628810c6509/users/20a7ae17424046b192982a57fa271961/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:58.665030 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-f7dd2a86-e242-47ae-a59e-74bffa41a173 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59b409361a4e4261b1225a6be521ac58', 'request_id': 'req-f7dd2a86-e242-47ae-a59e-74bffa41a173'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:58.689005 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a091f3d-eff4-41ae-a3d1-2debaefa0287 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b24e39a032ba47edb7e28628810c6509, user_id=20a7ae17424046b192982a57fa271961, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:58.694050 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a091f3d-eff4-41ae-a3d1-2debaefa0287 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:58.758990 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-f7dd2a86-e242-47ae-a59e-74bffa41a173 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59b409361a4e4261b1225a6be521ac58', 'request_id': 'req-f7dd2a86-e242-47ae-a59e-74bffa41a173'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:58.792339 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-f7dd2a86-e242-47ae-a59e-74bffa41a173 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59b409361a4e4261b1225a6be521ac58', 'request_id': 'req-f7dd2a86-e242-47ae-a59e-74bffa41a173'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:58.825989 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:33:58.861334 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-f7dd2a86-e242-47ae-a59e-74bffa41a173 admin admin] The token cache is being invalidate because project 59b409361a4e4261b1225a6be521ac58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:33:58.863545 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-f7dd2a86-e242-47ae-a59e-74bffa41a173 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:58.865621 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-f7dd2a86-e242-47ae-a59e-74bffa41a173 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:33:58.872928 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 849/1725] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:33:58 2022] DELETE /identity/v3/projects/59b409361a4e4261b1225a6be521ac58 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:33:58.876677 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fc2c6-97c2-455b-89dd-fa937bf27445 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:58.877489 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fc2c6-97c2-455b-89dd-fa937bf27445 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:58.877605 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fc2c6-97c2-455b-89dd-fa937bf27445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:58.881084 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 877/1726] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:33:58 2022] PUT /identity/v3/projects/b24e39a032ba47edb7e28628810c6509/users/20a7ae17424046b192982a57fa271961/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:33:58.905316 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075b4da-fef1-41b6-b7e2-f68db2436b87 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:58.905608 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075b4da-fef1-41b6-b7e2-f68db2436b87 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:58.905954 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075b4da-fef1-41b6-b7e2-f68db2436b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:58.916187 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-ca5fc2c6-97c2-455b-89dd-fa937bf27445 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:58.920583 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-ca5fc2c6-97c2-455b-89dd-fa937bf27445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:59.002548 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-1075b4da-fef1-41b6-b7e2-f68db2436b87 None None] MFA Rules not processed for user `20a7ae17424046b192982a57fa271961`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:59.009784 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-1075b4da-fef1-41b6-b7e2-f68db2436b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:59.129686 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 850/1727] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:33:59.141219 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56c5d6-e140-4caf-bbf9-2ddf0f6afaca None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:59.142383 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56c5d6-e140-4caf-bbf9-2ddf0f6afaca None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:59.143398 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56c5d6-e140-4caf-bbf9-2ddf0f6afaca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:59.176671 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-5f56c5d6-e140-4caf-bbf9-2ddf0f6afaca None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:59.178556 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-5f56c5d6-e140-4caf-bbf9-2ddf0f6afaca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:59.191127 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 851/1728] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:59.196940 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56c5d6-e140-4caf-bbf9-2ddf0f6afaca None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:59.202295 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 878/1729] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:58 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:33:59.207632 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075b4da-fef1-41b6-b7e2-f68db2436b87 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:59.211178 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-1075b4da-fef1-41b6-b7e2-f68db2436b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:59.223397 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56c5d6-e140-4caf-bbf9-2ddf0f6afaca None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:59.244053 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075b4da-fef1-41b6-b7e2-f68db2436b87 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:59.245209 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2010c43f-dea9-4976-abb9-4c7abbf87a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:59.246190 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010c43f-dea9-4976-abb9-4c7abbf87a1c admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:59.247390 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010c43f-dea9-4976-abb9-4c7abbf87a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:59.248070 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010c43f-dea9-4976-abb9-4c7abbf87a1c admin admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:59.249427 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2010c43f-dea9-4976-abb9-4c7abbf87a1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:33:59.249991 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2010c43f-dea9-4976-abb9-4c7abbf87a1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:59.252233 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c452ce2-3614-40d4-8cf4-0ac247e4bf79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:59.252723 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2010c43f-dea9-4976-abb9-4c7abbf87a1c admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:59.252954 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c452ce2-3614-40d4-8cf4-0ac247e4bf79 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:59.253202 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c452ce2-3614-40d4-8cf4-0ac247e4bf79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:59.253541 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c452ce2-3614-40d4-8cf4-0ac247e4bf79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:59.254325 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c452ce2-3614-40d4-8cf4-0ac247e4bf79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:59.259042 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c452ce2-3614-40d4-8cf4-0ac247e4bf79 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:59.275484 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 852/1730] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:33:59.280144 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2010c43f-dea9-4976-abb9-4c7abbf87a1c admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:59.305723 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2010c43f-dea9-4976-abb9-4c7abbf87a1c admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:59.312054 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43926b-770b-4ee9-b6c0-268fb3410e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:59.314669 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43926b-770b-4ee9-b6c0-268fb3410e2f admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:59.315187 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43926b-770b-4ee9-b6c0-268fb3410e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:59.315725 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43926b-770b-4ee9-b6c0-268fb3410e2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:59.316728 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f43926b-770b-4ee9-b6c0-268fb3410e2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:59.323182 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f43926b-770b-4ee9-b6c0-268fb3410e2f admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:59.404541 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 879/1731] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:33:59 2022] POST /identity/v3/projects => generated 365 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 19:33:59.407176 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c452ce2-3614-40d4-8cf4-0ac247e4bf79 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:59.453633 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 853/1732] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:33:59 2022] POST /identity/v3/projects => generated 405 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:33:59.465161 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43926b-770b-4ee9-b6c0-268fb3410e2f admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:59.611181 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43926b-770b-4ee9-b6c0-268fb3410e2f admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:59.624232 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5cd34-b503-44ad-8f23-c8c60d59380e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:59.625024 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5cd34-b503-44ad-8f23-c8c60d59380e admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:59.629683 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5cd34-b503-44ad-8f23-c8c60d59380e admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:59.629683 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5cd34-b503-44ad-8f23-c8c60d59380e admin admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:59.631031 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5cd34-b503-44ad-8f23-c8c60d59380e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:59.649053 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5cd34-b503-44ad-8f23-c8c60d59380e admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:59.692893 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:33:59.740338 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c452ce2-3614-40d4-8cf4-0ac247e4bf79 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:59.752161 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34bb98c-fc39-4d07-8830-c3c5e28845d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:59.752861 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bb98c-fc39-4d07-8830-c3c5e28845d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:59.753151 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bb98c-fc39-4d07-8830-c3c5e28845d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:59.753908 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bb98c-fc39-4d07-8830-c3c5e28845d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:59.754197 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34bb98c-fc39-4d07-8830-c3c5e28845d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:59.766302 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34bb98c-fc39-4d07-8830-c3c5e28845d9 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:59.781338 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 854/1733] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:33:59 2022] POST /identity/v3/users => generated 303 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:33:59.781338 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc83ac-e768-4e2d-ae36-f356e537a192 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:59.781338 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc83ac-e768-4e2d-ae36-f356e537a192 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:59.782074 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc83ac-e768-4e2d-ae36-f356e537a192 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:59.783663 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 855/1734] 10.222.0.60 () {54 vars in 961 bytes} [Thu Jul 21 19:33:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:33:59.795137 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc83ac-e768-4e2d-ae36-f356e537a192 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:33:59.865557 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc83ac-e768-4e2d-ae36-f356e537a192 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:33:59.907309 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 880/1735] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:33:59 2022] POST /identity/v3/users => generated 289 bytes in 502 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:33:59.914023 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf06d4-b1a1-4d86-ad0b-82cb4afda2cf None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:59.917685 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf06d4-b1a1-4d86-ad0b-82cb4afda2cf None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:59.919325 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf06d4-b1a1-4d86-ad0b-82cb4afda2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:59.921563 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873dff18-f454-406c-a6f1-c80229036423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:33:59.923719 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873dff18-f454-406c-a6f1-c80229036423 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:59.924017 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873dff18-f454-406c-a6f1-c80229036423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:59.924304 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873dff18-f454-406c-a6f1-c80229036423 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:59.925056 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873dff18-f454-406c-a6f1-c80229036423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:33:59.937872 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873dff18-f454-406c-a6f1-c80229036423 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:33:59.964937 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 856/1736] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:33:59.968148 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb5cc4-35a2-4b00-a685-9622661b07c0 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:33:59.969176 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb5cc4-35a2-4b00-a685-9622661b07c0 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:33:59.969463 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb5cc4-35a2-4b00-a685-9622661b07c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:33:59.984281 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-19bf06d4-b1a1-4d86-ad0b-82cb4afda2cf None None] MFA Rules not processed for user `bcc5eefc2f7c419190e96b46b163fedd`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:59.986222 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-19bf06d4-b1a1-4d86-ad0b-82cb4afda2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:33:59.992690 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-37bb5cc4-35a2-4b00-a685-9622661b07c0 None None] MFA Rules not processed for user `d9f276efb89f4e869e7c58b2c492a0f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:33:59.993956 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-37bb5cc4-35a2-4b00-a685-9622661b07c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:00.140691 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 857/1737] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:33:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:00.142617 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffdeafb-e604-4595-bdda-4dac81d7c2cf None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:00.143059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffdeafb-e604-4595-bdda-4dac81d7c2cf None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:00.143984 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffdeafb-e604-4595-bdda-4dac81d7c2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:00.165572 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-1ffdeafb-e604-4595-bdda-4dac81d7c2cf None None] MFA Rules not processed for user `44076ea4ef504e6a957e84dcb83c5d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:00.167387 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-1ffdeafb-e604-4595-bdda-4dac81d7c2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:00.257776 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 858/1738] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:00.258647 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffdeafb-e604-4595-bdda-4dac81d7c2cf None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:00.277431 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffdeafb-e604-4595-bdda-4dac81d7c2cf None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:00.289506 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edaea7b-b016-41b4-843d-318c276aeebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:00.291100 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edaea7b-b016-41b4-843d-318c276aeebc admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:00.291594 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edaea7b-b016-41b4-843d-318c276aeebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:00.292090 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edaea7b-b016-41b4-843d-318c276aeebc admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:00.293510 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edaea7b-b016-41b4-843d-318c276aeebc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:00.300597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edaea7b-b016-41b4-843d-318c276aeebc admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:00.312728 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 881/1739] 10.222.0.60 () {58 vars in 1058 bytes} [Thu Jul 21 19:33:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:00.312728 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf06d4-b1a1-4d86-ad0b-82cb4afda2cf None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:00.333451 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 859/1740] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:00.335342 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edaea7b-b016-41b4-843d-318c276aeebc admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:00.366623 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edaea7b-b016-41b4-843d-318c276aeebc admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:00.372930 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf06d4-b1a1-4d86-ad0b-82cb4afda2cf None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:00.385601 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f89b53-88ce-467c-8442-4499757e83cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:00.386302 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f89b53-88ce-467c-8442-4499757e83cb admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:00.386606 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f89b53-88ce-467c-8442-4499757e83cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:00.386879 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f89b53-88ce-467c-8442-4499757e83cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:00.388191 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f89b53-88ce-467c-8442-4499757e83cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:00.389817 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f89b53-88ce-467c-8442-4499757e83cb admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:00.403475 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d7bf1-e42f-437a-bde0-f33107eb3630 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcc5eefc2f7c419190e96b46b163fedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:00.404923 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d7bf1-e42f-437a-bde0-f33107eb3630 service placement] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:00.405220 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d7bf1-e42f-437a-bde0-f33107eb3630 service placement] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:00.405511 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d7bf1-e42f-437a-bde0-f33107eb3630 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:00.410452 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-467d7bf1-e42f-437a-bde0-f33107eb3630 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:00.423886 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d7bf1-e42f-437a-bde0-f33107eb3630 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:00.425759 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d7bf1-e42f-437a-bde0-f33107eb3630 service placement] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:00.432193 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 882/1741] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:00.434295 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f89b53-88ce-467c-8442-4499757e83cb admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:00.442189 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 860/1742] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:34:00.454870 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d7bf1-e42f-437a-bde0-f33107eb3630 service placement] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:00.456929 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f89b53-88ce-467c-8442-4499757e83cb admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:00.458676 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-467d7bf1-e42f-437a-bde0-f33107eb3630 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:00.473251 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94349f6e-5f3c-4c77-927e-b7583f2648a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:00.474483 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94349f6e-5f3c-4c77-927e-b7583f2648a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:00.475072 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94349f6e-5f3c-4c77-927e-b7583f2648a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:00.475803 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94349f6e-5f3c-4c77-927e-b7583f2648a9 admin admin] PATH_INFO: `/v3/projects/292b1c7ad62643099bfacb9e93e3b929/users/b58a0cbb2990439482dd14ff30f77834/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:00.491816 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d7bf1-e42f-437a-bde0-f33107eb3630 service placement] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:00.503864 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd098b87-aa80-47cb-b3a2-22e506beac82 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcc5eefc2f7c419190e96b46b163fedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:00.504833 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd098b87-aa80-47cb-b3a2-22e506beac82 service placement] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:00.507821 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd098b87-aa80-47cb-b3a2-22e506beac82 service placement] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:00.508284 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd098b87-aa80-47cb-b3a2-22e506beac82 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:00.513635 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94349f6e-5f3c-4c77-927e-b7583f2648a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=292b1c7ad62643099bfacb9e93e3b929, user_id=b58a0cbb2990439482dd14ff30f77834, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:00.532059 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94349f6e-5f3c-4c77-927e-b7583f2648a9 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:00.535627 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd098b87-aa80-47cb-b3a2-22e506beac82 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:00.537350 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd098b87-aa80-47cb-b3a2-22e506beac82 service placement] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:00.571059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 861/1743] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:34:00.572400 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd098b87-aa80-47cb-b3a2-22e506beac82 service placement] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:00.607640 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd098b87-aa80-47cb-b3a2-22e506beac82 service placement] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:00.608346 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb6e8d-12c0-417f-b98c-2c12174d3e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:00.610008 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb6e8d-12c0-417f-b98c-2c12174d3e71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:00.610446 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb6e8d-12c0-417f-b98c-2c12174d3e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:00.610876 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb6e8d-12c0-417f-b98c-2c12174d3e71 admin admin] PATH_INFO: `/v3/projects/ccb9c5772b5b41edb6386b3a98b8aa47/users/b3166dd4446f4716bd66c7519df20105/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:00.652057 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 883/1744] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:34:00 2022] PUT /identity/v3/projects/292b1c7ad62643099bfacb9e93e3b929/users/b58a0cbb2990439482dd14ff30f77834/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:00.658573 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94349f6e-5f3c-4c77-927e-b7583f2648a9 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:00.659874 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcb6e8d-12c0-417f-b98c-2c12174d3e71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccb9c5772b5b41edb6386b3a98b8aa47, user_id=b3166dd4446f4716bd66c7519df20105, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:00.662562 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcb6e8d-12c0-417f-b98c-2c12174d3e71 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:00.782501 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 862/1745] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:34:00 2022] PUT /identity/v3/projects/ccb9c5772b5b41edb6386b3a98b8aa47/users/b3166dd4446f4716bd66c7519df20105/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:00.782501 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f85d25-adf0-4c0b-8091-7a78b0cc1bd1 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:00.782501 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f85d25-adf0-4c0b-8091-7a78b0cc1bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:00.782501 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f85d25-adf0-4c0b-8091-7a78b0cc1bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:00.813878 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-f4f85d25-adf0-4c0b-8091-7a78b0cc1bd1 None None] MFA Rules not processed for user `42b8bcddb4a24befbad0a5f4ac7ad925`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:00.820440 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-f4f85d25-adf0-4c0b-8091-7a78b0cc1bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:00.904438 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94349f6e-5f3c-4c77-927e-b7583f2648a9 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:01.016122 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 863/1746] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:01.017429 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e8535-a73e-470b-bb9b-3fa20530aceb None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:01.022086 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e8535-a73e-470b-bb9b-3fa20530aceb None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:01.022086 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e8535-a73e-470b-bb9b-3fa20530aceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:01.065727 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519a0f6-3d01-4463-b02e-681282669b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:01.066432 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519a0f6-3d01-4463-b02e-681282669b5e admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:01.066725 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519a0f6-3d01-4463-b02e-681282669b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:01.066999 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519a0f6-3d01-4463-b02e-681282669b5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:01.067835 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519a0f6-3d01-4463-b02e-681282669b5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:01.070645 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519a0f6-3d01-4463-b02e-681282669b5e admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:01.080237 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-8f7e8535-a73e-470b-bb9b-3fa20530aceb None None] MFA Rules not processed for user `b3166dd4446f4716bd66c7519df20105`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:01.081486 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-8f7e8535-a73e-470b-bb9b-3fa20530aceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:01.100634 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 884/1747] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 19:34:01.102976 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519a0f6-3d01-4463-b02e-681282669b5e admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:01.129862 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519a0f6-3d01-4463-b02e-681282669b5e admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:01.152333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80d6e8-0a0e-43dc-a46c-cc92f510fbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:01.155533 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80d6e8-0a0e-43dc-a46c-cc92f510fbf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:01.156057 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80d6e8-0a0e-43dc-a46c-cc92f510fbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:01.157217 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80d6e8-0a0e-43dc-a46c-cc92f510fbf6 admin admin] PATH_INFO: `/v3/projects/292b1c7ad62643099bfacb9e93e3b929/users/b58a0cbb2990439482dd14ff30f77834/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:01.162558 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:01.164110 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80d6e8-0a0e-43dc-a46c-cc92f510fbf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=292b1c7ad62643099bfacb9e93e3b929, user_id=b58a0cbb2990439482dd14ff30f77834, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:01.171301 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80d6e8-0a0e-43dc-a46c-cc92f510fbf6 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:01.198402 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 885/1748] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:34:01 2022] PUT /identity/v3/projects/292b1c7ad62643099bfacb9e93e3b929/users/b58a0cbb2990439482dd14ff30f77834/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:01.209720 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae5bbb-6406-41ca-87ec-320e1790395c None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:01.210301 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae5bbb-6406-41ca-87ec-320e1790395c None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:01.210748 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae5bbb-6406-41ca-87ec-320e1790395c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:01.253381 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:01.257954 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 864/1749] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:01 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:01.277496 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e8535-a73e-470b-bb9b-3fa20530aceb None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:01.292449 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-0fae5bbb-6406-41ca-87ec-320e1790395c None None] MFA Rules not processed for user `b58a0cbb2990439482dd14ff30f77834`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:01.295901 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-0fae5bbb-6406-41ca-87ec-320e1790395c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:01.301375 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e8535-a73e-470b-bb9b-3fa20530aceb None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:01.462043 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08108b-d1b2-4ddb-af07-6bee5a722b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:01.462626 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08108b-d1b2-4ddb-af07-6bee5a722b29 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:01.463040 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08108b-d1b2-4ddb-af07-6bee5a722b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:01.463831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08108b-d1b2-4ddb-af07-6bee5a722b29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:01.467162 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e08108b-d1b2-4ddb-af07-6bee5a722b29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:01.470839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e08108b-d1b2-4ddb-af07-6bee5a722b29 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:01.519296 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 886/1750] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:01 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:01.533437 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae5bbb-6406-41ca-87ec-320e1790395c None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:01.536405 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-0fae5bbb-6406-41ca-87ec-320e1790395c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:01.602393 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 865/1751] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:34:01 2022] POST /identity/v3/projects => generated 405 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:34:01.606937 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08108b-d1b2-4ddb-af07-6bee5a722b29 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:01.707518 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae5bbb-6406-41ca-87ec-320e1790395c None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:01.729927 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08108b-d1b2-4ddb-af07-6bee5a722b29 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:01.751073 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1b56c-e787-435b-810a-f1df4f4246b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:01.752572 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1b56c-e787-435b-810a-f1df4f4246b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:01.753646 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1b56c-e787-435b-810a-f1df4f4246b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:01.754120 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1b56c-e787-435b-810a-f1df4f4246b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:01.755061 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b1b56c-e787-435b-810a-f1df4f4246b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:01.757409 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b1b56c-e787-435b-810a-f1df4f4246b5 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:01.791295 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250d0fd-f06b-4dd6-870f-266cf8526aca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:01.792207 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250d0fd-f06b-4dd6-870f-266cf8526aca service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:01.792510 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250d0fd-f06b-4dd6-870f-266cf8526aca service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:01.792842 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250d0fd-f06b-4dd6-870f-266cf8526aca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:01.885713 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6250d0fd-f06b-4dd6-870f-266cf8526aca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:01.888433 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6250d0fd-f06b-4dd6-870f-266cf8526aca service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:01.902119 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 866/1752] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:34:01 2022] POST /identity/v3/users => generated 309 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 19:34:01.905941 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707e627-8937-4df5-a6d6-dfc0d40c4ddb None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:01.908275 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707e627-8937-4df5-a6d6-dfc0d40c4ddb None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:01.908275 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707e627-8937-4df5-a6d6-dfc0d40c4ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:01.915029 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 887/1753] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:01 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:34:01.916376 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250d0fd-f06b-4dd6-870f-266cf8526aca service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:01.943125 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250d0fd-f06b-4dd6-870f-266cf8526aca service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:01.954766 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118a337-10d6-4c53-a05f-b9352de469e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:01.957239 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118a337-10d6-4c53-a05f-b9352de469e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:01.957784 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118a337-10d6-4c53-a05f-b9352de469e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:01.958170 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118a337-10d6-4c53-a05f-b9352de469e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:01.959712 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118a337-10d6-4c53-a05f-b9352de469e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:01.962245 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118a337-10d6-4c53-a05f-b9352de469e1 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:01.978539 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 888/1754] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:01 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:01.979624 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118a337-10d6-4c53-a05f-b9352de469e1 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:01.990803 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118a337-10d6-4c53-a05f-b9352de469e1 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:01.994652 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-1707e627-8937-4df5-a6d6-dfc0d40c4ddb None None] MFA Rules not processed for user `77472ae05a004b89a9f7b0b4b352dd46`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:01.996373 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637d7e3-645d-4ee9-b28b-04135cb193ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:01.999710 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637d7e3-645d-4ee9-b28b-04135cb193ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:01.999710 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637d7e3-645d-4ee9-b28b-04135cb193ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:01.999710 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637d7e3-645d-4ee9-b28b-04135cb193ad admin admin] PATH_INFO: `/v3/projects/8a8913377b624357a8efb29bf4994128/users/d74206be92824404975de97c0cff56b5/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:02.000065 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-1707e627-8937-4df5-a6d6-dfc0d40c4ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:02.016979 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637d7e3-645d-4ee9-b28b-04135cb193ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a8913377b624357a8efb29bf4994128, user_id=d74206be92824404975de97c0cff56b5, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:02.020245 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637d7e3-645d-4ee9-b28b-04135cb193ad admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:02.164136 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 889/1755] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:34:01 2022] PUT /identity/v3/projects/8a8913377b624357a8efb29bf4994128/users/d74206be92824404975de97c0cff56b5/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:02.175377 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637d7e3-645d-4ee9-b28b-04135cb193ad admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:02.261451 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 867/1756] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:01 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:02.271301 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:02.381765 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637d7e3-645d-4ee9-b28b-04135cb193ad admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:02.401633 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405c50f-0f3c-42d7-9213-14f04d72f13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:02.402360 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405c50f-0f3c-42d7-9213-14f04d72f13c admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:02.406509 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405c50f-0f3c-42d7-9213-14f04d72f13c admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:02.406710 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405c50f-0f3c-42d7-9213-14f04d72f13c admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:02.408441 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9405c50f-0f3c-42d7-9213-14f04d72f13c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:02.418753 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9405c50f-0f3c-42d7-9213-14f04d72f13c admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:02.478838 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 890/1757] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:02.480769 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707e627-8937-4df5-a6d6-dfc0d40c4ddb None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:02.495810 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707e627-8937-4df5-a6d6-dfc0d40c4ddb None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:02.507079 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32f7ad-dafb-4f27-8e2a-b5b34851f82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:02.508087 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32f7ad-dafb-4f27-8e2a-b5b34851f82c admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:02.508386 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32f7ad-dafb-4f27-8e2a-b5b34851f82c admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:02.508685 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32f7ad-dafb-4f27-8e2a-b5b34851f82c admin admin] PATH_INFO: `/v3/projects/8a8913377b624357a8efb29bf4994128/users/d74206be92824404975de97c0cff56b5/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:02.524053 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e32f7ad-dafb-4f27-8e2a-b5b34851f82c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a8913377b624357a8efb29bf4994128, user_id=d74206be92824404975de97c0cff56b5, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:02.530469 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e32f7ad-dafb-4f27-8e2a-b5b34851f82c admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:02.581983 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 868/1758] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:34:02 2022] PUT /identity/v3/projects/8a8913377b624357a8efb29bf4994128/users/d74206be92824404975de97c0cff56b5/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:02.592249 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65baa368-22d9-4f49-8b23-4ad9610e9a6c None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:02.593171 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65baa368-22d9-4f49-8b23-4ad9610e9a6c None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:02.593628 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65baa368-22d9-4f49-8b23-4ad9610e9a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:02.618340 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32f7ad-dafb-4f27-8e2a-b5b34851f82c admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:02.620532 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-6e32f7ad-dafb-4f27-8e2a-b5b34851f82c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:02.670322 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-65baa368-22d9-4f49-8b23-4ad9610e9a6c None None] MFA Rules not processed for user `d74206be92824404975de97c0cff56b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:02.671618 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-65baa368-22d9-4f49-8b23-4ad9610e9a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:02.768633 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32f7ad-dafb-4f27-8e2a-b5b34851f82c admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:02.780614 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e778674-7c67-446f-a80d-2cca98d0255c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:02.781354 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e778674-7c67-446f-a80d-2cca98d0255c service cinder] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:02.782242 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e778674-7c67-446f-a80d-2cca98d0255c service cinder] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:02.783198 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e778674-7c67-446f-a80d-2cca98d0255c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:02.789811 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-0e778674-7c67-446f-a80d-2cca98d0255c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:02.842441 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 891/1759] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:02 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:02.872914 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65baa368-22d9-4f49-8b23-4ad9610e9a6c None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:02.889890 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65baa368-22d9-4f49-8b23-4ad9610e9a6c None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:02.907215 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42273e-baf1-455a-b55e-1770d1aaec7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:02.908321 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42273e-baf1-455a-b55e-1770d1aaec7c service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:02.915345 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42273e-baf1-455a-b55e-1770d1aaec7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:02.915345 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42273e-baf1-455a-b55e-1770d1aaec7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:02.931385 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf42273e-baf1-455a-b55e-1770d1aaec7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:02.933235 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf42273e-baf1-455a-b55e-1770d1aaec7c service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:02.950573 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 892/1760] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:02 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 19:34:03.001843 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e778674-7c67-446f-a80d-2cca98d0255c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:03.003296 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e778674-7c67-446f-a80d-2cca98d0255c service cinder] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:03.024233 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 869/1761] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:02 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:34:03.471468 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42273e-baf1-455a-b55e-1770d1aaec7c service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:03.773506 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42273e-baf1-455a-b55e-1770d1aaec7c service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:03.786063 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae273e5-044a-4d96-aa6b-b97d65d394ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:03.787024 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae273e5-044a-4d96-aa6b-b97d65d394ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:03.787312 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae273e5-044a-4d96-aa6b-b97d65d394ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:03.788193 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae273e5-044a-4d96-aa6b-b97d65d394ce admin admin] PATH_INFO: `/v3/users/b3166dd4446f4716bd66c7519df20105` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:03.791942 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae273e5-044a-4d96-aa6b-b97d65d394ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3166dd4446f4716bd66c7519df20105)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:03.800753 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae273e5-044a-4d96-aa6b-b97d65d394ce admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:03.930801 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e778674-7c67-446f-a80d-2cca98d0255c service cinder] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:03.957181 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e778674-7c67-446f-a80d-2cca98d0255c service cinder] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:03.977026 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98089c6-060c-4a7a-a7f5-8cf792b3db8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:03.980346 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98089c6-060c-4a7a-a7f5-8cf792b3db8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:03.982268 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98089c6-060c-4a7a-a7f5-8cf792b3db8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:03.982634 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98089c6-060c-4a7a-a7f5-8cf792b3db8f admin admin] PATH_INFO: `/v3/users/20a7ae17424046b192982a57fa271961` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:03.987073 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98089c6-060c-4a7a-a7f5-8cf792b3db8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=20a7ae17424046b192982a57fa271961)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:04.023657 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98089c6-060c-4a7a-a7f5-8cf792b3db8f admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:04.101834 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:04.172159 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-4ae273e5-044a-4d96-aa6b-b97d65d394ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3166dd4446f4716bd66c7519df20105'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:04.299050 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-4ae273e5-044a-4d96-aa6b-b97d65d394ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3166dd4446f4716bd66c7519df20105'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:04.299709 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-4ae273e5-044a-4d96-aa6b-b97d65d394ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3166dd4446f4716bd66c7519df20105'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:04.320324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-4ae273e5-044a-4d96-aa6b-b97d65d394ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3166dd4446f4716bd66c7519df20105'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:04.329260 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:04.339303 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-4ae273e5-044a-4d96-aa6b-b97d65d394ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3166dd4446f4716bd66c7519df20105'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:04.355651 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-f98089c6-060c-4a7a-a7f5-8cf792b3db8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20a7ae17424046b192982a57fa271961'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:04.357906 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 893/1762] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:34:03 2022] DELETE /identity/v3/users/b3166dd4446f4716bd66c7519df20105 => generated 0 bytes in 887 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:04.362748 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9be671-93b5-43a9-89ae-faced64914d3 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:04.363381 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9be671-93b5-43a9-89ae-faced64914d3 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:04.364375 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9be671-93b5-43a9-89ae-faced64914d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:04.387277 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-1b9be671-93b5-43a9-89ae-faced64914d3 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:04.389636 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-1b9be671-93b5-43a9-89ae-faced64914d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:04.470149 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-f98089c6-060c-4a7a-a7f5-8cf792b3db8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20a7ae17424046b192982a57fa271961'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:04.493639 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-f98089c6-060c-4a7a-a7f5-8cf792b3db8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20a7ae17424046b192982a57fa271961'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:04.501420 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-f98089c6-060c-4a7a-a7f5-8cf792b3db8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20a7ae17424046b192982a57fa271961'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:04.526812 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-f98089c6-060c-4a7a-a7f5-8cf792b3db8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20a7ae17424046b192982a57fa271961'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:04.543175 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 870/1763] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:34:03 2022] DELETE /identity/v3/users/20a7ae17424046b192982a57fa271961 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:34:04.553538 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e49569-ac26-48b3-824c-16bb17bcc2aa None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:04.554233 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e49569-ac26-48b3-824c-16bb17bcc2aa None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:04.554690 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e49569-ac26-48b3-824c-16bb17bcc2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:04.577343 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 894/1764] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:04.579752 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-c0e49569-ac26-48b3-824c-16bb17bcc2aa None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:04.582129 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-c0e49569-ac26-48b3-824c-16bb17bcc2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:04.596190 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9be671-93b5-43a9-89ae-faced64914d3 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:04.597677 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-1b9be671-93b5-43a9-89ae-faced64914d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:04.758898 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9be671-93b5-43a9-89ae-faced64914d3 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:04.776632 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 871/1765] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:04.781200 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e49569-ac26-48b3-824c-16bb17bcc2aa None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:04.903466 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b6381-c211-4e3c-b42d-7bf44465caf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:04.904993 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b6381-c211-4e3c-b42d-7bf44465caf1 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:04.905509 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b6381-c211-4e3c-b42d-7bf44465caf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:04.905993 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b6381-c211-4e3c-b42d-7bf44465caf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:04.930814 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47b6381-c211-4e3c-b42d-7bf44465caf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:04.933119 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47b6381-c211-4e3c-b42d-7bf44465caf1 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:04.937330 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e49569-ac26-48b3-824c-16bb17bcc2aa None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:04.945398 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1496817-c4d8-4074-aaba-969e7f163207 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:04.946138 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1496817-c4d8-4074-aaba-969e7f163207 service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:04.946434 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1496817-c4d8-4074-aaba-969e7f163207 service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:04.946713 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1496817-c4d8-4074-aaba-969e7f163207 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:04.959950 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1496817-c4d8-4074-aaba-969e7f163207 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:04.963679 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 895/1766] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 19:34:04.966686 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea84695-4d10-4226-a2d3-da3f97e7c862 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:04.967108 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea84695-4d10-4226-a2d3-da3f97e7c862 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:04.967535 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea84695-4d10-4226-a2d3-da3f97e7c862 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:04.971369 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 896/1767] 10.222.0.60 () {54 vars in 921 bytes} [Thu Jul 21 19:34:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:34:04.978518 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a86a6-4c13-4a00-8f1a-cb65086f5a36 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:04.979122 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a86a6-4c13-4a00-8f1a-cb65086f5a36 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:04.979748 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a86a6-4c13-4a00-8f1a-cb65086f5a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:04.985739 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1496817-c4d8-4074-aaba-969e7f163207 service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:05.022710 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-bb0a86a6-4c13-4a00-8f1a-cb65086f5a36 None None] MFA Rules not processed for user `bcc5eefc2f7c419190e96b46b163fedd`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:05.024362 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-bb0a86a6-4c13-4a00-8f1a-cb65086f5a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:05.031931 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 872/1768] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 19:34:05.260274 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 897/1769] 10.222.0.60 () {58 vars in 1018 bytes} [Thu Jul 21 19:34:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:34:05.279184 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1496817-c4d8-4074-aaba-969e7f163207 service neutron] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:05.281160 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-e1496817-c4d8-4074-aaba-969e7f163207 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:05.337115 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1496817-c4d8-4074-aaba-969e7f163207 service neutron] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:05.358068 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b19c4-9286-4394-a1aa-0b2a6e05fbc1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcc5eefc2f7c419190e96b46b163fedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:05.358752 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b19c4-9286-4394-a1aa-0b2a6e05fbc1 service placement] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:05.359044 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b19c4-9286-4394-a1aa-0b2a6e05fbc1 service placement] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:05.359323 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b19c4-9286-4394-a1aa-0b2a6e05fbc1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:05.390908 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b19c4-9286-4394-a1aa-0b2a6e05fbc1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:05.395269 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b19c4-9286-4394-a1aa-0b2a6e05fbc1 service placement] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:05.431062 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 873/1770] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:34:06.182726 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a86a6-4c13-4a00-8f1a-cb65086f5a36 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:06.185473 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-bb0a86a6-4c13-4a00-8f1a-cb65086f5a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:06.210998 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a86a6-4c13-4a00-8f1a-cb65086f5a36 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:06.220396 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4fb601-582d-4153-bd34-3d9a6caeeb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:06.222205 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fb601-582d-4153-bd34-3d9a6caeeb3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:06.222827 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fb601-582d-4153-bd34-3d9a6caeeb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:06.223784 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fb601-582d-4153-bd34-3d9a6caeeb3d admin admin] PATH_INFO: `/v3/projects/b24e39a032ba47edb7e28628810c6509` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:06.226378 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4fb601-582d-4153-bd34-3d9a6caeeb3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b24e39a032ba47edb7e28628810c6509)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:06.229518 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4fb601-582d-4153-bd34-3d9a6caeeb3d admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:06.260359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b19c4-9286-4394-a1aa-0b2a6e05fbc1 service placement] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:06.262664 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-939b19c4-9286-4394-a1aa-0b2a6e05fbc1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:06.284616 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b19c4-9286-4394-a1aa-0b2a6e05fbc1 service placement] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:06.296167 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c776ddc-bf64-4817-8852-8ada0399e1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:06.298498 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c776ddc-bf64-4817-8852-8ada0399e1e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:06.298956 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c776ddc-bf64-4817-8852-8ada0399e1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:06.299844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c776ddc-bf64-4817-8852-8ada0399e1e2 admin admin] PATH_INFO: `/v3/projects/ccb9c5772b5b41edb6386b3a98b8aa47` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:06.303257 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c776ddc-bf64-4817-8852-8ada0399e1e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccb9c5772b5b41edb6386b3a98b8aa47)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:06.305529 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c776ddc-bf64-4817-8852-8ada0399e1e2 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:06.481872 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-0c4fb601-582d-4153-bd34-3d9a6caeeb3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b24e39a032ba47edb7e28628810c6509', 'request_id': 'req-0c4fb601-582d-4153-bd34-3d9a6caeeb3d'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:06.486079 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:06.517703 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-0c4fb601-582d-4153-bd34-3d9a6caeeb3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b24e39a032ba47edb7e28628810c6509', 'request_id': 'req-0c4fb601-582d-4153-bd34-3d9a6caeeb3d'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:06.540175 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-0c776ddc-bf64-4817-8852-8ada0399e1e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccb9c5772b5b41edb6386b3a98b8aa47', 'request_id': 'req-0c776ddc-bf64-4817-8852-8ada0399e1e2'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:06.573796 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:06.598665 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-0c4fb601-582d-4153-bd34-3d9a6caeeb3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b24e39a032ba47edb7e28628810c6509', 'request_id': 'req-0c4fb601-582d-4153-bd34-3d9a6caeeb3d'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:06.654037 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-0c4fb601-582d-4153-bd34-3d9a6caeeb3d admin admin] The token cache is being invalidate because project b24e39a032ba47edb7e28628810c6509 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:34:06.656101 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-0c4fb601-582d-4153-bd34-3d9a6caeeb3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:06.659062 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-0c4fb601-582d-4153-bd34-3d9a6caeeb3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:06.671176 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 898/1771] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:34:06 2022] DELETE /identity/v3/projects/b24e39a032ba47edb7e28628810c6509 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:06.677166 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-0c776ddc-bf64-4817-8852-8ada0399e1e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccb9c5772b5b41edb6386b3a98b8aa47', 'request_id': 'req-0c776ddc-bf64-4817-8852-8ada0399e1e2'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:06.677500 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4fb601-582d-4153-bd34-3d9a6caeeb3d admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:06.685692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-0c776ddc-bf64-4817-8852-8ada0399e1e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccb9c5772b5b41edb6386b3a98b8aa47', 'request_id': 'req-0c776ddc-bf64-4817-8852-8ada0399e1e2'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:06.687375 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-0c4fb601-582d-4153-bd34-3d9a6caeeb3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:06.710043 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-0c776ddc-bf64-4817-8852-8ada0399e1e2 admin admin] The token cache is being invalidate because project ccb9c5772b5b41edb6386b3a98b8aa47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:34:06.710945 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-0c776ddc-bf64-4817-8852-8ada0399e1e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:06.712652 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-0c776ddc-bf64-4817-8852-8ada0399e1e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:06.717741 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 874/1772] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:34:06 2022] DELETE /identity/v3/projects/ccb9c5772b5b41edb6386b3a98b8aa47 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:34:06.723253 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c776ddc-bf64-4817-8852-8ada0399e1e2 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:06.726382 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-0c776ddc-bf64-4817-8852-8ada0399e1e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:06.876905 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4fb601-582d-4153-bd34-3d9a6caeeb3d admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:06.883981 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c776ddc-bf64-4817-8852-8ada0399e1e2 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:06.898155 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334bf11-984d-4012-a346-c9a88aef5f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:06.898755 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b15b6d8-9721-45eb-82ea-e1805fb8d2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:06.899009 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334bf11-984d-4012-a346-c9a88aef5f05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:06.901298 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15b6d8-9721-45eb-82ea-e1805fb8d2ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:06.901512 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334bf11-984d-4012-a346-c9a88aef5f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:06.901817 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334bf11-984d-4012-a346-c9a88aef5f05 admin admin] PATH_INFO: `/v3/users/b58a0cbb2990439482dd14ff30f77834` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:06.902803 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15b6d8-9721-45eb-82ea-e1805fb8d2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:06.903708 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e334bf11-984d-4012-a346-c9a88aef5f05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b58a0cbb2990439482dd14ff30f77834)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:06.904774 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15b6d8-9721-45eb-82ea-e1805fb8d2ab admin admin] PATH_INFO: `/v3/users/d74206be92824404975de97c0cff56b5` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:06.908068 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e334bf11-984d-4012-a346-c9a88aef5f05 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:06.909035 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b15b6d8-9721-45eb-82ea-e1805fb8d2ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=d74206be92824404975de97c0cff56b5)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:06.915807 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b15b6d8-9721-45eb-82ea-e1805fb8d2ab admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:07.252258 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-6b15b6d8-9721-45eb-82ea-e1805fb8d2ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd74206be92824404975de97c0cff56b5'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:07.275119 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-e334bf11-984d-4012-a346-c9a88aef5f05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b58a0cbb2990439482dd14ff30f77834'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:07.357761 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-6b15b6d8-9721-45eb-82ea-e1805fb8d2ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd74206be92824404975de97c0cff56b5'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:07.382781 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-6b15b6d8-9721-45eb-82ea-e1805fb8d2ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd74206be92824404975de97c0cff56b5'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:07.384009 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-6b15b6d8-9721-45eb-82ea-e1805fb8d2ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd74206be92824404975de97c0cff56b5'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:07.398841 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-6b15b6d8-9721-45eb-82ea-e1805fb8d2ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd74206be92824404975de97c0cff56b5'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:07.406556 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 875/1773] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:34:06 2022] DELETE /identity/v3/users/d74206be92824404975de97c0cff56b5 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:07.420347 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce40e23-a25d-40ef-b35f-10d64b6f69ba None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:07.420347 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce40e23-a25d-40ef-b35f-10d64b6f69ba None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:07.420347 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce40e23-a25d-40ef-b35f-10d64b6f69ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:07.453943 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-e334bf11-984d-4012-a346-c9a88aef5f05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b58a0cbb2990439482dd14ff30f77834'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:07.456769 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-e334bf11-984d-4012-a346-c9a88aef5f05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b58a0cbb2990439482dd14ff30f77834'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:07.467125 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-e334bf11-984d-4012-a346-c9a88aef5f05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b58a0cbb2990439482dd14ff30f77834'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:07.470873 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-2ce40e23-a25d-40ef-b35f-10d64b6f69ba None None] MFA Rules not processed for user `22d11b8e390e4b9db3b84c419266c4b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:07.472232 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-2ce40e23-a25d-40ef-b35f-10d64b6f69ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:07.496076 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-e334bf11-984d-4012-a346-c9a88aef5f05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b58a0cbb2990439482dd14ff30f77834'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:07.517921 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 899/1774] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:34:06 2022] DELETE /identity/v3/users/b58a0cbb2990439482dd14ff30f77834 => generated 0 bytes in 842 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:07.519315 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfcfb0f-4815-422e-9853-b7c3854b7fe8 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:07.519631 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfcfb0f-4815-422e-9853-b7c3854b7fe8 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:07.519909 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfcfb0f-4815-422e-9853-b7c3854b7fe8 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:07.532734 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 900/1775] 10.222.0.60 () {54 vars in 921 bytes} [Thu Jul 21 19:34:07 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:34:07.533705 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfcfb0f-4815-422e-9853-b7c3854b7fe8 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:07.538577 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ddfcfb0f-4815-422e-9853-b7c3854b7fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:07.546812 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 876/1776] 10.222.0.60 () {58 vars in 1009 bytes} [Thu Jul 21 19:34:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:07.588130 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26831ff2-1db6-406a-bca9-c764a3ebe099 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:07.588671 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26831ff2-1db6-406a-bca9-c764a3ebe099 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:07.589029 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26831ff2-1db6-406a-bca9-c764a3ebe099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:07.640505 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-26831ff2-1db6-406a-bca9-c764a3ebe099 None None] MFA Rules not processed for user `bcc5eefc2f7c419190e96b46b163fedd`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:07.642919 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-26831ff2-1db6-406a-bca9-c764a3ebe099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:07.676656 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfcfb0f-4815-422e-9853-b7c3854b7fe8 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:07.688760 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb0b33a-c004-40bc-a871-a63060667f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:07.690072 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0b33a-c004-40bc-a871-a63060667f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:07.690454 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0b33a-c004-40bc-a871-a63060667f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:07.690884 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0b33a-c004-40bc-a871-a63060667f43 admin admin] PATH_INFO: `/v3/users/466eac612e9c44c994d3007f4583c4c3` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:07.693631 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb0b33a-c004-40bc-a871-a63060667f43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=466eac612e9c44c994d3007f4583c4c3)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:07.700744 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb0b33a-c004-40bc-a871-a63060667f43 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:07.806508 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 877/1777] 10.222.0.60 () {58 vars in 1018 bytes} [Thu Jul 21 19:34:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:34:07.829609 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26831ff2-1db6-406a-bca9-c764a3ebe099 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:07.838301 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-26831ff2-1db6-406a-bca9-c764a3ebe099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:07.879180 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26831ff2-1db6-406a-bca9-c764a3ebe099 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:07.911739 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11b482-1ec6-457b-9f77-29dd435ca82b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcc5eefc2f7c419190e96b46b163fedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:07.912923 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11b482-1ec6-457b-9f77-29dd435ca82b service placement] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:07.913530 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11b482-1ec6-457b-9f77-29dd435ca82b service placement] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:07.914005 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11b482-1ec6-457b-9f77-29dd435ca82b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:07.928585 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11b482-1ec6-457b-9f77-29dd435ca82b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:07.930806 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11b482-1ec6-457b-9f77-29dd435ca82b service placement] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:07.969770 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 878/1778] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:34:08.157648 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11b482-1ec6-457b-9f77-29dd435ca82b service placement] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:08.159230 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-4b11b482-1ec6-457b-9f77-29dd435ca82b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:08.196415 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-0eb0b33a-c004-40bc-a871-a63060667f43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '466eac612e9c44c994d3007f4583c4c3'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:08.270918 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:08.316603 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-0eb0b33a-c004-40bc-a871-a63060667f43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '466eac612e9c44c994d3007f4583c4c3'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:08.317519 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-0eb0b33a-c004-40bc-a871-a63060667f43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '466eac612e9c44c994d3007f4583c4c3'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:08.331028 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-0eb0b33a-c004-40bc-a871-a63060667f43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '466eac612e9c44c994d3007f4583c4c3'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:08.405316 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-0eb0b33a-c004-40bc-a871-a63060667f43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '466eac612e9c44c994d3007f4583c4c3'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:08.445945 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 901/1779] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:34:07 2022] DELETE /identity/v3/users/466eac612e9c44c994d3007f4583c4c3 => generated 0 bytes in 910 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:08.520505 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11b482-1ec6-457b-9f77-29dd435ca82b service placement] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:08.661740 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372a295-1450-4df8-b4ee-b84fd467f931 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa579af53a6441a9205cf82864a640e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:08.663870 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372a295-1450-4df8-b4ee-b84fd467f931 service swift] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:08.663870 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372a295-1450-4df8-b4ee-b84fd467f931 service swift] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:08.664968 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372a295-1450-4df8-b4ee-b84fd467f931 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:08.672304 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-1372a295-1450-4df8-b4ee-b84fd467f931 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:08.782833 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372a295-1450-4df8-b4ee-b84fd467f931 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:08.787964 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372a295-1450-4df8-b4ee-b84fd467f931 service swift] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:08.809950 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 879/1780] 10.222.0.60 () {60 vars in 1384 bytes} [Thu Jul 21 19:34:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 19:34:09.438881 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:09.720984 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb0b33a-c004-40bc-a871-a63060667f43 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:09.723608 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-0eb0b33a-c004-40bc-a871-a63060667f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:09.932463 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb0b33a-c004-40bc-a871-a63060667f43 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:09.941727 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f89cc9-1bd3-4689-bed7-b54b2c47e98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:09.942631 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f89cc9-1bd3-4689-bed7-b54b2c47e98b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:09.942923 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f89cc9-1bd3-4689-bed7-b54b2c47e98b admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:09.943330 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f89cc9-1bd3-4689-bed7-b54b2c47e98b admin admin] PATH_INFO: `/v3/projects/8a8913377b624357a8efb29bf4994128` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:09.945695 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f89cc9-1bd3-4689-bed7-b54b2c47e98b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a8913377b624357a8efb29bf4994128)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:09.953545 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f89cc9-1bd3-4689-bed7-b54b2c47e98b admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:10.158859 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372a295-1450-4df8-b4ee-b84fd467f931 service swift] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:10.158859 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-1372a295-1450-4df8-b4ee-b84fd467f931 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:10.158859 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372a295-1450-4df8-b4ee-b84fd467f931 service swift] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:10.162068 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4077f62-d10e-4709-bb78-b42d39e02e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:10.162068 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4077f62-d10e-4709-bb78-b42d39e02e65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:10.162068 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4077f62-d10e-4709-bb78-b42d39e02e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:10.162068 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4077f62-d10e-4709-bb78-b42d39e02e65 admin admin] PATH_INFO: `/v3/projects/292b1c7ad62643099bfacb9e93e3b929` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:10.162738 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4077f62-d10e-4709-bb78-b42d39e02e65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=292b1c7ad62643099bfacb9e93e3b929)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:10.162738 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4077f62-d10e-4709-bb78-b42d39e02e65 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:10.286178 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-64f89cc9-1bd3-4689-bed7-b54b2c47e98b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a8913377b624357a8efb29bf4994128', 'request_id': 'req-64f89cc9-1bd3-4689-bed7-b54b2c47e98b'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:10.300216 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-64f89cc9-1bd3-4689-bed7-b54b2c47e98b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a8913377b624357a8efb29bf4994128', 'request_id': 'req-64f89cc9-1bd3-4689-bed7-b54b2c47e98b'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:10.600728 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-64f89cc9-1bd3-4689-bed7-b54b2c47e98b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a8913377b624357a8efb29bf4994128', 'request_id': 'req-64f89cc9-1bd3-4689-bed7-b54b2c47e98b'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:10.629818 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-c4077f62-d10e-4709-bb78-b42d39e02e65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '292b1c7ad62643099bfacb9e93e3b929', 'request_id': 'req-c4077f62-d10e-4709-bb78-b42d39e02e65'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:10.640133 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-64f89cc9-1bd3-4689-bed7-b54b2c47e98b admin admin] The token cache is being invalidate because project 8a8913377b624357a8efb29bf4994128 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:34:10.640519 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-64f89cc9-1bd3-4689-bed7-b54b2c47e98b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:10.646527 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-64f89cc9-1bd3-4689-bed7-b54b2c47e98b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:10.656090 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 902/1781] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:34:09 2022] DELETE /identity/v3/projects/8a8913377b624357a8efb29bf4994128 => generated 0 bytes in 936 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:10.658858 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f89cc9-1bd3-4689-bed7-b54b2c47e98b admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:10.664479 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-64f89cc9-1bd3-4689-bed7-b54b2c47e98b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:10.735265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-c4077f62-d10e-4709-bb78-b42d39e02e65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '292b1c7ad62643099bfacb9e93e3b929', 'request_id': 'req-c4077f62-d10e-4709-bb78-b42d39e02e65'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:10.743243 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-c4077f62-d10e-4709-bb78-b42d39e02e65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '292b1c7ad62643099bfacb9e93e3b929', 'request_id': 'req-c4077f62-d10e-4709-bb78-b42d39e02e65'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:10.772392 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-c4077f62-d10e-4709-bb78-b42d39e02e65 admin admin] The token cache is being invalidate because project 292b1c7ad62643099bfacb9e93e3b929 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:34:10.774380 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-c4077f62-d10e-4709-bb78-b42d39e02e65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:10.776096 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-c4077f62-d10e-4709-bb78-b42d39e02e65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:10.786181 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 880/1782] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:34:10 2022] DELETE /identity/v3/projects/292b1c7ad62643099bfacb9e93e3b929 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:34:10.786181 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf0ef1-af0e-463d-a752-d85e5fa2a741 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:10.786181 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf0ef1-af0e-463d-a752-d85e5fa2a741 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:10.786181 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf0ef1-af0e-463d-a752-d85e5fa2a741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:10.813663 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f89cc9-1bd3-4689-bed7-b54b2c47e98b admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:10.835014 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-3bbf0ef1-af0e-463d-a752-d85e5fa2a741 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:10.837377 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-3bbf0ef1-af0e-463d-a752-d85e5fa2a741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:10.947305 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020039a-5494-41a1-9072-5cf6c33e18fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:10.949593 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020039a-5494-41a1-9072-5cf6c33e18fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:10.949877 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020039a-5494-41a1-9072-5cf6c33e18fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:10.950152 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020039a-5494-41a1-9072-5cf6c33e18fc admin admin] PATH_INFO: `/v3/projects/42197ee0fd1a45aaa1b2c414e724b176` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:10.955586 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b020039a-5494-41a1-9072-5cf6c33e18fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=42197ee0fd1a45aaa1b2c414e724b176)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:10.957807 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b020039a-5494-41a1-9072-5cf6c33e18fc admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:11.044730 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:11.082224 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 881/1783] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:11.083882 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d4ecc-88a2-4c30-8d0b-9f844c5e54a5 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:11.084187 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d4ecc-88a2-4c30-8d0b-9f844c5e54a5 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:11.084475 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d4ecc-88a2-4c30-8d0b-9f844c5e54a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:11.128422 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-774d4ecc-88a2-4c30-8d0b-9f844c5e54a5 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:11.134215 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-774d4ecc-88a2-4c30-8d0b-9f844c5e54a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:11.177832 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 882/1784] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:11.182490 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-b020039a-5494-41a1-9072-5cf6c33e18fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42197ee0fd1a45aaa1b2c414e724b176', 'request_id': 'req-b020039a-5494-41a1-9072-5cf6c33e18fc'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:11.182626 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e57a43-cb92-42c0-ac2a-b87865dfd6de None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:11.182626 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e57a43-cb92-42c0-ac2a-b87865dfd6de None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:11.182626 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e57a43-cb92-42c0-ac2a-b87865dfd6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:11.213675 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-b020039a-5494-41a1-9072-5cf6c33e18fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42197ee0fd1a45aaa1b2c414e724b176', 'request_id': 'req-b020039a-5494-41a1-9072-5cf6c33e18fc'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:11.258079 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-84e57a43-cb92-42c0-ac2a-b87865dfd6de None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:11.263253 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-84e57a43-cb92-42c0-ac2a-b87865dfd6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:11.327160 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-b020039a-5494-41a1-9072-5cf6c33e18fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42197ee0fd1a45aaa1b2c414e724b176', 'request_id': 'req-b020039a-5494-41a1-9072-5cf6c33e18fc'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:11.351521 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-b020039a-5494-41a1-9072-5cf6c33e18fc admin admin] The token cache is being invalidate because project 42197ee0fd1a45aaa1b2c414e724b176 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:34:11.351816 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-b020039a-5494-41a1-9072-5cf6c33e18fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:11.355191 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-b020039a-5494-41a1-9072-5cf6c33e18fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:11.361102 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 903/1785] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:34:10 2022] DELETE /identity/v3/projects/42197ee0fd1a45aaa1b2c414e724b176 => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:11.366362 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01de719-7595-4baa-8c1e-ba95a03a7030 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:11.366665 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01de719-7595-4baa-8c1e-ba95a03a7030 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:11.370395 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01de719-7595-4baa-8c1e-ba95a03a7030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:11.453730 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 883/1786] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:11.471784 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-d01de719-7595-4baa-8c1e-ba95a03a7030 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:11.471784 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-d01de719-7595-4baa-8c1e-ba95a03a7030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:11.472022 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e57a43-cb92-42c0-ac2a-b87865dfd6de None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:11.473253 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-84e57a43-cb92-42c0-ac2a-b87865dfd6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:11.494700 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e57a43-cb92-42c0-ac2a-b87865dfd6de None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:11.499268 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411da292-bd21-4165-b77a-70ac90021008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:11.503336 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411da292-bd21-4165-b77a-70ac90021008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:11.503670 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411da292-bd21-4165-b77a-70ac90021008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:11.504003 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411da292-bd21-4165-b77a-70ac90021008 admin admin] PATH_INFO: `/v3/users/77472ae05a004b89a9f7b0b4b352dd46` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:11.505394 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411da292-bd21-4165-b77a-70ac90021008 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77472ae05a004b89a9f7b0b4b352dd46)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:11.507813 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 904/1787] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:11.508981 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01de719-7595-4baa-8c1e-ba95a03a7030 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:11.531948 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01de719-7595-4baa-8c1e-ba95a03a7030 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:11.535666 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411da292-bd21-4165-b77a-70ac90021008 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:11.549570 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58636f2c-fb2d-4151-aa18-a083119bc469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:11.553080 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58636f2c-fb2d-4151-aa18-a083119bc469 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:11.553080 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58636f2c-fb2d-4151-aa18-a083119bc469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:11.553080 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58636f2c-fb2d-4151-aa18-a083119bc469 admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:11.553080 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58636f2c-fb2d-4151-aa18-a083119bc469 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:34:11.553080 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58636f2c-fb2d-4151-aa18-a083119bc469 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:11.555978 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58636f2c-fb2d-4151-aa18-a083119bc469 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:11.615919 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 905/1788] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:34:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:34:11.616978 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58636f2c-fb2d-4151-aa18-a083119bc469 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:11.647965 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58636f2c-fb2d-4151-aa18-a083119bc469 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:11.664857 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2313c3-b939-4b08-a279-36a1b8804aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:11.668498 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2313c3-b939-4b08-a279-36a1b8804aac admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:11.668498 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2313c3-b939-4b08-a279-36a1b8804aac admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:11.668498 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2313c3-b939-4b08-a279-36a1b8804aac admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:11.668498 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2313c3-b939-4b08-a279-36a1b8804aac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:34:11.668498 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2313c3-b939-4b08-a279-36a1b8804aac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:11.670365 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2313c3-b939-4b08-a279-36a1b8804aac admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:11.708355 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 906/1789] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:34:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:34:11.708355 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2313c3-b939-4b08-a279-36a1b8804aac admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:11.736888 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2313c3-b939-4b08-a279-36a1b8804aac admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:11.760641 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc0b63c-c37e-4a75-9514-d9456fd59a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:11.765450 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0b63c-c37e-4a75-9514-d9456fd59a6c admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:11.765450 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0b63c-c37e-4a75-9514-d9456fd59a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:11.765450 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0b63c-c37e-4a75-9514-d9456fd59a6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:11.765450 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc0b63c-c37e-4a75-9514-d9456fd59a6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:11.765450 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc0b63c-c37e-4a75-9514-d9456fd59a6c admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:11.846677 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-411da292-bd21-4165-b77a-70ac90021008 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77472ae05a004b89a9f7b0b4b352dd46'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:11.984490 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 907/1790] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:34:11 2022] POST /identity/v3/projects => generated 379 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:34:11.985798 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc0b63c-c37e-4a75-9514-d9456fd59a6c admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:12.041302 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-411da292-bd21-4165-b77a-70ac90021008 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77472ae05a004b89a9f7b0b4b352dd46'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:12.077306 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-411da292-bd21-4165-b77a-70ac90021008 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77472ae05a004b89a9f7b0b4b352dd46'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:12.078256 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-411da292-bd21-4165-b77a-70ac90021008 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77472ae05a004b89a9f7b0b4b352dd46'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:12.081753 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc0b63c-c37e-4a75-9514-d9456fd59a6c admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:12.088309 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-411da292-bd21-4165-b77a-70ac90021008 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77472ae05a004b89a9f7b0b4b352dd46'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:12.089135 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fdb925-e3b6-4f77-97c8-6a60c5233177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:12.090574 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fdb925-e3b6-4f77-97c8-6a60c5233177 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:12.090909 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fdb925-e3b6-4f77-97c8-6a60c5233177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:12.091239 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fdb925-e3b6-4f77-97c8-6a60c5233177 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:12.092317 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fdb925-e3b6-4f77-97c8-6a60c5233177 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:12.094559 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fdb925-e3b6-4f77-97c8-6a60c5233177 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:12.116397 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 884/1791] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:34:11 2022] DELETE /identity/v3/users/77472ae05a004b89a9f7b0b4b352dd46 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:12.119739 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75390e27-6654-4aa9-80b2-80a988e56df1 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:12.120110 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75390e27-6654-4aa9-80b2-80a988e56df1 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:12.122554 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75390e27-6654-4aa9-80b2-80a988e56df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:12.184674 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-75390e27-6654-4aa9-80b2-80a988e56df1 None None] MFA Rules not processed for user `b1908b2f87d5442da8ba826489cb2018`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:12.186274 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-75390e27-6654-4aa9-80b2-80a988e56df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:12.229095 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 908/1792] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:34:11 2022] POST /identity/v3/projects => generated 405 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:34:12.231889 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fdb925-e3b6-4f77-97c8-6a60c5233177 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:12.242465 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-e6fdb925-e3b6-4f77-97c8-6a60c5233177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:12.335150 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 885/1793] 10.222.0.47 () {58 vars in 1015 bytes} [Thu Jul 21 19:34:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:12.336835 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75390e27-6654-4aa9-80b2-80a988e56df1 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:12.341514 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-75390e27-6654-4aa9-80b2-80a988e56df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:12.450895 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fdb925-e3b6-4f77-97c8-6a60c5233177 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:12.476515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac0ef4-1da0-44c1-aa03-1d0410eb2b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:12.476515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac0ef4-1da0-44c1-aa03-1d0410eb2b80 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:12.477756 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac0ef4-1da0-44c1-aa03-1d0410eb2b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:12.479190 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac0ef4-1da0-44c1-aa03-1d0410eb2b80 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:12.481315 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac0ef4-1da0-44c1-aa03-1d0410eb2b80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:12.487276 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac0ef4-1da0-44c1-aa03-1d0410eb2b80 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:12.500442 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75390e27-6654-4aa9-80b2-80a988e56df1 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:12.511506 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910550a-adb9-42bb-8202-6e38a7171c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:12.512440 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910550a-adb9-42bb-8202-6e38a7171c67 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:12.512785 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910550a-adb9-42bb-8202-6e38a7171c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:12.513134 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910550a-adb9-42bb-8202-6e38a7171c67 admin admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:12.513928 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6910550a-adb9-42bb-8202-6e38a7171c67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:12.517819 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6910550a-adb9-42bb-8202-6e38a7171c67 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:12.625614 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 909/1794] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:34:12 2022] POST /identity/v3/users => generated 290 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:34:12.625614 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac0ef4-1da0-44c1-aa03-1d0410eb2b80 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:12.626467 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-fdac0ef4-1da0-44c1-aa03-1d0410eb2b80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:12.635778 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 886/1795] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:34:12 2022] POST /identity/v3/users => generated 303 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:34:12.635778 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910550a-adb9-42bb-8202-6e38a7171c67 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:12.637488 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-6910550a-adb9-42bb-8202-6e38a7171c67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:12.732068 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac0ef4-1da0-44c1-aa03-1d0410eb2b80 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:12.734692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910550a-adb9-42bb-8202-6e38a7171c67 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:12.736254 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed4726-c91e-4096-a9c5-e0836140d1e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:12.736939 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed4726-c91e-4096-a9c5-e0836140d1e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:12.737286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed4726-c91e-4096-a9c5-e0836140d1e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:12.737570 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed4726-c91e-4096-a9c5-e0836140d1e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:12.740137 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f37765-b16a-480e-b06c-c3dc5dd0b467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:12.741130 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f37765-b16a-480e-b06c-c3dc5dd0b467 service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:12.741631 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f37765-b16a-480e-b06c-c3dc5dd0b467 service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:12.742095 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f37765-b16a-480e-b06c-c3dc5dd0b467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:12.751127 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed4726-c91e-4096-a9c5-e0836140d1e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:12.752541 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f37765-b16a-480e-b06c-c3dc5dd0b467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:12.752654 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed4726-c91e-4096-a9c5-e0836140d1e7 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:12.754865 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f37765-b16a-480e-b06c-c3dc5dd0b467 service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:12.761994 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 910/1796] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:34:12.762972 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed4726-c91e-4096-a9c5-e0836140d1e7 service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:12.779404 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 887/1797] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:34:12.779404 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f37765-b16a-480e-b06c-c3dc5dd0b467 service neutron] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:12.779404 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-f8f37765-b16a-480e-b06c-c3dc5dd0b467 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:12.780410 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed4726-c91e-4096-a9c5-e0836140d1e7 service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:12.780410 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21794bd2-36b0-43a4-bcec-96dbda0440dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:12.780410 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21794bd2-36b0-43a4-bcec-96dbda0440dc service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:12.780410 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21794bd2-36b0-43a4-bcec-96dbda0440dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:12.780686 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21794bd2-36b0-43a4-bcec-96dbda0440dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:12.782785 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f37765-b16a-480e-b06c-c3dc5dd0b467 service neutron] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:12.786847 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21794bd2-36b0-43a4-bcec-96dbda0440dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:12.792880 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f323cd-044d-40b6-b919-e94b9131820c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:12.793282 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21794bd2-36b0-43a4-bcec-96dbda0440dc service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:12.793765 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f323cd-044d-40b6-b919-e94b9131820c service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:12.794212 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f323cd-044d-40b6-b919-e94b9131820c service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:12.794522 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f323cd-044d-40b6-b919-e94b9131820c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:12.811468 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 911/1798] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:34:12.811468 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21794bd2-36b0-43a4-bcec-96dbda0440dc service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:12.812139 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f323cd-044d-40b6-b919-e94b9131820c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:12.831573 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f323cd-044d-40b6-b919-e94b9131820c service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:12.831694 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21794bd2-36b0-43a4-bcec-96dbda0440dc service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:12.831820 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 888/1799] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:34:12.831820 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f323cd-044d-40b6-b919-e94b9131820c service neutron] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:12.858755 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f323cd-044d-40b6-b919-e94b9131820c service neutron] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:12.863817 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbdfa7-ff29-4540-9898-495ef384376d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:12.864643 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbdfa7-ff29-4540-9898-495ef384376d admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:12.865419 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbdfa7-ff29-4540-9898-495ef384376d admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:12.865810 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbdfa7-ff29-4540-9898-495ef384376d admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:12.866831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cbdfa7-ff29-4540-9898-495ef384376d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:12.868565 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:12.873170 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cbdfa7-ff29-4540-9898-495ef384376d admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:12.873990 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321d79c-cce9-4f4b-84a4-17a5173b207e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:12.875862 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321d79c-cce9-4f4b-84a4-17a5173b207e admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:12.876867 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321d79c-cce9-4f4b-84a4-17a5173b207e admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:12.877698 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321d79c-cce9-4f4b-84a4-17a5173b207e admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:12.879144 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6321d79c-cce9-4f4b-84a4-17a5173b207e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:12.884906 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6321d79c-cce9-4f4b-84a4-17a5173b207e admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:12.907605 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 889/1800] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:12.908790 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbdfa7-ff29-4540-9898-495ef384376d admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:12.914658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 912/1801] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:12.916927 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321d79c-cce9-4f4b-84a4-17a5173b207e admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:12.940812 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbdfa7-ff29-4540-9898-495ef384376d admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:12.943421 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1961de-9ed3-4ecb-86c2-a6bef54c21f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:12.944314 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1961de-9ed3-4ecb-86c2-a6bef54c21f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:12.944617 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321d79c-cce9-4f4b-84a4-17a5173b207e admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:12.944795 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1961de-9ed3-4ecb-86c2-a6bef54c21f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:12.944952 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1961de-9ed3-4ecb-86c2-a6bef54c21f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:12.945987 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1961de-9ed3-4ecb-86c2-a6bef54c21f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:12.948190 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1961de-9ed3-4ecb-86c2-a6bef54c21f6 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:12.961987 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fafcb2d-660a-4990-a486-99391876d148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:12.963677 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fafcb2d-660a-4990-a486-99391876d148 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:12.963677 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fafcb2d-660a-4990-a486-99391876d148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:12.963677 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fafcb2d-660a-4990-a486-99391876d148 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:12.964414 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fafcb2d-660a-4990-a486-99391876d148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:12.966821 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fafcb2d-660a-4990-a486-99391876d148 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:12.983226 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 890/1802] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:12.984496 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1961de-9ed3-4ecb-86c2-a6bef54c21f6 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:12.989866 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 913/1803] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:12.992340 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fafcb2d-660a-4990-a486-99391876d148 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:13.019278 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1961de-9ed3-4ecb-86c2-a6bef54c21f6 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:13.025701 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec88b90e-bf4c-4bca-adf0-78acac615982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:13.026806 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88b90e-bf4c-4bca-adf0-78acac615982 admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:13.027243 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88b90e-bf4c-4bca-adf0-78acac615982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:13.040718 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88b90e-bf4c-4bca-adf0-78acac615982 admin admin] PATH_INFO: `/v3/projects/1ea17ee862334963a7032bb81129683f/users/ed8cb30911dc499d9f4f8edd7b37efb3/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:13.049587 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fafcb2d-660a-4990-a486-99391876d148 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:13.077294 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978890e1-b956-45a5-bf23-ba66e4247d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:13.078738 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978890e1-b956-45a5-bf23-ba66e4247d0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:13.079189 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978890e1-b956-45a5-bf23-ba66e4247d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:13.079663 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978890e1-b956-45a5-bf23-ba66e4247d0e admin admin] PATH_INFO: `/v3/projects/f48ad31f86d145a2affcf3612d6128b7/users/4d6b37a555484a7f99fb47baf486c886/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:13.093614 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec88b90e-bf4c-4bca-adf0-78acac615982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ea17ee862334963a7032bb81129683f, user_id=ed8cb30911dc499d9f4f8edd7b37efb3, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:13.099663 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec88b90e-bf4c-4bca-adf0-78acac615982 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:13.114495 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978890e1-b956-45a5-bf23-ba66e4247d0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f48ad31f86d145a2affcf3612d6128b7, user_id=4d6b37a555484a7f99fb47baf486c886, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:13.129000 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978890e1-b956-45a5-bf23-ba66e4247d0e admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:13.235030 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 891/1804] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:34:12 2022] PUT /identity/v3/projects/1ea17ee862334963a7032bb81129683f/users/ed8cb30911dc499d9f4f8edd7b37efb3/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:13.241579 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b565e-6978-4590-9909-b88448c7365c None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:13.241880 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b565e-6978-4590-9909-b88448c7365c None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:13.242174 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b565e-6978-4590-9909-b88448c7365c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:13.292458 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 914/1805] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:34:12 2022] PUT /identity/v3/projects/f48ad31f86d145a2affcf3612d6128b7/users/4d6b37a555484a7f99fb47baf486c886/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:34:13.309375 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-081b565e-6978-4590-9909-b88448c7365c None None] MFA Rules not processed for user `ed8cb30911dc499d9f4f8edd7b37efb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:13.310887 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-081b565e-6978-4590-9909-b88448c7365c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:13.313934 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c4775-dc14-4a1d-99b7-b84a9f0bc1b5 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:13.314135 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c4775-dc14-4a1d-99b7-b84a9f0bc1b5 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:13.316399 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c4775-dc14-4a1d-99b7-b84a9f0bc1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:13.402155 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-048c4775-dc14-4a1d-99b7-b84a9f0bc1b5 None None] MFA Rules not processed for user `4d6b37a555484a7f99fb47baf486c886`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:13.405825 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-048c4775-dc14-4a1d-99b7-b84a9f0bc1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:13.413524 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:13.456974 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 892/1806] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:13 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:34:13.461430 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b565e-6978-4590-9909-b88448c7365c None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:13.604526 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b565e-6978-4590-9909-b88448c7365c None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:13.614013 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 915/1807] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:13.618338 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c4775-dc14-4a1d-99b7-b84a9f0bc1b5 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:13.633123 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674c43b-6430-49f8-9e5e-9f67d23aaed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:13.633958 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674c43b-6430-49f8-9e5e-9f67d23aaed7 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:13.634160 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674c43b-6430-49f8-9e5e-9f67d23aaed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:13.634438 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674c43b-6430-49f8-9e5e-9f67d23aaed7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:13.638931 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674c43b-6430-49f8-9e5e-9f67d23aaed7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:13.647599 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674c43b-6430-49f8-9e5e-9f67d23aaed7 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:13.658347 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c4775-dc14-4a1d-99b7-b84a9f0bc1b5 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:13.669367 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375c690-7789-447b-9d33-bdbd76b895b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:13.672441 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375c690-7789-447b-9d33-bdbd76b895b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:13.672441 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375c690-7789-447b-9d33-bdbd76b895b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:13.672441 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375c690-7789-447b-9d33-bdbd76b895b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:13.672441 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9375c690-7789-447b-9d33-bdbd76b895b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:13.686305 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9375c690-7789-447b-9d33-bdbd76b895b7 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:13.791135 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 893/1808] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:34:13 2022] POST /identity/v3/projects => generated 407 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 19:34:13.795320 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674c43b-6430-49f8-9e5e-9f67d23aaed7 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:13.798813 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-3674c43b-6430-49f8-9e5e-9f67d23aaed7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:13.817941 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 916/1809] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:34:13 2022] POST /identity/v3/projects => generated 381 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:34:13.823039 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375c690-7789-447b-9d33-bdbd76b895b7 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:14.017193 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375c690-7789-447b-9d33-bdbd76b895b7 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:14.027373 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d995690-56b3-45cc-9062-274fba5f1179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:14.036832 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d995690-56b3-45cc-9062-274fba5f1179 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:14.036832 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d995690-56b3-45cc-9062-274fba5f1179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:14.036832 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d995690-56b3-45cc-9062-274fba5f1179 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:14.036832 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d995690-56b3-45cc-9062-274fba5f1179 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:14.036832 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d995690-56b3-45cc-9062-274fba5f1179 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:14.059922 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674c43b-6430-49f8-9e5e-9f67d23aaed7 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:14.066585 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ab67b-fd67-4b5d-9ee7-68ec34c3e729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:14.067706 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ab67b-fd67-4b5d-9ee7-68ec34c3e729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:14.068131 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ab67b-fd67-4b5d-9ee7-68ec34c3e729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:14.068498 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ab67b-fd67-4b5d-9ee7-68ec34c3e729 admin admin] PATH_INFO: `/v3/projects/a11ae42df9ef487a9558e26dfcfa4190` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:14.069924 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ab67b-fd67-4b5d-9ee7-68ec34c3e729 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a11ae42df9ef487a9558e26dfcfa4190)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:14.072139 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ab67b-fd67-4b5d-9ee7-68ec34c3e729 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:14.189104 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 917/1810] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:34:13 2022] POST /identity/v3/users => generated 310 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:34:14.193353 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d995690-56b3-45cc-9062-274fba5f1179 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:14.208962 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d995690-56b3-45cc-9062-274fba5f1179 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:14.217069 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8d478-60c3-44a7-8dad-ef2feb58f900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:14.217763 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8d478-60c3-44a7-8dad-ef2feb58f900 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:14.218052 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8d478-60c3-44a7-8dad-ef2feb58f900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:14.218335 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8d478-60c3-44a7-8dad-ef2feb58f900 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:14.219042 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8d478-60c3-44a7-8dad-ef2feb58f900 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:14.229486 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8d478-60c3-44a7-8dad-ef2feb58f900 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:14.281840 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-311ab67b-fd67-4b5d-9ee7-68ec34c3e729 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a11ae42df9ef487a9558e26dfcfa4190', 'request_id': 'req-311ab67b-fd67-4b5d-9ee7-68ec34c3e729'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:14.373331 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 918/1811] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:34:14 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:34:14.374285 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8d478-60c3-44a7-8dad-ef2feb58f900 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:14.389276 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8d478-60c3-44a7-8dad-ef2feb58f900 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:14.405667 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-311ab67b-fd67-4b5d-9ee7-68ec34c3e729 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a11ae42df9ef487a9558e26dfcfa4190', 'request_id': 'req-311ab67b-fd67-4b5d-9ee7-68ec34c3e729'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:14.413814 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-311ab67b-fd67-4b5d-9ee7-68ec34c3e729 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a11ae42df9ef487a9558e26dfcfa4190', 'request_id': 'req-311ab67b-fd67-4b5d-9ee7-68ec34c3e729'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:14.452161 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-311ab67b-fd67-4b5d-9ee7-68ec34c3e729 admin admin] The token cache is being invalidate because project a11ae42df9ef487a9558e26dfcfa4190 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:34:14.453643 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-311ab67b-fd67-4b5d-9ee7-68ec34c3e729 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:14.455658 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-311ab67b-fd67-4b5d-9ee7-68ec34c3e729 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:14.463878 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 894/1812] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:34:13 2022] DELETE /identity/v3/projects/a11ae42df9ef487a9558e26dfcfa4190 => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:14.463878 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ab67b-fd67-4b5d-9ee7-68ec34c3e729 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:14.470469 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-311ab67b-fd67-4b5d-9ee7-68ec34c3e729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:14.564674 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427dab0c-61d8-4b4f-8adf-bd24c9dbec6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:14.566960 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427dab0c-61d8-4b4f-8adf-bd24c9dbec6c admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:14.567748 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427dab0c-61d8-4b4f-8adf-bd24c9dbec6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:14.568785 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427dab0c-61d8-4b4f-8adf-bd24c9dbec6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:14.569973 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427dab0c-61d8-4b4f-8adf-bd24c9dbec6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:14.576617 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427dab0c-61d8-4b4f-8adf-bd24c9dbec6c admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:14.613618 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 919/1813] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:14.613618 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4a0dd-adf3-439e-937d-a0f4dcf66e89 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:14.613618 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4a0dd-adf3-439e-937d-a0f4dcf66e89 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:14.613618 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4a0dd-adf3-439e-937d-a0f4dcf66e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:14.665780 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ab67b-fd67-4b5d-9ee7-68ec34c3e729 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:14.666865 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-31f4a0dd-adf3-439e-937d-a0f4dcf66e89 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:14.668271 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-31f4a0dd-adf3-439e-937d-a0f4dcf66e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:14.691918 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109685c-2d7c-4f04-8154-4db7a69defc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:14.692995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109685c-2d7c-4f04-8154-4db7a69defc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:14.693202 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109685c-2d7c-4f04-8154-4db7a69defc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:14.693480 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109685c-2d7c-4f04-8154-4db7a69defc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:14.694228 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109685c-2d7c-4f04-8154-4db7a69defc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:14.695906 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109685c-2d7c-4f04-8154-4db7a69defc0 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:14.701884 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:14.708795 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 920/1814] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:14.709959 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4a0dd-adf3-439e-937d-a0f4dcf66e89 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:14.711636 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-31f4a0dd-adf3-439e-937d-a0f4dcf66e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:14.748459 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 895/1815] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:14.748660 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d691372-ab86-4951-ad1a-9b1c48ed94e7 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:14.748910 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d691372-ab86-4951-ad1a-9b1c48ed94e7 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:14.753783 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d691372-ab86-4951-ad1a-9b1c48ed94e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:14.773929 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4a0dd-adf3-439e-937d-a0f4dcf66e89 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:14.784789 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13716c3-1110-40e5-a4ff-4ae6b220f6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:14.788666 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13716c3-1110-40e5-a4ff-4ae6b220f6f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:14.789375 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13716c3-1110-40e5-a4ff-4ae6b220f6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:14.789757 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13716c3-1110-40e5-a4ff-4ae6b220f6f6 admin admin] PATH_INFO: `/v3/projects/65d1247a76d64a198ffae5e4310e3493/users/026bce6ce6ad4ca894dd523d02326f71/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:14.827281 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13716c3-1110-40e5-a4ff-4ae6b220f6f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65d1247a76d64a198ffae5e4310e3493, user_id=026bce6ce6ad4ca894dd523d02326f71, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:14.832828 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13716c3-1110-40e5-a4ff-4ae6b220f6f6 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:14.838065 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-0d691372-ab86-4951-ad1a-9b1c48ed94e7 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:14.840620 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-0d691372-ab86-4951-ad1a-9b1c48ed94e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:14.883986 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 896/1816] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:14.885358 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee082909-e3bc-46f9-b139-b443b9aee243 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:14.885782 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee082909-e3bc-46f9-b139-b443b9aee243 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:14.885924 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee082909-e3bc-46f9-b139-b443b9aee243 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:14.894752 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 897/1817] 10.222.0.60 () {54 vars in 921 bytes} [Thu Jul 21 19:34:14 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:34:14.898555 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee082909-e3bc-46f9-b139-b443b9aee243 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:14.951841 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee082909-e3bc-46f9-b139-b443b9aee243 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:14.975099 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925ecfa-1f6c-41ac-be2b-c4b2cfe05e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:14.976099 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925ecfa-1f6c-41ac-be2b-c4b2cfe05e52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:14.976326 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925ecfa-1f6c-41ac-be2b-c4b2cfe05e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:14.976801 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925ecfa-1f6c-41ac-be2b-c4b2cfe05e52 admin admin] PATH_INFO: `/v3/projects/55eccaed88ee44b1a9fd0f9d62dc042b/users/e9ac95dd8464408eaffec39d857f2217/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:14.985069 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 921/1818] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:34:14 2022] PUT /identity/v3/projects/65d1247a76d64a198ffae5e4310e3493/users/026bce6ce6ad4ca894dd523d02326f71/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:14.985069 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13716c3-1110-40e5-a4ff-4ae6b220f6f6 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:15.037904 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925ecfa-1f6c-41ac-be2b-c4b2cfe05e52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55eccaed88ee44b1a9fd0f9d62dc042b, user_id=e9ac95dd8464408eaffec39d857f2217, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:15.049233 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925ecfa-1f6c-41ac-be2b-c4b2cfe05e52 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:15.112758 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13716c3-1110-40e5-a4ff-4ae6b220f6f6 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:15.117778 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b599b91c-b984-49e9-b9b5-50a82d57d902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:15.118664 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599b91c-b984-49e9-b9b5-50a82d57d902 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:15.119035 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599b91c-b984-49e9-b9b5-50a82d57d902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:15.119398 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599b91c-b984-49e9-b9b5-50a82d57d902 admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:15.120236 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b599b91c-b984-49e9-b9b5-50a82d57d902 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:34:15.120656 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b599b91c-b984-49e9-b9b5-50a82d57d902 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:15.123082 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b599b91c-b984-49e9-b9b5-50a82d57d902 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:15.145062 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 898/1819] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:34:14 2022] PUT /identity/v3/projects/55eccaed88ee44b1a9fd0f9d62dc042b/users/e9ac95dd8464408eaffec39d857f2217/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:15.146984 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990cdbb8-6750-4a83-8b85-60aa82d17084 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:15.148032 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990cdbb8-6750-4a83-8b85-60aa82d17084 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:15.149155 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990cdbb8-6750-4a83-8b85-60aa82d17084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:15.160903 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 922/1820] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:34:15.161947 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b599b91c-b984-49e9-b9b5-50a82d57d902 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:15.200286 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-990cdbb8-6750-4a83-8b85-60aa82d17084 None None] MFA Rules not processed for user `6b4d98e967814e5f84f5f0d67ebb3c17`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:15.202237 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-990cdbb8-6750-4a83-8b85-60aa82d17084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:15.202521 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b599b91c-b984-49e9-b9b5-50a82d57d902 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:15.321732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 899/1821] 10.222.0.60 () {58 vars in 1018 bytes} [Thu Jul 21 19:34:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:15.322637 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990cdbb8-6750-4a83-8b85-60aa82d17084 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:15.348748 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27cda45-aac2-47a3-b739-c199bedda0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:15.355110 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cda45-aac2-47a3-b739-c199bedda0e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:15.355110 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cda45-aac2-47a3-b739-c199bedda0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:15.355110 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cda45-aac2-47a3-b739-c199bedda0e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:15.355110 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27cda45-aac2-47a3-b739-c199bedda0e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:15.355110 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27cda45-aac2-47a3-b739-c199bedda0e9 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:15.378387 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 923/1822] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:15.385720 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27cda45-aac2-47a3-b739-c199bedda0e9 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:15.395780 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27cda45-aac2-47a3-b739-c199bedda0e9 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:15.424830 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990cdbb8-6750-4a83-8b85-60aa82d17084 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:15.437440 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11c8b3-c96e-424e-9ded-b2b3a323c466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:15.437440 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11c8b3-c96e-424e-9ded-b2b3a323c466 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:15.437440 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11c8b3-c96e-424e-9ded-b2b3a323c466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:15.437440 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11c8b3-c96e-424e-9ded-b2b3a323c466 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:15.446778 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf11c8b3-c96e-424e-9ded-b2b3a323c466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:15.446778 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf11c8b3-c96e-424e-9ded-b2b3a323c466 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:15.446907 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8d17c-b20d-417e-abe0-dd9be21aa1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:15.446907 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8d17c-b20d-417e-abe0-dd9be21aa1c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:15.446907 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8d17c-b20d-417e-abe0-dd9be21aa1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:15.446907 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8d17c-b20d-417e-abe0-dd9be21aa1c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:15.447162 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8d17c-b20d-417e-abe0-dd9be21aa1c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:15.447162 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8d17c-b20d-417e-abe0-dd9be21aa1c6 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:15.448454 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 900/1823] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:15.449580 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11c8b3-c96e-424e-9ded-b2b3a323c466 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:15.451511 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-cf11c8b3-c96e-424e-9ded-b2b3a323c466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:15.498745 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11c8b3-c96e-424e-9ded-b2b3a323c466 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:15.519490 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058bb48-08e4-412c-9f93-0a7bdd7446fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:15.520282 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058bb48-08e4-412c-9f93-0a7bdd7446fe service nova] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:15.522023 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058bb48-08e4-412c-9f93-0a7bdd7446fe service nova] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:15.522393 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058bb48-08e4-412c-9f93-0a7bdd7446fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:15.545646 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2058bb48-08e4-412c-9f93-0a7bdd7446fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:15.547390 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2058bb48-08e4-412c-9f93-0a7bdd7446fe service nova] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:15.589495 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 901/1824] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:34:15.590732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058bb48-08e4-412c-9f93-0a7bdd7446fe service nova] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:15.628598 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 924/1825] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:34:15 2022] POST /identity/v3/projects => generated 379 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:34:15.628773 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058bb48-08e4-412c-9f93-0a7bdd7446fe service nova] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:15.628873 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8d17c-b20d-417e-abe0-dd9be21aa1c6 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:15.844677 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da639977-83bb-448f-a4d9-f88e04c17271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:15.847076 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da639977-83bb-448f-a4d9-f88e04c17271 admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:15.847076 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da639977-83bb-448f-a4d9-f88e04c17271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:15.847076 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da639977-83bb-448f-a4d9-f88e04c17271 admin admin] PATH_INFO: `/v3/projects/65d1247a76d64a198ffae5e4310e3493/users/026bce6ce6ad4ca894dd523d02326f71/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:15.853649 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da639977-83bb-448f-a4d9-f88e04c17271 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65d1247a76d64a198ffae5e4310e3493, user_id=026bce6ce6ad4ca894dd523d02326f71, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:15.857879 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da639977-83bb-448f-a4d9-f88e04c17271 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:15.887812 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8d17c-b20d-417e-abe0-dd9be21aa1c6 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:15.906296 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 902/1826] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:34:15 2022] PUT /identity/v3/projects/65d1247a76d64a198ffae5e4310e3493/users/026bce6ce6ad4ca894dd523d02326f71/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:15.908137 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da639977-83bb-448f-a4d9-f88e04c17271 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:16.092655 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da639977-83bb-448f-a4d9-f88e04c17271 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:16.111838 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3594dde-6832-43b2-8746-192e23386d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:16.114888 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3594dde-6832-43b2-8746-192e23386d17 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:16.115183 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3594dde-6832-43b2-8746-192e23386d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:16.115662 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3594dde-6832-43b2-8746-192e23386d17 admin admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:16.128177 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:16.128845 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3594dde-6832-43b2-8746-192e23386d17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:16.128845 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3594dde-6832-43b2-8746-192e23386d17 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:16.140439 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec9c85b-8378-4fbb-a5c7-c42fcd896842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:16.142755 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9c85b-8378-4fbb-a5c7-c42fcd896842 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:16.143723 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9c85b-8378-4fbb-a5c7-c42fcd896842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:16.144798 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9c85b-8378-4fbb-a5c7-c42fcd896842 admin admin] PATH_INFO: `/v3/projects/55eccaed88ee44b1a9fd0f9d62dc042b/users/e9ac95dd8464408eaffec39d857f2217/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:16.149585 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec9c85b-8378-4fbb-a5c7-c42fcd896842 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55eccaed88ee44b1a9fd0f9d62dc042b, user_id=e9ac95dd8464408eaffec39d857f2217, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:16.157978 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec9c85b-8378-4fbb-a5c7-c42fcd896842 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:16.198493 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 925/1827] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:34:15 2022] PUT /identity/v3/projects/55eccaed88ee44b1a9fd0f9d62dc042b/users/e9ac95dd8464408eaffec39d857f2217/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:16.205773 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e6a7f-bad7-4b82-a11e-e9c81d25cf3a None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:16.211568 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e6a7f-bad7-4b82-a11e-e9c81d25cf3a None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:16.211568 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e6a7f-bad7-4b82-a11e-e9c81d25cf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:16.249311 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-f46e6a7f-bad7-4b82-a11e-e9c81d25cf3a None None] MFA Rules not processed for user `026bce6ce6ad4ca894dd523d02326f71`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:16.250946 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f46e6a7f-bad7-4b82-a11e-e9c81d25cf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:16.269250 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 903/1828] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:34:15 2022] POST /identity/v3/users => generated 290 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:34:16.270675 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9ce7a-eb19-47b7-9d57-a7750e29ee85 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:16.271026 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9ce7a-eb19-47b7-9d57-a7750e29ee85 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:16.271316 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9ce7a-eb19-47b7-9d57-a7750e29ee85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:16.349325 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-54b9ce7a-eb19-47b7-9d57-a7750e29ee85 None None] MFA Rules not processed for user `e9ac95dd8464408eaffec39d857f2217`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:16.349325 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-54b9ce7a-eb19-47b7-9d57-a7750e29ee85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:16.406766 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 926/1829] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:16 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:16.409294 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e6a7f-bad7-4b82-a11e-e9c81d25cf3a None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:16.526654 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 904/1830] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:16 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:16.532652 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9ce7a-eb19-47b7-9d57-a7750e29ee85 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:16.536445 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-54b9ce7a-eb19-47b7-9d57-a7750e29ee85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:16.542539 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e6a7f-bad7-4b82-a11e-e9c81d25cf3a None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:16.569715 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b68c85-efd0-4426-a888-1470749c70dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:16.570403 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b68c85-efd0-4426-a888-1470749c70dc admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:16.570735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b68c85-efd0-4426-a888-1470749c70dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:16.571053 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b68c85-efd0-4426-a888-1470749c70dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:16.571871 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b68c85-efd0-4426-a888-1470749c70dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:16.573560 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b68c85-efd0-4426-a888-1470749c70dc admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:16.601228 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 927/1831] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:16 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:16.602145 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b68c85-efd0-4426-a888-1470749c70dc admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:16.648340 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b68c85-efd0-4426-a888-1470749c70dc admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:16.683589 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a75727-63c6-4ebb-b35a-7d6f288c5618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:16.683589 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a75727-63c6-4ebb-b35a-7d6f288c5618 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:16.683589 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a75727-63c6-4ebb-b35a-7d6f288c5618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:16.683589 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a75727-63c6-4ebb-b35a-7d6f288c5618 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:16.684002 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a75727-63c6-4ebb-b35a-7d6f288c5618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:16.684002 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a75727-63c6-4ebb-b35a-7d6f288c5618 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:16.725960 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 928/1832] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:16 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:16.728447 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a75727-63c6-4ebb-b35a-7d6f288c5618 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:16.732997 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9ce7a-eb19-47b7-9d57-a7750e29ee85 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:16.736211 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-56a75727-63c6-4ebb-b35a-7d6f288c5618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:16.748279 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cdf2e1-220c-42af-95d1-d7b8aa9ab086 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:16.749500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cdf2e1-220c-42af-95d1-d7b8aa9ab086 service cinder] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:16.749500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cdf2e1-220c-42af-95d1-d7b8aa9ab086 service cinder] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:16.749500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cdf2e1-220c-42af-95d1-d7b8aa9ab086 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:16.776100 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a75727-63c6-4ebb-b35a-7d6f288c5618 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:16.783281 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8eac4-fb40-46be-b88a-3f4223ff41a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:16.785249 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cdf2e1-220c-42af-95d1-d7b8aa9ab086 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:16.786715 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cdf2e1-220c-42af-95d1-d7b8aa9ab086 service cinder] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:16.787760 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8eac4-fb40-46be-b88a-3f4223ff41a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:16.788065 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8eac4-fb40-46be-b88a-3f4223ff41a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:16.789600 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8eac4-fb40-46be-b88a-3f4223ff41a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:16.831572 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 905/1833] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:16 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:34:16.832704 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cdf2e1-220c-42af-95d1-d7b8aa9ab086 service cinder] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:16.838722 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8eac4-fb40-46be-b88a-3f4223ff41a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:16.843218 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8eac4-fb40-46be-b88a-3f4223ff41a3 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:16.862927 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cdf2e1-220c-42af-95d1-d7b8aa9ab086 service cinder] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:16.877210 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9483134-a1a9-479a-8125-e43e532d5f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:16.884495 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9483134-a1a9-479a-8125-e43e532d5f73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:16.884495 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9483134-a1a9-479a-8125-e43e532d5f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:16.884495 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9483134-a1a9-479a-8125-e43e532d5f73 admin admin] PATH_INFO: `/v3/projects/1930e80bd0264435b4cd1544cf4de855/users/c7d53d6ef83c4fe1b57a2ed11ff2f396/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:16.884885 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 929/1834] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:16 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:34:16.953803 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9483134-a1a9-479a-8125-e43e532d5f73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1930e80bd0264435b4cd1544cf4de855, user_id=c7d53d6ef83c4fe1b57a2ed11ff2f396, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:16.958039 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9483134-a1a9-479a-8125-e43e532d5f73 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:17.091840 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 906/1835] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:34:16 2022] PUT /identity/v3/projects/1930e80bd0264435b4cd1544cf4de855/users/c7d53d6ef83c4fe1b57a2ed11ff2f396/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:17.104786 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5f4cc-b88b-4c2b-8c2f-4677bee48d7b None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:17.106385 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5f4cc-b88b-4c2b-8c2f-4677bee48d7b None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:17.106910 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5f4cc-b88b-4c2b-8c2f-4677bee48d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:17.168508 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-5ff5f4cc-b88b-4c2b-8c2f-4677bee48d7b None None] MFA Rules not processed for user `c7d53d6ef83c4fe1b57a2ed11ff2f396`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:17.170545 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-5ff5f4cc-b88b-4c2b-8c2f-4677bee48d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:17.360000 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 930/1836] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:34:17.364708 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9483134-a1a9-479a-8125-e43e532d5f73 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:17.534959 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9483134-a1a9-479a-8125-e43e532d5f73 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:17.550270 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5f4cc-b88b-4c2b-8c2f-4677bee48d7b None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:17.560979 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811c4a8-3023-4c80-a463-3066de646501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:17.561691 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811c4a8-3023-4c80-a463-3066de646501 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:17.562031 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811c4a8-3023-4c80-a463-3066de646501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:17.562343 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811c4a8-3023-4c80-a463-3066de646501 admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:17.563064 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0811c4a8-3023-4c80-a463-3066de646501 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:17.568373 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0811c4a8-3023-4c80-a463-3066de646501 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:17.673252 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5f4cc-b88b-4c2b-8c2f-4677bee48d7b None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:17.689304 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a60b3eb-2286-4753-a811-f270dd5d25c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:17.693029 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60b3eb-2286-4753-a811-f270dd5d25c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:17.693029 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60b3eb-2286-4753-a811-f270dd5d25c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:17.693029 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60b3eb-2286-4753-a811-f270dd5d25c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:17.696694 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-6a60b3eb-2286-4753-a811-f270dd5d25c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:17.730479 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 907/1837] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:34:17 2022] POST /identity/v3/projects => generated 379 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:34:17.732290 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811c4a8-3023-4c80-a463-3066de646501 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:17.864872 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811c4a8-3023-4c80-a463-3066de646501 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:17.879680 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6192b4-79ec-49cd-92b8-085d48adde5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:17.883917 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6192b4-79ec-49cd-92b8-085d48adde5c admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:17.884598 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6192b4-79ec-49cd-92b8-085d48adde5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:17.885620 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6192b4-79ec-49cd-92b8-085d48adde5c admin admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:17.896203 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6192b4-79ec-49cd-92b8-085d48adde5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:17.896203 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6192b4-79ec-49cd-92b8-085d48adde5c admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:17.906411 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a60b3eb-2286-4753-a811-f270dd5d25c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:17.913742 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a60b3eb-2286-4753-a811-f270dd5d25c5 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:17.914903 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:17.927298 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 931/1838] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:17 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 19:34:18.069836 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 908/1839] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:34:17 2022] POST /identity/v3/users => generated 296 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:34:18.072526 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a60b3eb-2286-4753-a811-f270dd5d25c5 service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:18.099842 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a60b3eb-2286-4753-a811-f270dd5d25c5 service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:18.124305 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2c231-015e-4a9c-8183-d4ebd7b290fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:18.128881 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2c231-015e-4a9c-8183-d4ebd7b290fa admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:18.129362 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2c231-015e-4a9c-8183-d4ebd7b290fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:18.129815 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2c231-015e-4a9c-8183-d4ebd7b290fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:18.132422 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2c231-015e-4a9c-8183-d4ebd7b290fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:18.135956 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2c231-015e-4a9c-8183-d4ebd7b290fa admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:18.158588 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 932/1840] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:18 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 19:34:18.162723 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6192b4-79ec-49cd-92b8-085d48adde5c admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:18.180409 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6192b4-79ec-49cd-92b8-085d48adde5c admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:18.187729 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93633da-18c7-4641-bc89-26bbf69fa0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:18.188959 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93633da-18c7-4641-bc89-26bbf69fa0e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:18.189698 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93633da-18c7-4641-bc89-26bbf69fa0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:18.190279 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93633da-18c7-4641-bc89-26bbf69fa0e4 admin admin] PATH_INFO: `/v3/projects/116701fd5ba6474e9aaaf87af9baf65d/users/46072ffb0d454d87a0786f9122495a0a/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:18.215775 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93633da-18c7-4641-bc89-26bbf69fa0e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=116701fd5ba6474e9aaaf87af9baf65d, user_id=46072ffb0d454d87a0786f9122495a0a, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:18.219072 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93633da-18c7-4641-bc89-26bbf69fa0e4 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:18.343185 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 909/1841] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:34:18 2022] PUT /identity/v3/projects/116701fd5ba6474e9aaaf87af9baf65d/users/46072ffb0d454d87a0786f9122495a0a/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:18.345855 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2c231-015e-4a9c-8183-d4ebd7b290fa admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:18.358146 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2c231-015e-4a9c-8183-d4ebd7b290fa admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:18.479921 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93633da-18c7-4641-bc89-26bbf69fa0e4 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:18.505744 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ee843-8e59-4339-84e0-3f1a2d7fd432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:18.507707 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ee843-8e59-4339-84e0-3f1a2d7fd432 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:18.509759 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ee843-8e59-4339-84e0-3f1a2d7fd432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:18.509759 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ee843-8e59-4339-84e0-3f1a2d7fd432 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:18.512874 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757ee843-8e59-4339-84e0-3f1a2d7fd432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:18.515044 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757ee843-8e59-4339-84e0-3f1a2d7fd432 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:18.535095 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 933/1842] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:18 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:18.535095 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ee843-8e59-4339-84e0-3f1a2d7fd432 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:18.551428 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ee843-8e59-4339-84e0-3f1a2d7fd432 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:18.560429 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:18.575109 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33fe554-4dd8-4bf3-b2c4-a81eb0bf3663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:18.577487 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fe554-4dd8-4bf3-b2c4-a81eb0bf3663 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:18.577730 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fe554-4dd8-4bf3-b2c4-a81eb0bf3663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:18.578015 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fe554-4dd8-4bf3-b2c4-a81eb0bf3663 admin admin] PATH_INFO: `/v3/projects/116701fd5ba6474e9aaaf87af9baf65d/users/46072ffb0d454d87a0786f9122495a0a/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:18.583270 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33fe554-4dd8-4bf3-b2c4-a81eb0bf3663 admin admin] RBAC: Authorizing `identity:create_grant(project_id=116701fd5ba6474e9aaaf87af9baf65d, user_id=46072ffb0d454d87a0786f9122495a0a, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:18.591741 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33fe554-4dd8-4bf3-b2c4-a81eb0bf3663 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:18.632092 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 934/1843] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:34:18 2022] PUT /identity/v3/projects/116701fd5ba6474e9aaaf87af9baf65d/users/46072ffb0d454d87a0786f9122495a0a/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:18.642830 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a1f3e-dbff-42d4-a2e5-8842980d0e2e None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:18.643126 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a1f3e-dbff-42d4-a2e5-8842980d0e2e None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:18.643691 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a1f3e-dbff-42d4-a2e5-8842980d0e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:18.652508 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93633da-18c7-4641-bc89-26bbf69fa0e4 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:18.766698 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8248b0e-65de-440b-b74b-3f98e0614af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:18.770020 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8248b0e-65de-440b-b74b-3f98e0614af0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:18.770020 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8248b0e-65de-440b-b74b-3f98e0614af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:18.772108 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8248b0e-65de-440b-b74b-3f98e0614af0 admin admin] PATH_INFO: `/v3/users/4d6b37a555484a7f99fb47baf486c886` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:18.774304 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8248b0e-65de-440b-b74b-3f98e0614af0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d6b37a555484a7f99fb47baf486c886)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:18.780156 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8248b0e-65de-440b-b74b-3f98e0614af0 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:18.786909 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-4a1a1f3e-dbff-42d4-a2e5-8842980d0e2e None None] MFA Rules not processed for user `46072ffb0d454d87a0786f9122495a0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:18.808695 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-4a1a1f3e-dbff-42d4-a2e5-8842980d0e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:19.010587 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:19.038840 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 935/1844] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:18 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:34:19.040725 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603664f-af58-4175-9fa4-7200a8019b1c None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:19.041179 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603664f-af58-4175-9fa4-7200a8019b1c None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:19.041678 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603664f-af58-4175-9fa4-7200a8019b1c None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:19.053088 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 936/1845] 10.222.0.60 () {54 vars in 921 bytes} [Thu Jul 21 19:34:19 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:34:19.053988 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603664f-af58-4175-9fa4-7200a8019b1c None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:19.151204 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-a8248b0e-65de-440b-b74b-3f98e0614af0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d6b37a555484a7f99fb47baf486c886'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:19.176733 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603664f-af58-4175-9fa4-7200a8019b1c None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:19.184149 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b67fd94-be60-4504-9867-bc0473db79ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:19.184912 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67fd94-be60-4504-9867-bc0473db79ce service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:19.185272 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67fd94-be60-4504-9867-bc0473db79ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:19.185624 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67fd94-be60-4504-9867-bc0473db79ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:19.197437 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b67fd94-be60-4504-9867-bc0473db79ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:19.199854 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b67fd94-be60-4504-9867-bc0473db79ce service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:19.212508 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 937/1846] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:19 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:34:19.226671 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-a8248b0e-65de-440b-b74b-3f98e0614af0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d6b37a555484a7f99fb47baf486c886'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:19.257529 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-a8248b0e-65de-440b-b74b-3f98e0614af0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d6b37a555484a7f99fb47baf486c886'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:19.265161 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-a8248b0e-65de-440b-b74b-3f98e0614af0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d6b37a555484a7f99fb47baf486c886'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:19.281723 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-a8248b0e-65de-440b-b74b-3f98e0614af0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d6b37a555484a7f99fb47baf486c886'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:19.295887 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 910/1847] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:34:18 2022] DELETE /identity/v3/users/4d6b37a555484a7f99fb47baf486c886 => generated 0 bytes in 816 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:19.300671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75ba1b-8fe7-4df4-a3ec-478fe723f826 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:19.300969 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75ba1b-8fe7-4df4-a3ec-478fe723f826 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:19.301233 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75ba1b-8fe7-4df4-a3ec-478fe723f826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:19.301332 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23f4a0-85c8-4dfb-baea-0141cd33ace0 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:19.301539 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23f4a0-85c8-4dfb-baea-0141cd33ace0 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:19.301821 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23f4a0-85c8-4dfb-baea-0141cd33ace0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:19.369583 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-de75ba1b-8fe7-4df4-a3ec-478fe723f826 None None] MFA Rules not processed for user `6b4d98e967814e5f84f5f0d67ebb3c17`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:19.381430 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-de75ba1b-8fe7-4df4-a3ec-478fe723f826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:19.384002 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-0a23f4a0-85c8-4dfb-baea-0141cd33ace0 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:19.387962 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-0a23f4a0-85c8-4dfb-baea-0141cd33ace0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:19.617120 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 911/1848] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:19.618878 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23f4a0-85c8-4dfb-baea-0141cd33ace0 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:19.622238 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-0a23f4a0-85c8-4dfb-baea-0141cd33ace0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:19.639985 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 938/1849] 10.222.0.60 () {58 vars in 1018 bytes} [Thu Jul 21 19:34:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:19.654738 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75ba1b-8fe7-4df4-a3ec-478fe723f826 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:19.656193 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-de75ba1b-8fe7-4df4-a3ec-478fe723f826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:19.775177 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23f4a0-85c8-4dfb-baea-0141cd33ace0 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:19.789946 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554fe814-1afd-4e9a-a22a-a063ec937cc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:19.789946 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fe814-1afd-4e9a-a22a-a063ec937cc6 service cinder] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:19.789946 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fe814-1afd-4e9a-a22a-a063ec937cc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:19.789946 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fe814-1afd-4e9a-a22a-a063ec937cc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:19.790358 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-554fe814-1afd-4e9a-a22a-a063ec937cc6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:19.825817 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75ba1b-8fe7-4df4-a3ec-478fe723f826 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:19.830962 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a5551-0b2c-4d77-a91d-475030675c97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:19.832565 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a5551-0b2c-4d77-a91d-475030675c97 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:19.833156 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a5551-0b2c-4d77-a91d-475030675c97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:19.833568 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a5551-0b2c-4d77-a91d-475030675c97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:19.894581 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a5551-0b2c-4d77-a91d-475030675c97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:19.899019 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a5551-0b2c-4d77-a91d-475030675c97 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:19.908294 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554fe814-1afd-4e9a-a22a-a063ec937cc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:19.911311 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554fe814-1afd-4e9a-a22a-a063ec937cc6 service cinder] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:19.936543 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 939/1850] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 19:34:19.937754 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a5551-0b2c-4d77-a91d-475030675c97 service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:19.939216 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-4e1a5551-0b2c-4d77-a91d-475030675c97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:19.944167 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 912/1851] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:34:19.963500 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a5551-0b2c-4d77-a91d-475030675c97 service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:19.964142 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc5e019-ad8f-4eff-9c1e-471e6c80234c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:19.965041 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5e019-ad8f-4eff-9c1e-471e6c80234c service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:19.965441 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5e019-ad8f-4eff-9c1e-471e6c80234c service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:19.965856 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5e019-ad8f-4eff-9c1e-471e6c80234c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:19.978311 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc5e019-ad8f-4eff-9c1e-471e6c80234c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:19.982496 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc5e019-ad8f-4eff-9c1e-471e6c80234c service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:19.998457 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 940/1852] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:34:21.222319 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554fe814-1afd-4e9a-a22a-a063ec937cc6 service cinder] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:21.222319 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-554fe814-1afd-4e9a-a22a-a063ec937cc6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:21.248016 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554fe814-1afd-4e9a-a22a-a063ec937cc6 service cinder] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:21.261103 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541dc34-4fb9-4bcc-ba53-223b279451f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:21.262640 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541dc34-4fb9-4bcc-ba53-223b279451f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:21.263063 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541dc34-4fb9-4bcc-ba53-223b279451f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:21.263350 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541dc34-4fb9-4bcc-ba53-223b279451f7 admin admin] PATH_INFO: `/v3/projects/f48ad31f86d145a2affcf3612d6128b7` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:21.264780 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3541dc34-4fb9-4bcc-ba53-223b279451f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f48ad31f86d145a2affcf3612d6128b7)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:21.266702 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3541dc34-4fb9-4bcc-ba53-223b279451f7 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:21.383186 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-3541dc34-4fb9-4bcc-ba53-223b279451f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f48ad31f86d145a2affcf3612d6128b7', 'request_id': 'req-3541dc34-4fb9-4bcc-ba53-223b279451f7'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:21.455825 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-3541dc34-4fb9-4bcc-ba53-223b279451f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f48ad31f86d145a2affcf3612d6128b7', 'request_id': 'req-3541dc34-4fb9-4bcc-ba53-223b279451f7'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:21.464337 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-3541dc34-4fb9-4bcc-ba53-223b279451f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f48ad31f86d145a2affcf3612d6128b7', 'request_id': 'req-3541dc34-4fb9-4bcc-ba53-223b279451f7'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:21.490563 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-3541dc34-4fb9-4bcc-ba53-223b279451f7 admin admin] The token cache is being invalidate because project f48ad31f86d145a2affcf3612d6128b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:34:21.490913 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-3541dc34-4fb9-4bcc-ba53-223b279451f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:21.502222 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-3541dc34-4fb9-4bcc-ba53-223b279451f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:21.502222 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 913/1853] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:34:21 2022] DELETE /identity/v3/projects/f48ad31f86d145a2affcf3612d6128b7 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:21.505241 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc5e019-ad8f-4eff-9c1e-471e6c80234c service nova] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:21.528515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc5e019-ad8f-4eff-9c1e-471e6c80234c service nova] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:21.558803 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:21.618092 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baecce44-c36e-4531-b633-4843cd2048f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:21.619279 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baecce44-c36e-4531-b633-4843cd2048f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:21.619738 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baecce44-c36e-4531-b633-4843cd2048f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:21.620261 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baecce44-c36e-4531-b633-4843cd2048f1 admin admin] PATH_INFO: `/v3/users/e9ac95dd8464408eaffec39d857f2217` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:21.622117 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baecce44-c36e-4531-b633-4843cd2048f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9ac95dd8464408eaffec39d857f2217)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:21.625250 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baecce44-c36e-4531-b633-4843cd2048f1 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:21.929736 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-baecce44-c36e-4531-b633-4843cd2048f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9ac95dd8464408eaffec39d857f2217'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:22.499084 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:22.500616 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-baecce44-c36e-4531-b633-4843cd2048f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9ac95dd8464408eaffec39d857f2217'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:22.501601 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-baecce44-c36e-4531-b633-4843cd2048f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9ac95dd8464408eaffec39d857f2217'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:22.509694 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-baecce44-c36e-4531-b633-4843cd2048f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9ac95dd8464408eaffec39d857f2217'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:22.525103 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-baecce44-c36e-4531-b633-4843cd2048f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9ac95dd8464408eaffec39d857f2217'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:22.532255 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 941/1854] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:34:21 2022] DELETE /identity/v3/users/e9ac95dd8464408eaffec39d857f2217 => generated 0 bytes in 1027 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:22.596440 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541dc34-4fb9-4bcc-ba53-223b279451f7 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:22.598683 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-3541dc34-4fb9-4bcc-ba53-223b279451f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:22.614429 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541dc34-4fb9-4bcc-ba53-223b279451f7 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:22.680866 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124dc577-d4f3-432c-8c68-57035563f667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:22.681858 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124dc577-d4f3-432c-8c68-57035563f667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:22.682212 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124dc577-d4f3-432c-8c68-57035563f667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:22.682555 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124dc577-d4f3-432c-8c68-57035563f667 admin admin] PATH_INFO: `/v3/users/4b993cba59d94d72b4f5635dc8fe6755` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:22.684360 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124dc577-d4f3-432c-8c68-57035563f667 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b993cba59d94d72b4f5635dc8fe6755)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:22.686390 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124dc577-d4f3-432c-8c68-57035563f667 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:22.962454 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-124dc577-d4f3-432c-8c68-57035563f667 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b993cba59d94d72b4f5635dc8fe6755'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:23.055878 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-124dc577-d4f3-432c-8c68-57035563f667 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b993cba59d94d72b4f5635dc8fe6755'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:23.073622 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-124dc577-d4f3-432c-8c68-57035563f667 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b993cba59d94d72b4f5635dc8fe6755'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:23.074762 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-124dc577-d4f3-432c-8c68-57035563f667 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b993cba59d94d72b4f5635dc8fe6755'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:23.099213 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-124dc577-d4f3-432c-8c68-57035563f667 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b993cba59d94d72b4f5635dc8fe6755'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:23.110067 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 914/1855] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:34:22 2022] DELETE /identity/v3/users/4b993cba59d94d72b4f5635dc8fe6755 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:23.114610 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ebebc-d104-4503-9554-637d1b46739d None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:23.114907 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ebebc-d104-4503-9554-637d1b46739d None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:23.115188 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ebebc-d104-4503-9554-637d1b46739d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:23.134958 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-514ebebc-d104-4503-9554-637d1b46739d None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:23.140496 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-514ebebc-d104-4503-9554-637d1b46739d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:23.218996 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 942/1856] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:34:23.239409 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124dc577-d4f3-432c-8c68-57035563f667 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:23.242689 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-124dc577-d4f3-432c-8c68-57035563f667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:23.309111 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124dc577-d4f3-432c-8c68-57035563f667 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:23.312945 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da58e83-46f7-40ed-bc4c-4d03817e89a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:23.313605 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da58e83-46f7-40ed-bc4c-4d03817e89a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:23.313891 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da58e83-46f7-40ed-bc4c-4d03817e89a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:23.314170 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da58e83-46f7-40ed-bc4c-4d03817e89a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:23.323496 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da58e83-46f7-40ed-bc4c-4d03817e89a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:23.325093 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da58e83-46f7-40ed-bc4c-4d03817e89a5 service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:23.349124 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 915/1857] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:34:23.349974 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ebebc-d104-4503-9554-637d1b46739d None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:23.351560 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-514ebebc-d104-4503-9554-637d1b46739d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:23.370134 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ebebc-d104-4503-9554-637d1b46739d None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:23.375898 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa76db-7558-45b9-ba1e-7bb103e60334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:23.376970 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa76db-7558-45b9-ba1e-7bb103e60334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:23.377066 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa76db-7558-45b9-ba1e-7bb103e60334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:23.377296 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa76db-7558-45b9-ba1e-7bb103e60334 admin admin] PATH_INFO: `/v3/projects/55eccaed88ee44b1a9fd0f9d62dc042b` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:23.378484 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa76db-7558-45b9-ba1e-7bb103e60334 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55eccaed88ee44b1a9fd0f9d62dc042b)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:23.380461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa76db-7558-45b9-ba1e-7bb103e60334 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:23.488564 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-e0aa76db-7558-45b9-ba1e-7bb103e60334 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55eccaed88ee44b1a9fd0f9d62dc042b', 'request_id': 'req-e0aa76db-7558-45b9-ba1e-7bb103e60334'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:23.495554 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-e0aa76db-7558-45b9-ba1e-7bb103e60334 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55eccaed88ee44b1a9fd0f9d62dc042b', 'request_id': 'req-e0aa76db-7558-45b9-ba1e-7bb103e60334'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:23.592773 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-e0aa76db-7558-45b9-ba1e-7bb103e60334 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55eccaed88ee44b1a9fd0f9d62dc042b', 'request_id': 'req-e0aa76db-7558-45b9-ba1e-7bb103e60334'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:23.605224 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-e0aa76db-7558-45b9-ba1e-7bb103e60334 admin admin] The token cache is being invalidate because project 55eccaed88ee44b1a9fd0f9d62dc042b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:34:23.605520 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-e0aa76db-7558-45b9-ba1e-7bb103e60334 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:23.606223 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-e0aa76db-7558-45b9-ba1e-7bb103e60334 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:23.607820 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 943/1858] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:34:23 2022] DELETE /identity/v3/projects/55eccaed88ee44b1a9fd0f9d62dc042b => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:23.612821 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debc5f6-45af-4ecf-9565-6b23a53f595a None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:23.613310 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debc5f6-45af-4ecf-9565-6b23a53f595a None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:23.613411 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debc5f6-45af-4ecf-9565-6b23a53f595a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:23.631603 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-5debc5f6-45af-4ecf-9565-6b23a53f595a None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:23.632787 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-5debc5f6-45af-4ecf-9565-6b23a53f595a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:23.695012 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 916/1859] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:23.703741 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837d596-d026-4edd-a781-85aa79419a77 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:23.704045 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837d596-d026-4edd-a781-85aa79419a77 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:23.704330 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837d596-d026-4edd-a781-85aa79419a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:23.723909 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-7837d596-d026-4edd-a781-85aa79419a77 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:23.725235 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-7837d596-d026-4edd-a781-85aa79419a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:23.734314 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 944/1860] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:23.738818 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debc5f6-45af-4ecf-9565-6b23a53f595a None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:23.749229 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debc5f6-45af-4ecf-9565-6b23a53f595a None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:23.753889 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6591f-a254-45ae-9250-7b494b21c26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:23.754546 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6591f-a254-45ae-9250-7b494b21c26a admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:23.754840 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6591f-a254-45ae-9250-7b494b21c26a admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:23.755121 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6591f-a254-45ae-9250-7b494b21c26a admin admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:23.755880 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd6591f-a254-45ae-9250-7b494b21c26a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:34:23.756193 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd6591f-a254-45ae-9250-7b494b21c26a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:23.757816 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd6591f-a254-45ae-9250-7b494b21c26a admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:23.770505 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 917/1861] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:34:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:34:23.774978 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837d596-d026-4edd-a781-85aa79419a77 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:23.785248 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837d596-d026-4edd-a781-85aa79419a77 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:23.790316 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6761141-3995-40a5-8347-d72d27616384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:23.790985 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6761141-3995-40a5-8347-d72d27616384 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:23.791274 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6761141-3995-40a5-8347-d72d27616384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:23.791583 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6761141-3995-40a5-8347-d72d27616384 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:23.792288 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6761141-3995-40a5-8347-d72d27616384 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:23.794631 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6761141-3995-40a5-8347-d72d27616384 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:23.959529 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 945/1862] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:34:23 2022] POST /identity/v3/projects => generated 383 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:34:23.963825 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6591f-a254-45ae-9250-7b494b21c26a admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:23.974149 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6591f-a254-45ae-9250-7b494b21c26a admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:24.035116 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184183a-7f74-44f4-871e-3e1ca8532d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:24.035803 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184183a-7f74-44f4-871e-3e1ca8532d7f admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:24.036094 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184183a-7f74-44f4-871e-3e1ca8532d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:24.036428 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184183a-7f74-44f4-871e-3e1ca8532d7f admin admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:24.037129 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5184183a-7f74-44f4-871e-3e1ca8532d7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:24.039146 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5184183a-7f74-44f4-871e-3e1ca8532d7f admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:24.160845 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 918/1863] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:34:23 2022] POST /identity/v3/users => generated 292 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:34:24.161776 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6761141-3995-40a5-8347-d72d27616384 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:24.174342 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6761141-3995-40a5-8347-d72d27616384 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:24.179958 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b5697-4a7e-49c6-a4f9-dc683181a6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:24.180833 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b5697-4a7e-49c6-a4f9-dc683181a6c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:24.181123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b5697-4a7e-49c6-a4f9-dc683181a6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:24.181400 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b5697-4a7e-49c6-a4f9-dc683181a6c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:24.182127 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b5697-4a7e-49c6-a4f9-dc683181a6c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:24.184457 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b5697-4a7e-49c6-a4f9-dc683181a6c3 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:24.195529 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 946/1864] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:24.200271 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184183a-7f74-44f4-871e-3e1ca8532d7f admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:24.210593 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184183a-7f74-44f4-871e-3e1ca8532d7f admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:24.215936 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f8a95-2ea0-4b06-84bf-cda2df87b11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:24.216651 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f8a95-2ea0-4b06-84bf-cda2df87b11b admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:24.216935 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f8a95-2ea0-4b06-84bf-cda2df87b11b admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:24.217215 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f8a95-2ea0-4b06-84bf-cda2df87b11b admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:24.217943 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f8a95-2ea0-4b06-84bf-cda2df87b11b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:24.219632 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f8a95-2ea0-4b06-84bf-cda2df87b11b admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:24.231606 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 919/1865] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:24.234294 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b5697-4a7e-49c6-a4f9-dc683181a6c3 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:24.244493 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b5697-4a7e-49c6-a4f9-dc683181a6c3 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:24.249974 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d612d7-f64b-4891-afd9-5fa2e3097438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:24.250864 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d612d7-f64b-4891-afd9-5fa2e3097438 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:24.251151 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d612d7-f64b-4891-afd9-5fa2e3097438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:24.251454 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d612d7-f64b-4891-afd9-5fa2e3097438 admin admin] PATH_INFO: `/v3/projects/7b0da5c37cfc4e098e47e0571a784630/users/5d4289f13d344a64bf98762324670f6a/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:24.267045 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d612d7-f64b-4891-afd9-5fa2e3097438 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b0da5c37cfc4e098e47e0571a784630, user_id=5d4289f13d344a64bf98762324670f6a, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:24.269811 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d612d7-f64b-4891-afd9-5fa2e3097438 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:24.306046 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f8a95-2ea0-4b06-84bf-cda2df87b11b admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:24.309620 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-146f8a95-2ea0-4b06-84bf-cda2df87b11b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:24.331019 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f8a95-2ea0-4b06-84bf-cda2df87b11b admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:24.340078 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4b228-60da-4d79-aa82-3bb404a83cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:24.341526 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4b228-60da-4d79-aa82-3bb404a83cd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:24.341917 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4b228-60da-4d79-aa82-3bb404a83cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:24.342486 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4b228-60da-4d79-aa82-3bb404a83cd3 admin admin] PATH_INFO: `/v3/projects/d72078bfc5be4aee803b12781f4eb728` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:24.344882 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc4b228-60da-4d79-aa82-3bb404a83cd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d72078bfc5be4aee803b12781f4eb728)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:24.348172 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc4b228-60da-4d79-aa82-3bb404a83cd3 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:24.368792 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 947/1866] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:34:24 2022] PUT /identity/v3/projects/7b0da5c37cfc4e098e47e0571a784630/users/5d4289f13d344a64bf98762324670f6a/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:24.381176 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05b4e1-4b92-4637-a4a9-2b0552730cc7 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:24.381469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05b4e1-4b92-4637-a4a9-2b0552730cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:24.381811 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05b4e1-4b92-4637-a4a9-2b0552730cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:24.422089 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-1a05b4e1-4b92-4637-a4a9-2b0552730cc7 None None] MFA Rules not processed for user `5d4289f13d344a64bf98762324670f6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:24.423286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-1a05b4e1-4b92-4637-a4a9-2b0552730cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:24.536212 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 948/1867] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:34:24.547890 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a05b4e1-4b92-4637-a4a9-2b0552730cc7 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:24.549325 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-1a05b4e1-4b92-4637-a4a9-2b0552730cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:24.579722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-1cc4b228-60da-4d79-aa82-3bb404a83cd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd72078bfc5be4aee803b12781f4eb728', 'request_id': 'req-1cc4b228-60da-4d79-aa82-3bb404a83cd3'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:24.620162 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a05b4e1-4b92-4637-a4a9-2b0552730cc7 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:24.670180 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4dde85-7d52-47fe-8647-42a71d774b4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:24.670842 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4dde85-7d52-47fe-8647-42a71d774b4b service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:24.671154 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4dde85-7d52-47fe-8647-42a71d774b4b service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:24.671428 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4dde85-7d52-47fe-8647-42a71d774b4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:24.675292 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-1cc4b228-60da-4d79-aa82-3bb404a83cd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd72078bfc5be4aee803b12781f4eb728', 'request_id': 'req-1cc4b228-60da-4d79-aa82-3bb404a83cd3'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:24.681868 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-1cc4b228-60da-4d79-aa82-3bb404a83cd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd72078bfc5be4aee803b12781f4eb728', 'request_id': 'req-1cc4b228-60da-4d79-aa82-3bb404a83cd3'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:24.698624 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-1cc4b228-60da-4d79-aa82-3bb404a83cd3 admin admin] The token cache is being invalidate because project d72078bfc5be4aee803b12781f4eb728 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:34:24.698922 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-1cc4b228-60da-4d79-aa82-3bb404a83cd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:24.699635 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-1cc4b228-60da-4d79-aa82-3bb404a83cd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:24.701656 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 920/1868] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:34:24 2022] DELETE /identity/v3/projects/d72078bfc5be4aee803b12781f4eb728 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:24.706041 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4b228-60da-4d79-aa82-3bb404a83cd3 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:24.707694 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-1cc4b228-60da-4d79-aa82-3bb404a83cd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:24.762074 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4dde85-7d52-47fe-8647-42a71d774b4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:24.763754 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4dde85-7d52-47fe-8647-42a71d774b4b service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:24.774040 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 949/1869] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 19:34:24.784930 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4b228-60da-4d79-aa82-3bb404a83cd3 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:24.793899 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82dcf0c-4234-40c0-a5d5-6af491fc5c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:24.793899 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82dcf0c-4234-40c0-a5d5-6af491fc5c1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:24.793899 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82dcf0c-4234-40c0-a5d5-6af491fc5c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:24.793899 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82dcf0c-4234-40c0-a5d5-6af491fc5c1e admin admin] PATH_INFO: `/v3/users/a568112cc43440ae81c162a601539354` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:24.794210 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82dcf0c-4234-40c0-a5d5-6af491fc5c1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a568112cc43440ae81c162a601539354)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:24.797396 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4dde85-7d52-47fe-8647-42a71d774b4b service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:24.798205 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82dcf0c-4234-40c0-a5d5-6af491fc5c1e admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:24.808676 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4dde85-7d52-47fe-8647-42a71d774b4b service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:24.813509 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae6fe4-f507-4a1c-a466-feaf590ff83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:24.814435 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae6fe4-f507-4a1c-a466-feaf590ff83e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:24.815036 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae6fe4-f507-4a1c-a466-feaf590ff83e admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:24.815376 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae6fe4-f507-4a1c-a466-feaf590ff83e admin admin] PATH_INFO: `/v3/users/5d4289f13d344a64bf98762324670f6a` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:24.816935 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae6fe4-f507-4a1c-a466-feaf590ff83e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d4289f13d344a64bf98762324670f6a)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:24.818843 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae6fe4-f507-4a1c-a466-feaf590ff83e admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:24.969704 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:25.050672 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-2fae6fe4-f507-4a1c-a466-feaf590ff83e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d4289f13d344a64bf98762324670f6a'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:25.080468 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-b82dcf0c-4234-40c0-a5d5-6af491fc5c1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a568112cc43440ae81c162a601539354'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:25.121391 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-2fae6fe4-f507-4a1c-a466-feaf590ff83e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d4289f13d344a64bf98762324670f6a'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:25.122040 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-2fae6fe4-f507-4a1c-a466-feaf590ff83e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d4289f13d344a64bf98762324670f6a'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:25.129452 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-2fae6fe4-f507-4a1c-a466-feaf590ff83e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d4289f13d344a64bf98762324670f6a'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:25.143501 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-2fae6fe4-f507-4a1c-a466-feaf590ff83e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d4289f13d344a64bf98762324670f6a'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:25.149555 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 950/1870] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:34:24 2022] DELETE /identity/v3/users/5d4289f13d344a64bf98762324670f6a => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:25.154804 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a574218-75ab-4af0-874b-fa0ae0d41b45 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:25.155098 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a574218-75ab-4af0-874b-fa0ae0d41b45 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:25.155384 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a574218-75ab-4af0-874b-fa0ae0d41b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:25.173524 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-9a574218-75ab-4af0-874b-fa0ae0d41b45 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:25.174730 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-9a574218-75ab-4af0-874b-fa0ae0d41b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:25.201034 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-b82dcf0c-4234-40c0-a5d5-6af491fc5c1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a568112cc43440ae81c162a601539354'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:25.213417 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-b82dcf0c-4234-40c0-a5d5-6af491fc5c1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a568112cc43440ae81c162a601539354'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:25.214178 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-b82dcf0c-4234-40c0-a5d5-6af491fc5c1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a568112cc43440ae81c162a601539354'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:25.221711 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-b82dcf0c-4234-40c0-a5d5-6af491fc5c1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a568112cc43440ae81c162a601539354'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:25.227886 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 921/1871] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:34:24 2022] DELETE /identity/v3/users/a568112cc43440ae81c162a601539354 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:25.235102 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 951/1872] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:34:25.244819 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82dcf0c-4234-40c0-a5d5-6af491fc5c1e admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:25.246596 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-b82dcf0c-4234-40c0-a5d5-6af491fc5c1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:25.317591 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82dcf0c-4234-40c0-a5d5-6af491fc5c1e admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:25.321540 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e8e0b-bcf5-4b87-a41a-71220bf4cd8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:25.324944 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e8e0b-bcf5-4b87-a41a-71220bf4cd8c service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:25.324944 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e8e0b-bcf5-4b87-a41a-71220bf4cd8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:25.324944 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e8e0b-bcf5-4b87-a41a-71220bf4cd8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:25.378523 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:25.388753 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e8e0b-bcf5-4b87-a41a-71220bf4cd8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:25.390199 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e8e0b-bcf5-4b87-a41a-71220bf4cd8c service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:25.400042 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 922/1873] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:34:25.900333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a574218-75ab-4af0-874b-fa0ae0d41b45 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:25.901905 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-9a574218-75ab-4af0-874b-fa0ae0d41b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:25.915145 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a574218-75ab-4af0-874b-fa0ae0d41b45 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:25.921348 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e31b40-e473-4135-9a07-3e1ce22cf34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:25.922846 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e31b40-e473-4135-9a07-3e1ce22cf34f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:25.923375 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e31b40-e473-4135-9a07-3e1ce22cf34f admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:25.924867 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e31b40-e473-4135-9a07-3e1ce22cf34f admin admin] PATH_INFO: `/v3/projects/4312cd67c3be4fcc9ec5f217234fb9c4` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:25.926948 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e31b40-e473-4135-9a07-3e1ce22cf34f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4312cd67c3be4fcc9ec5f217234fb9c4)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:25.929283 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e31b40-e473-4135-9a07-3e1ce22cf34f admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:25.987415 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e8e0b-bcf5-4b87-a41a-71220bf4cd8c service neutron] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:25.989405 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-637e8e0b-bcf5-4b87-a41a-71220bf4cd8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:26.008427 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e8e0b-bcf5-4b87-a41a-71220bf4cd8c service neutron] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:26.014942 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485dcbb7-43e0-4c45-81ff-fdbab6038fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:26.015978 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485dcbb7-43e0-4c45-81ff-fdbab6038fc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:26.016380 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485dcbb7-43e0-4c45-81ff-fdbab6038fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:26.018281 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485dcbb7-43e0-4c45-81ff-fdbab6038fc5 admin admin] PATH_INFO: `/v3/projects/7b0da5c37cfc4e098e47e0571a784630` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:26.020531 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485dcbb7-43e0-4c45-81ff-fdbab6038fc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b0da5c37cfc4e098e47e0571a784630)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:26.023933 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485dcbb7-43e0-4c45-81ff-fdbab6038fc5 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:26.081521 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-75e31b40-e473-4135-9a07-3e1ce22cf34f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4312cd67c3be4fcc9ec5f217234fb9c4', 'request_id': 'req-75e31b40-e473-4135-9a07-3e1ce22cf34f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:26.089568 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-75e31b40-e473-4135-9a07-3e1ce22cf34f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4312cd67c3be4fcc9ec5f217234fb9c4', 'request_id': 'req-75e31b40-e473-4135-9a07-3e1ce22cf34f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:26.242302 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-75e31b40-e473-4135-9a07-3e1ce22cf34f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4312cd67c3be4fcc9ec5f217234fb9c4', 'request_id': 'req-75e31b40-e473-4135-9a07-3e1ce22cf34f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:26.263534 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-75e31b40-e473-4135-9a07-3e1ce22cf34f admin admin] The token cache is being invalidate because project 4312cd67c3be4fcc9ec5f217234fb9c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:34:26.263830 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-75e31b40-e473-4135-9a07-3e1ce22cf34f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:26.264530 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-75e31b40-e473-4135-9a07-3e1ce22cf34f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:26.266143 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 952/1874] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:34:25 2022] DELETE /identity/v3/projects/4312cd67c3be4fcc9ec5f217234fb9c4 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:26.269784 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-485dcbb7-43e0-4c45-81ff-fdbab6038fc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b0da5c37cfc4e098e47e0571a784630', 'request_id': 'req-485dcbb7-43e0-4c45-81ff-fdbab6038fc5'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:26.270812 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdcc92b-c7b6-4392-89ce-d36acc8a2b81 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:26.271383 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdcc92b-c7b6-4392-89ce-d36acc8a2b81 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:26.271675 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdcc92b-c7b6-4392-89ce-d36acc8a2b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:26.292707 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-3fdcc92b-c7b6-4392-89ce-d36acc8a2b81 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:26.294261 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3fdcc92b-c7b6-4392-89ce-d36acc8a2b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:26.365699 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 953/1875] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:26.366798 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdcc92b-c7b6-4392-89ce-d36acc8a2b81 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:26.368544 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3fdcc92b-c7b6-4392-89ce-d36acc8a2b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:26.383792 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdcc92b-c7b6-4392-89ce-d36acc8a2b81 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:26.390184 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f109b-e93e-4b08-af00-ebcdf4772704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:26.391499 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f109b-e93e-4b08-af00-ebcdf4772704 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:26.391936 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f109b-e93e-4b08-af00-ebcdf4772704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:26.392358 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f109b-e93e-4b08-af00-ebcdf4772704 admin admin] PATH_INFO: `/v3/users/ed8cb30911dc499d9f4f8edd7b37efb3` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:26.393841 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f109b-e93e-4b08-af00-ebcdf4772704 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed8cb30911dc499d9f4f8edd7b37efb3)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:26.397209 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f109b-e93e-4b08-af00-ebcdf4772704 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:26.423956 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-485dcbb7-43e0-4c45-81ff-fdbab6038fc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b0da5c37cfc4e098e47e0571a784630', 'request_id': 'req-485dcbb7-43e0-4c45-81ff-fdbab6038fc5'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:26.423956 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-485dcbb7-43e0-4c45-81ff-fdbab6038fc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b0da5c37cfc4e098e47e0571a784630', 'request_id': 'req-485dcbb7-43e0-4c45-81ff-fdbab6038fc5'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:26.429414 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-485dcbb7-43e0-4c45-81ff-fdbab6038fc5 admin admin] The token cache is being invalidate because project 7b0da5c37cfc4e098e47e0571a784630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:34:26.429706 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-485dcbb7-43e0-4c45-81ff-fdbab6038fc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:26.431486 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-485dcbb7-43e0-4c45-81ff-fdbab6038fc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:26.437894 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 923/1876] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:34:25 2022] DELETE /identity/v3/projects/7b0da5c37cfc4e098e47e0571a784630 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:34:26.437894 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae374bf-0269-454a-a7fb-8342df330722 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:26.437894 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae374bf-0269-454a-a7fb-8342df330722 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:26.437894 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae374bf-0269-454a-a7fb-8342df330722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:26.459287 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-aae374bf-0269-454a-a7fb-8342df330722 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:26.460696 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-aae374bf-0269-454a-a7fb-8342df330722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:26.473731 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 924/1877] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:26.475564 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201f515-e6e4-45e2-8dcc-83843a9f0c05 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:26.476191 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201f515-e6e4-45e2-8dcc-83843a9f0c05 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:26.476773 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201f515-e6e4-45e2-8dcc-83843a9f0c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:26.503857 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-4201f515-e6e4-45e2-8dcc-83843a9f0c05 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:26.505616 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-4201f515-e6e4-45e2-8dcc-83843a9f0c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:26.516020 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 925/1878] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:26.517172 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201f515-e6e4-45e2-8dcc-83843a9f0c05 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:26.530880 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:26.534687 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201f515-e6e4-45e2-8dcc-83843a9f0c05 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:26.539597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b563664-18d5-45c3-b509-39cf32d485e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:26.540266 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b563664-18d5-45c3-b509-39cf32d485e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:26.540551 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b563664-18d5-45c3-b509-39cf32d485e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:26.540828 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b563664-18d5-45c3-b509-39cf32d485e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:26.541685 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b563664-18d5-45c3-b509-39cf32d485e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:34:26.541994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b563664-18d5-45c3-b509-39cf32d485e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:26.544195 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b563664-18d5-45c3-b509-39cf32d485e4 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:26.558651 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 926/1879] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:34:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:34:26.562529 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27afc9b1-f5d3-4b30-94d1-b10ecee9626d None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:26.562529 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27afc9b1-f5d3-4b30-94d1-b10ecee9626d None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:26.562529 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27afc9b1-f5d3-4b30-94d1-b10ecee9626d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:26.579107 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-27afc9b1-f5d3-4b30-94d1-b10ecee9626d None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:26.580369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-27afc9b1-f5d3-4b30-94d1-b10ecee9626d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:26.589277 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 927/1880] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:26.590918 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27afc9b1-f5d3-4b30-94d1-b10ecee9626d None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:26.601788 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27afc9b1-f5d3-4b30-94d1-b10ecee9626d None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:26.610288 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac436c3f-62e1-4f13-9c0f-f891554ed5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:26.611068 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac436c3f-62e1-4f13-9c0f-f891554ed5e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:26.611417 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac436c3f-62e1-4f13-9c0f-f891554ed5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:26.611735 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac436c3f-62e1-4f13-9c0f-f891554ed5e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:26.613889 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac436c3f-62e1-4f13-9c0f-f891554ed5e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:26.614488 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac436c3f-62e1-4f13-9c0f-f891554ed5e5 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:26.649021 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-186f109b-e93e-4b08-af00-ebcdf4772704 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed8cb30911dc499d9f4f8edd7b37efb3'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:26.735478 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 928/1881] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:34:26 2022] POST /identity/v3/projects => generated 387 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:34:26.735710 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac436c3f-62e1-4f13-9c0f-f891554ed5e5 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:26.746939 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-186f109b-e93e-4b08-af00-ebcdf4772704 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed8cb30911dc499d9f4f8edd7b37efb3'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:26.749074 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-186f109b-e93e-4b08-af00-ebcdf4772704 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed8cb30911dc499d9f4f8edd7b37efb3'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:26.760524 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-186f109b-e93e-4b08-af00-ebcdf4772704 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed8cb30911dc499d9f4f8edd7b37efb3'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:26.786241 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-186f109b-e93e-4b08-af00-ebcdf4772704 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed8cb30911dc499d9f4f8edd7b37efb3'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:26.806400 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 954/1882] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:34:26 2022] DELETE /identity/v3/users/ed8cb30911dc499d9f4f8edd7b37efb3 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:26.807750 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f109b-e93e-4b08-af00-ebcdf4772704 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:26.811607 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-186f109b-e93e-4b08-af00-ebcdf4772704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:26.837611 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac436c3f-62e1-4f13-9c0f-f891554ed5e5 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:26.903052 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f109b-e93e-4b08-af00-ebcdf4772704 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:26.913569 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7346ce-2b0c-4e7f-8ad0-e7afbc17a264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:26.914424 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7346ce-2b0c-4e7f-8ad0-e7afbc17a264 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:26.914755 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7346ce-2b0c-4e7f-8ad0-e7afbc17a264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:26.915284 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7346ce-2b0c-4e7f-8ad0-e7afbc17a264 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:26.916138 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7346ce-2b0c-4e7f-8ad0-e7afbc17a264 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:26.923855 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7346ce-2b0c-4e7f-8ad0-e7afbc17a264 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:26.928649 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf562ebf-5400-49ba-9653-9314f4c37ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:26.928889 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:26.929952 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf562ebf-5400-49ba-9653-9314f4c37ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:26.936434 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf562ebf-5400-49ba-9653-9314f4c37ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:26.936898 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf562ebf-5400-49ba-9653-9314f4c37ee5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:26.941919 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf562ebf-5400-49ba-9653-9314f4c37ee5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:34:26.941919 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf562ebf-5400-49ba-9653-9314f4c37ee5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:26.941919 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf562ebf-5400-49ba-9653-9314f4c37ee5 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:26.953498 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 929/1883] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:34:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:34:26.958128 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf62281-f08e-4eee-a5bb-8943e14a9fff None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:26.958516 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf62281-f08e-4eee-a5bb-8943e14a9fff None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:26.958848 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf62281-f08e-4eee-a5bb-8943e14a9fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:26.976787 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-bcf62281-f08e-4eee-a5bb-8943e14a9fff None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:26.978004 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-bcf62281-f08e-4eee-a5bb-8943e14a9fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:26.986551 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 930/1884] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:26.987344 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf62281-f08e-4eee-a5bb-8943e14a9fff None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:26.988608 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-bcf62281-f08e-4eee-a5bb-8943e14a9fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:27.001155 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf62281-f08e-4eee-a5bb-8943e14a9fff None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:27.005788 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa07df6-e5bc-439f-930d-6da30abe68b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:27.006444 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa07df6-e5bc-439f-930d-6da30abe68b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:27.006728 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa07df6-e5bc-439f-930d-6da30abe68b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:27.007003 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa07df6-e5bc-439f-930d-6da30abe68b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:27.007746 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa07df6-e5bc-439f-930d-6da30abe68b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:27.009630 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa07df6-e5bc-439f-930d-6da30abe68b7 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:27.035489 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 955/1885] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:34:26 2022] POST /identity/v3/users => generated 294 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:34:27.036940 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7346ce-2b0c-4e7f-8ad0-e7afbc17a264 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:27.037968 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ce7346ce-2b0c-4e7f-8ad0-e7afbc17a264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:27.098371 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7346ce-2b0c-4e7f-8ad0-e7afbc17a264 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:27.102054 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07f06c-b76a-4de3-87af-a090384ae83a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:27.102702 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07f06c-b76a-4de3-87af-a090384ae83a service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:27.103013 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07f06c-b76a-4de3-87af-a090384ae83a service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:27.103293 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07f06c-b76a-4de3-87af-a090384ae83a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:27.112977 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f07f06c-b76a-4de3-87af-a090384ae83a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:27.114594 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f07f06c-b76a-4de3-87af-a090384ae83a service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:27.126615 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 956/1886] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:34:27.129279 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07f06c-b76a-4de3-87af-a090384ae83a service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:27.132946 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 931/1887] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:34:26 2022] POST /identity/v3/projects => generated 373 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:34:27.134004 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa07df6-e5bc-439f-930d-6da30abe68b7 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:27.138155 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07f06c-b76a-4de3-87af-a090384ae83a service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:27.205574 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeaed55-caaa-42f4-8c4e-a9341215865c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:27.206396 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeaed55-caaa-42f4-8c4e-a9341215865c admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:27.206742 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeaed55-caaa-42f4-8c4e-a9341215865c admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:27.207031 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeaed55-caaa-42f4-8c4e-a9341215865c admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:27.208401 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeaed55-caaa-42f4-8c4e-a9341215865c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:27.210316 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeaed55-caaa-42f4-8c4e-a9341215865c admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:27.211623 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa07df6-e5bc-439f-930d-6da30abe68b7 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:27.216886 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a0754-2630-43d9-967d-f34a509a0e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:27.217566 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a0754-2630-43d9-967d-f34a509a0e49 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:27.217847 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a0754-2630-43d9-967d-f34a509a0e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:27.218206 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a0754-2630-43d9-967d-f34a509a0e49 admin admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:27.219179 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385a0754-2630-43d9-967d-f34a509a0e49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:27.220959 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385a0754-2630-43d9-967d-f34a509a0e49 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:27.221529 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 957/1888] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:27.225309 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeaed55-caaa-42f4-8c4e-a9341215865c admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:27.237438 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeaed55-caaa-42f4-8c4e-a9341215865c admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:27.242807 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24944a9f-27a5-4cca-b8e2-1c4f3f9a6f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:27.243609 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24944a9f-27a5-4cca-b8e2-1c4f3f9a6f7f admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:27.243900 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24944a9f-27a5-4cca-b8e2-1c4f3f9a6f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:27.244176 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24944a9f-27a5-4cca-b8e2-1c4f3f9a6f7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:27.244925 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24944a9f-27a5-4cca-b8e2-1c4f3f9a6f7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:27.247054 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24944a9f-27a5-4cca-b8e2-1c4f3f9a6f7f admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:27.257651 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 958/1889] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 19:34:27.269718 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24944a9f-27a5-4cca-b8e2-1c4f3f9a6f7f admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:27.272888 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24944a9f-27a5-4cca-b8e2-1c4f3f9a6f7f admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:27.277956 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76311e6e-bc1b-4042-961d-c739c714f7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:27.278886 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76311e6e-bc1b-4042-961d-c739c714f7ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:27.279176 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76311e6e-bc1b-4042-961d-c739c714f7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:27.279493 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76311e6e-bc1b-4042-961d-c739c714f7ae admin admin] PATH_INFO: `/v3/projects/831d5de3983d4061a8c3558b3e16e147/users/be72f104a97245b6bfb46056829dfc63/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:27.297547 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76311e6e-bc1b-4042-961d-c739c714f7ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=831d5de3983d4061a8c3558b3e16e147, user_id=be72f104a97245b6bfb46056829dfc63, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:27.300246 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76311e6e-bc1b-4042-961d-c739c714f7ae admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:27.351926 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 932/1890] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:34:27 2022] POST /identity/v3/users => generated 287 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:34:27.356618 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a0754-2630-43d9-967d-f34a509a0e49 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:27.366501 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a0754-2630-43d9-967d-f34a509a0e49 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:27.371874 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3d2b8-ffe4-4cc5-a500-5ae95516cfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:27.372534 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3d2b8-ffe4-4cc5-a500-5ae95516cfb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:27.372894 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3d2b8-ffe4-4cc5-a500-5ae95516cfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:27.373101 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3d2b8-ffe4-4cc5-a500-5ae95516cfb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:27.373824 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde3d2b8-ffe4-4cc5-a500-5ae95516cfb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:27.375424 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde3d2b8-ffe4-4cc5-a500-5ae95516cfb1 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:27.385672 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 933/1891] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 19:34:27.399509 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3d2b8-ffe4-4cc5-a500-5ae95516cfb1 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:27.410236 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3d2b8-ffe4-4cc5-a500-5ae95516cfb1 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:27.415582 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99927c07-3187-4d7b-9b85-48aa2499307f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:27.416270 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99927c07-3187-4d7b-9b85-48aa2499307f admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:27.416554 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99927c07-3187-4d7b-9b85-48aa2499307f admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:27.416834 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99927c07-3187-4d7b-9b85-48aa2499307f admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:27.418113 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99927c07-3187-4d7b-9b85-48aa2499307f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:27.424368 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99927c07-3187-4d7b-9b85-48aa2499307f admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:27.431552 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 934/1892] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 19:34:27.436690 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99927c07-3187-4d7b-9b85-48aa2499307f admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:27.447011 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99927c07-3187-4d7b-9b85-48aa2499307f admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:27.451814 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2a12a-96b9-4b10-8ae5-7a13206a8fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:27.452717 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2a12a-96b9-4b10-8ae5-7a13206a8fd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:27.453004 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2a12a-96b9-4b10-8ae5-7a13206a8fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:27.453279 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2a12a-96b9-4b10-8ae5-7a13206a8fd3 admin admin] PATH_INFO: `/v3/projects/e6a0ce7066f54225b3ffc215c9afc379/users/6e97e0a76f9f444c9c1974c0494eba67/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:27.472159 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2a12a-96b9-4b10-8ae5-7a13206a8fd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6a0ce7066f54225b3ffc215c9afc379, user_id=6e97e0a76f9f444c9c1974c0494eba67, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:27.475663 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2a12a-96b9-4b10-8ae5-7a13206a8fd3 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:27.659205 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 959/1893] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:34:27 2022] PUT /identity/v3/projects/831d5de3983d4061a8c3558b3e16e147/users/be72f104a97245b6bfb46056829dfc63/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:34:27.774099 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672144d-edbb-4ed5-8cc1-0e047e8d428c None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:27.774389 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672144d-edbb-4ed5-8cc1-0e047e8d428c None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:27.774669 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672144d-edbb-4ed5-8cc1-0e047e8d428c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:27.807952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-2672144d-edbb-4ed5-8cc1-0e047e8d428c None None] MFA Rules not processed for user `be72f104a97245b6bfb46056829dfc63`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:27.809160 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-2672144d-edbb-4ed5-8cc1-0e047e8d428c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:27.902715 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 960/1894] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:27.904005 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672144d-edbb-4ed5-8cc1-0e047e8d428c None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:27.975517 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672144d-edbb-4ed5-8cc1-0e047e8d428c None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:27.981380 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1c5c7-f2c3-4f18-8850-60e70a695f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:27.982330 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1c5c7-f2c3-4f18-8850-60e70a695f51 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:27.982819 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1c5c7-f2c3-4f18-8850-60e70a695f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:27.983527 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1c5c7-f2c3-4f18-8850-60e70a695f51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:27.984442 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e1c5c7-f2c3-4f18-8850-60e70a695f51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:27.988657 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e1c5c7-f2c3-4f18-8850-60e70a695f51 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:28.540160 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 935/1895] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:34:27 2022] PUT /identity/v3/projects/e6a0ce7066f54225b3ffc215c9afc379/users/6e97e0a76f9f444c9c1974c0494eba67/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 1104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:34:28.550926 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a53076-5931-45b0-a4f0-fe5e69e1be1e None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:28.551137 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a53076-5931-45b0-a4f0-fe5e69e1be1e None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:28.551605 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a53076-5931-45b0-a4f0-fe5e69e1be1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:28.592279 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-b3a53076-5931-45b0-a4f0-fe5e69e1be1e None None] MFA Rules not processed for user `6e97e0a76f9f444c9c1974c0494eba67`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:28.594086 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-b3a53076-5931-45b0-a4f0-fe5e69e1be1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:28.599001 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 961/1896] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:34:27 2022] POST /identity/v3/projects => generated 387 bytes in 696 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 19:34:28.603468 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1c5c7-f2c3-4f18-8850-60e70a695f51 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:28.711128 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1c5c7-f2c3-4f18-8850-60e70a695f51 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:28.720576 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c8d75-1924-4788-a995-717a475fba37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:28.721346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c8d75-1924-4788-a995-717a475fba37 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:28.725521 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c8d75-1924-4788-a995-717a475fba37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:28.725521 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c8d75-1924-4788-a995-717a475fba37 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:28.725521 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c8d75-1924-4788-a995-717a475fba37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:28.726021 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c8d75-1924-4788-a995-717a475fba37 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:28.729080 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 936/1897] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:28.742589 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a53076-5931-45b0-a4f0-fe5e69e1be1e None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:28.744482 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-b3a53076-5931-45b0-a4f0-fe5e69e1be1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:28.819594 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 962/1898] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:34:28 2022] POST /identity/v3/users => generated 300 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 19:34:28.820856 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c8d75-1924-4788-a995-717a475fba37 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:28.823127 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-e88c8d75-1924-4788-a995-717a475fba37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:28.845173 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a53076-5931-45b0-a4f0-fe5e69e1be1e None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:28.848088 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c8d75-1924-4788-a995-717a475fba37 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:28.860446 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494bff55-7e39-4805-b54a-f95f87610f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:28.861464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494bff55-7e39-4805-b54a-f95f87610f57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:28.861981 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494bff55-7e39-4805-b54a-f95f87610f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:28.862894 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494bff55-7e39-4805-b54a-f95f87610f57 admin admin] PATH_INFO: `/v3/projects/1ea17ee862334963a7032bb81129683f` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:28.866064 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494bff55-7e39-4805-b54a-f95f87610f57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ea17ee862334963a7032bb81129683f)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:28.868678 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494bff55-7e39-4805-b54a-f95f87610f57 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:28.930868 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3528edb-a12b-4969-94ad-9c4e85613da9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:28.931622 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3528edb-a12b-4969-94ad-9c4e85613da9 service cinder] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:28.932814 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3528edb-a12b-4969-94ad-9c4e85613da9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:28.933193 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3528edb-a12b-4969-94ad-9c4e85613da9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:29.034015 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3528edb-a12b-4969-94ad-9c4e85613da9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:29.036010 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3528edb-a12b-4969-94ad-9c4e85613da9 service cinder] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:29.036757 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-494bff55-7e39-4805-b54a-f95f87610f57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ea17ee862334963a7032bb81129683f', 'request_id': 'req-494bff55-7e39-4805-b54a-f95f87610f57'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:29.057693 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 937/1899] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:34:29.058844 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-494bff55-7e39-4805-b54a-f95f87610f57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ea17ee862334963a7032bb81129683f', 'request_id': 'req-494bff55-7e39-4805-b54a-f95f87610f57'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:29.070317 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3528edb-a12b-4969-94ad-9c4e85613da9 service cinder] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:29.085827 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3528edb-a12b-4969-94ad-9c4e85613da9 service cinder] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:29.149523 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-494bff55-7e39-4805-b54a-f95f87610f57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ea17ee862334963a7032bb81129683f', 'request_id': 'req-494bff55-7e39-4805-b54a-f95f87610f57'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:29.172010 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-494bff55-7e39-4805-b54a-f95f87610f57 admin admin] The token cache is being invalidate because project 1ea17ee862334963a7032bb81129683f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:34:29.173417 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-494bff55-7e39-4805-b54a-f95f87610f57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:29.173895 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-494bff55-7e39-4805-b54a-f95f87610f57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:29.184083 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 963/1900] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:34:28 2022] DELETE /identity/v3/projects/1ea17ee862334963a7032bb81129683f => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:29.186076 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efce5b4-9af9-4a27-9732-d5769e08b1ca None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:29.186763 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efce5b4-9af9-4a27-9732-d5769e08b1ca None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:29.187278 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efce5b4-9af9-4a27-9732-d5769e08b1ca None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:29.188196 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480fc859-a202-4766-a95a-718c6d5db620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:29.188946 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480fc859-a202-4766-a95a-718c6d5db620 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:29.189251 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480fc859-a202-4766-a95a-718c6d5db620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:29.189893 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480fc859-a202-4766-a95a-718c6d5db620 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:29.190490 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480fc859-a202-4766-a95a-718c6d5db620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:29.191611 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 964/1901] 10.222.0.60 () {54 vars in 921 bytes} [Thu Jul 21 19:34:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:34:29.192283 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480fc859-a202-4766-a95a-718c6d5db620 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:29.193696 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efce5b4-9af9-4a27-9732-d5769e08b1ca None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:29.195840 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-9efce5b4-9af9-4a27-9732-d5769e08b1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:29.221632 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 938/1902] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:29.224257 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85417b03-fba0-4e88-b88e-f8c3de4a6191 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:29.224522 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85417b03-fba0-4e88-b88e-f8c3de4a6191 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:29.225100 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85417b03-fba0-4e88-b88e-f8c3de4a6191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:29.232686 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efce5b4-9af9-4a27-9732-d5769e08b1ca None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:29.245251 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01812b1e-b71e-4dd0-bb65-03d81fe1ac80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:29.245981 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01812b1e-b71e-4dd0-bb65-03d81fe1ac80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:29.245981 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01812b1e-b71e-4dd0-bb65-03d81fe1ac80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:29.246318 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01812b1e-b71e-4dd0-bb65-03d81fe1ac80 admin admin] PATH_INFO: `/v3/users/026bce6ce6ad4ca894dd523d02326f71` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:29.249250 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01812b1e-b71e-4dd0-bb65-03d81fe1ac80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=026bce6ce6ad4ca894dd523d02326f71)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:29.251247 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01812b1e-b71e-4dd0-bb65-03d81fe1ac80 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:29.260065 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-85417b03-fba0-4e88-b88e-f8c3de4a6191 None None] MFA Rules not processed for user `6b4d98e967814e5f84f5f0d67ebb3c17`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:29.262908 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-85417b03-fba0-4e88-b88e-f8c3de4a6191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:29.440455 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 939/1903] 10.222.0.60 () {58 vars in 1018 bytes} [Thu Jul 21 19:34:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:29.441500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85417b03-fba0-4e88-b88e-f8c3de4a6191 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:29.446877 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-85417b03-fba0-4e88-b88e-f8c3de4a6191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:29.471058 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85417b03-fba0-4e88-b88e-f8c3de4a6191 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:29.475887 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962d711-74a1-4183-b4be-96c5146ee4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:29.477057 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962d711-74a1-4183-b4be-96c5146ee4f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:29.477343 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962d711-74a1-4183-b4be-96c5146ee4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:29.477632 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962d711-74a1-4183-b4be-96c5146ee4f3 admin admin] PATH_INFO: `/v3/projects/c47dd573bc984f9588f088ab2b9599f2/users/67d72de90f3b413eac2c944b9d4114e3/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:29.493172 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3962d711-74a1-4183-b4be-96c5146ee4f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c47dd573bc984f9588f088ab2b9599f2, user_id=67d72de90f3b413eac2c944b9d4114e3, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:29.496497 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3962d711-74a1-4183-b4be-96c5146ee4f3 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:29.530813 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-01812b1e-b71e-4dd0-bb65-03d81fe1ac80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '026bce6ce6ad4ca894dd523d02326f71'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:29.623877 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 940/1904] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:34:29 2022] PUT /identity/v3/projects/c47dd573bc984f9588f088ab2b9599f2/users/67d72de90f3b413eac2c944b9d4114e3/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:29.625264 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962d711-74a1-4183-b4be-96c5146ee4f3 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:29.627931 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-3962d711-74a1-4183-b4be-96c5146ee4f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:29.647217 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-01812b1e-b71e-4dd0-bb65-03d81fe1ac80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '026bce6ce6ad4ca894dd523d02326f71'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:29.647922 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-01812b1e-b71e-4dd0-bb65-03d81fe1ac80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '026bce6ce6ad4ca894dd523d02326f71'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:29.657223 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-01812b1e-b71e-4dd0-bb65-03d81fe1ac80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '026bce6ce6ad4ca894dd523d02326f71'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:29.672207 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-01812b1e-b71e-4dd0-bb65-03d81fe1ac80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '026bce6ce6ad4ca894dd523d02326f71'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:29.679002 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 965/1905] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:34:29 2022] DELETE /identity/v3/users/026bce6ce6ad4ca894dd523d02326f71 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:29.680215 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01812b1e-b71e-4dd0-bb65-03d81fe1ac80 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:29.681879 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-01812b1e-b71e-4dd0-bb65-03d81fe1ac80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:29.735147 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962d711-74a1-4183-b4be-96c5146ee4f3 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:29.739690 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:29.811696 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01812b1e-b71e-4dd0-bb65-03d81fe1ac80 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:29.817730 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091346f1-c40f-4f5a-9f5d-6ff16552bfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:29.818407 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091346f1-c40f-4f5a-9f5d-6ff16552bfe4 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:29.818695 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091346f1-c40f-4f5a-9f5d-6ff16552bfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:29.818971 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091346f1-c40f-4f5a-9f5d-6ff16552bfe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:29.819822 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091346f1-c40f-4f5a-9f5d-6ff16552bfe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:29.821515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091346f1-c40f-4f5a-9f5d-6ff16552bfe4 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:29.833071 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 966/1906] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:29.834423 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88075331-0bd1-492f-85ed-317d5348210b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:29.835102 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88075331-0bd1-492f-85ed-317d5348210b service nova] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:29.835461 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88075331-0bd1-492f-85ed-317d5348210b service nova] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:29.835772 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88075331-0bd1-492f-85ed-317d5348210b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:29.837369 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091346f1-c40f-4f5a-9f5d-6ff16552bfe4 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:29.837662 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-88075331-0bd1-492f-85ed-317d5348210b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:29.850910 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091346f1-c40f-4f5a-9f5d-6ff16552bfe4 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:29.851114 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88075331-0bd1-492f-85ed-317d5348210b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:29.852672 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88075331-0bd1-492f-85ed-317d5348210b service nova] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:29.856679 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cbe6bb-0c89-4e0c-a183-13678d2c64f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:29.857764 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cbe6bb-0c89-4e0c-a183-13678d2c64f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:29.858234 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cbe6bb-0c89-4e0c-a183-13678d2c64f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:29.858670 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cbe6bb-0c89-4e0c-a183-13678d2c64f2 admin admin] PATH_INFO: `/v3/projects/c47dd573bc984f9588f088ab2b9599f2/users/67d72de90f3b413eac2c944b9d4114e3/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:29.861032 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cbe6bb-0c89-4e0c-a183-13678d2c64f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c47dd573bc984f9588f088ab2b9599f2, user_id=67d72de90f3b413eac2c944b9d4114e3, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:29.864088 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cbe6bb-0c89-4e0c-a183-13678d2c64f2 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:29.865759 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 941/1907] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:34:29.875359 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 967/1908] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:34:29 2022] PUT /identity/v3/projects/c47dd573bc984f9588f088ab2b9599f2/users/67d72de90f3b413eac2c944b9d4114e3/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:34:29.894121 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb2390-c63e-4cf9-a456-09d745479028 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:29.894423 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb2390-c63e-4cf9-a456-09d745479028 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:29.894706 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb2390-c63e-4cf9-a456-09d745479028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:29.942086 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-15eb2390-c63e-4cf9-a456-09d745479028 None None] MFA Rules not processed for user `67d72de90f3b413eac2c944b9d4114e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:29.944794 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-15eb2390-c63e-4cf9-a456-09d745479028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:30.023491 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 942/1909] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:29 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:30.035720 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cbe6bb-0c89-4e0c-a183-13678d2c64f2 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:30.038974 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-95cbe6bb-0c89-4e0c-a183-13678d2c64f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:30.136676 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:30.152676 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cbe6bb-0c89-4e0c-a183-13678d2c64f2 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:30.156717 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e474dbf-9ac5-48c0-9a8a-cee34383b0aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:30.157391 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e474dbf-9ac5-48c0-9a8a-cee34383b0aa service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:30.157674 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e474dbf-9ac5-48c0-9a8a-cee34383b0aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:30.157954 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e474dbf-9ac5-48c0-9a8a-cee34383b0aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:30.168762 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e474dbf-9ac5-48c0-9a8a-cee34383b0aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:30.170280 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e474dbf-9ac5-48c0-9a8a-cee34383b0aa service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:30.181113 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 968/1910] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:30 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:34:30.270404 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb2390-c63e-4cf9-a456-09d745479028 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:30.335865 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e474dbf-9ac5-48c0-9a8a-cee34383b0aa service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:30.337525 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-4e474dbf-9ac5-48c0-9a8a-cee34383b0aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:30.409826 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb2390-c63e-4cf9-a456-09d745479028 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:30.425060 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5fbcb-ebaa-4d5f-87c5-65203762dec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:30.425060 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5fbcb-ebaa-4d5f-87c5-65203762dec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:30.425060 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5fbcb-ebaa-4d5f-87c5-65203762dec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:30.425060 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5fbcb-ebaa-4d5f-87c5-65203762dec0 admin admin] PATH_INFO: `/v3/users/be72f104a97245b6bfb46056829dfc63` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:30.425400 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd5fbcb-ebaa-4d5f-87c5-65203762dec0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be72f104a97245b6bfb46056829dfc63)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:30.430241 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd5fbcb-ebaa-4d5f-87c5-65203762dec0 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:30.496515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e474dbf-9ac5-48c0-9a8a-cee34383b0aa service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:30.510230 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6e984-0321-42ac-af67-f5a99731f092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:30.513392 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6e984-0321-42ac-af67-f5a99731f092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:30.513607 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6e984-0321-42ac-af67-f5a99731f092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:30.513919 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6e984-0321-42ac-af67-f5a99731f092 admin admin] PATH_INFO: `/v3/projects/65d1247a76d64a198ffae5e4310e3493` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:30.516585 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6e984-0321-42ac-af67-f5a99731f092 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65d1247a76d64a198ffae5e4310e3493)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:30.520795 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6e984-0321-42ac-af67-f5a99731f092 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:30.680015 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-9dd5fbcb-ebaa-4d5f-87c5-65203762dec0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be72f104a97245b6bfb46056829dfc63'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:30.770744 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-fea6e984-0321-42ac-af67-f5a99731f092 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65d1247a76d64a198ffae5e4310e3493', 'request_id': 'req-fea6e984-0321-42ac-af67-f5a99731f092'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:30.773937 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-9dd5fbcb-ebaa-4d5f-87c5-65203762dec0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be72f104a97245b6bfb46056829dfc63'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:30.789118 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-fea6e984-0321-42ac-af67-f5a99731f092 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65d1247a76d64a198ffae5e4310e3493', 'request_id': 'req-fea6e984-0321-42ac-af67-f5a99731f092'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:30.793611 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-9dd5fbcb-ebaa-4d5f-87c5-65203762dec0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be72f104a97245b6bfb46056829dfc63'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:30.794352 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-9dd5fbcb-ebaa-4d5f-87c5-65203762dec0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be72f104a97245b6bfb46056829dfc63'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:30.801990 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-9dd5fbcb-ebaa-4d5f-87c5-65203762dec0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be72f104a97245b6bfb46056829dfc63'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:30.808300 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 943/1911] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:34:30 2022] DELETE /identity/v3/users/be72f104a97245b6bfb46056829dfc63 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:30.812674 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83386ce5-266b-4c7d-8e7a-a8485f533592 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:30.812970 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83386ce5-266b-4c7d-8e7a-a8485f533592 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:30.813692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83386ce5-266b-4c7d-8e7a-a8485f533592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:30.831327 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-83386ce5-266b-4c7d-8e7a-a8485f533592 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:30.832564 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-83386ce5-266b-4c7d-8e7a-a8485f533592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:30.880381 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-fea6e984-0321-42ac-af67-f5a99731f092 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65d1247a76d64a198ffae5e4310e3493', 'request_id': 'req-fea6e984-0321-42ac-af67-f5a99731f092'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:30.897226 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-fea6e984-0321-42ac-af67-f5a99731f092 admin admin] The token cache is being invalidate because project 65d1247a76d64a198ffae5e4310e3493 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:34:30.898216 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-fea6e984-0321-42ac-af67-f5a99731f092 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:30.899013 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-fea6e984-0321-42ac-af67-f5a99731f092 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:30.904898 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 969/1912] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:34:30 2022] DELETE /identity/v3/projects/65d1247a76d64a198ffae5e4310e3493 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:30.923021 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 944/1913] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:34:30.924671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac2ec3-0325-4e8c-8b49-4268be334d41 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:30.924967 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac2ec3-0325-4e8c-8b49-4268be334d41 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:30.925251 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac2ec3-0325-4e8c-8b49-4268be334d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:30.936046 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83386ce5-266b-4c7d-8e7a-a8485f533592 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:30.938617 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-83386ce5-266b-4c7d-8e7a-a8485f533592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:30.983368 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-d8ac2ec3-0325-4e8c-8b49-4268be334d41 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:30.986311 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-d8ac2ec3-0325-4e8c-8b49-4268be334d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:31.000577 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 970/1914] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:31.008349 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d48703-fa62-41c8-92e3-321c9ac51bc6 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:31.008649 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d48703-fa62-41c8-92e3-321c9ac51bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:31.008959 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d48703-fa62-41c8-92e3-321c9ac51bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:31.014674 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83386ce5-266b-4c7d-8e7a-a8485f533592 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:31.018360 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bee769-3718-4879-9cd2-91e7e8239fd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:31.019252 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bee769-3718-4879-9cd2-91e7e8239fd3 service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:31.019665 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bee769-3718-4879-9cd2-91e7e8239fd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:31.019768 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bee769-3718-4879-9cd2-91e7e8239fd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:31.031339 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bee769-3718-4879-9cd2-91e7e8239fd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:31.034261 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bee769-3718-4879-9cd2-91e7e8239fd3 service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:31.038959 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-a0d48703-fa62-41c8-92e3-321c9ac51bc6 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:31.040276 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-a0d48703-fa62-41c8-92e3-321c9ac51bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:31.046225 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 945/1915] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:34:31.052439 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 971/1916] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:31.055678 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bee769-3718-4879-9cd2-91e7e8239fd3 service neutron] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:31.067186 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bee769-3718-4879-9cd2-91e7e8239fd3 service neutron] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:31.072077 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6b40b-272c-4cd3-afbe-a7a7d0e0a8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:31.072790 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6b40b-272c-4cd3-afbe-a7a7d0e0a8c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:31.073100 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6b40b-272c-4cd3-afbe-a7a7d0e0a8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:31.073381 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6b40b-272c-4cd3-afbe-a7a7d0e0a8c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:31.074761 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6b40b-272c-4cd3-afbe-a7a7d0e0a8c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:34:31.075067 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6b40b-272c-4cd3-afbe-a7a7d0e0a8c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:31.076859 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6b40b-272c-4cd3-afbe-a7a7d0e0a8c0 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:31.098416 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 946/1917] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:34:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:34:31.102606 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d48703-fa62-41c8-92e3-321c9ac51bc6 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:31.112605 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d48703-fa62-41c8-92e3-321c9ac51bc6 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:31.118208 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40489a9f-e6fa-4b30-ae87-9806ab31d2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:31.119046 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40489a9f-e6fa-4b30-ae87-9806ab31d2cb admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:31.119506 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40489a9f-e6fa-4b30-ae87-9806ab31d2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:31.119973 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40489a9f-e6fa-4b30-ae87-9806ab31d2cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:31.120840 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40489a9f-e6fa-4b30-ae87-9806ab31d2cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:31.124609 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40489a9f-e6fa-4b30-ae87-9806ab31d2cb admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:31.211745 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 972/1918] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:34:31 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 19:34:31.216375 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6b40b-272c-4cd3-afbe-a7a7d0e0a8c0 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:31.224929 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6b40b-272c-4cd3-afbe-a7a7d0e0a8c0 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:31.282481 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9f1b2-eb27-4fe5-9639-ae44ad651762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:31.283252 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9f1b2-eb27-4fe5-9639-ae44ad651762 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:31.283455 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9f1b2-eb27-4fe5-9639-ae44ad651762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:31.283739 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9f1b2-eb27-4fe5-9639-ae44ad651762 admin admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:31.284433 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe9f1b2-eb27-4fe5-9639-ae44ad651762 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:31.286469 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe9f1b2-eb27-4fe5-9639-ae44ad651762 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:31.309632 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40489a9f-e6fa-4b30-ae87-9806ab31d2cb admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:31.313832 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-40489a9f-e6fa-4b30-ae87-9806ab31d2cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:31.326641 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40489a9f-e6fa-4b30-ae87-9806ab31d2cb admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:31.331312 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7534a-ddf2-4790-991e-b9596aae2c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:31.332222 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7534a-ddf2-4790-991e-b9596aae2c69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:31.332509 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7534a-ddf2-4790-991e-b9596aae2c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:31.332785 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7534a-ddf2-4790-991e-b9596aae2c69 admin admin] PATH_INFO: `/v3/users/c7d53d6ef83c4fe1b57a2ed11ff2f396` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:31.334182 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7534a-ddf2-4790-991e-b9596aae2c69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7d53d6ef83c4fe1b57a2ed11ff2f396)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:31.341402 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7534a-ddf2-4790-991e-b9596aae2c69 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:31.376861 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 947/1919] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:34:31 2022] POST /identity/v3/users => generated 294 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:34:31.378174 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9f1b2-eb27-4fe5-9639-ae44ad651762 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:31.390830 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9f1b2-eb27-4fe5-9639-ae44ad651762 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:31.402847 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c98f2-46d3-4089-a5e2-418908c7782a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:31.403510 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c98f2-46d3-4089-a5e2-418908c7782a admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:31.404201 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c98f2-46d3-4089-a5e2-418908c7782a admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:31.404201 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c98f2-46d3-4089-a5e2-418908c7782a admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:31.404797 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c98f2-46d3-4089-a5e2-418908c7782a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:31.406398 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c98f2-46d3-4089-a5e2-418908c7782a admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:31.420895 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 948/1920] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 19:34:31.425520 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c98f2-46d3-4089-a5e2-418908c7782a admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:31.437327 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c98f2-46d3-4089-a5e2-418908c7782a admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:31.442457 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101e57e-c18e-40bc-8c1c-5db4e87445df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:31.445517 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101e57e-c18e-40bc-8c1c-5db4e87445df admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:31.445517 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101e57e-c18e-40bc-8c1c-5db4e87445df admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:31.445517 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101e57e-c18e-40bc-8c1c-5db4e87445df admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:31.445517 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b101e57e-c18e-40bc-8c1c-5db4e87445df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:31.447257 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b101e57e-c18e-40bc-8c1c-5db4e87445df admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:31.460775 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 949/1921] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:31.465032 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101e57e-c18e-40bc-8c1c-5db4e87445df admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:31.478628 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101e57e-c18e-40bc-8c1c-5db4e87445df admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:31.484392 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad30b11a-1e45-4708-a373-e01dc7093fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:31.485345 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30b11a-1e45-4708-a373-e01dc7093fd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:31.485572 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30b11a-1e45-4708-a373-e01dc7093fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:31.485847 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30b11a-1e45-4708-a373-e01dc7093fd3 admin admin] PATH_INFO: `/v3/projects/4b787ef5b7094418b63cdba480c67ae4/users/4ef71702e27d432ba47679a5b4931929/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:31.501602 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad30b11a-1e45-4708-a373-e01dc7093fd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b787ef5b7094418b63cdba480c67ae4, user_id=4ef71702e27d432ba47679a5b4931929, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:31.504421 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad30b11a-1e45-4708-a373-e01dc7093fd3 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:31.581728 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-16f7534a-ddf2-4790-991e-b9596aae2c69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7d53d6ef83c4fe1b57a2ed11ff2f396'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:31.591667 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 950/1922] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:34:31 2022] PUT /identity/v3/projects/4b787ef5b7094418b63cdba480c67ae4/users/4ef71702e27d432ba47679a5b4931929/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:34:31.594559 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad30b11a-1e45-4708-a373-e01dc7093fd3 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:31.594559 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-ad30b11a-1e45-4708-a373-e01dc7093fd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:31.670239 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad30b11a-1e45-4708-a373-e01dc7093fd3 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:31.674959 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5edf1-e819-4de6-b943-7184436ffae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:31.675911 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5edf1-e819-4de6-b943-7184436ffae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:31.676228 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5edf1-e819-4de6-b943-7184436ffae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:31.676815 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5edf1-e819-4de6-b943-7184436ffae6 admin admin] PATH_INFO: `/v3/projects/831d5de3983d4061a8c3558b3e16e147` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:31.678086 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b5edf1-e819-4de6-b943-7184436ffae6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=831d5de3983d4061a8c3558b3e16e147)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:31.678191 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-16f7534a-ddf2-4790-991e-b9596aae2c69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7d53d6ef83c4fe1b57a2ed11ff2f396'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:31.679099 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-16f7534a-ddf2-4790-991e-b9596aae2c69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7d53d6ef83c4fe1b57a2ed11ff2f396'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:31.680111 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b5edf1-e819-4de6-b943-7184436ffae6 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:31.688031 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-16f7534a-ddf2-4790-991e-b9596aae2c69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7d53d6ef83c4fe1b57a2ed11ff2f396'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:31.701680 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-16f7534a-ddf2-4790-991e-b9596aae2c69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7d53d6ef83c4fe1b57a2ed11ff2f396'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:31.707931 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 973/1923] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:34:31 2022] DELETE /identity/v3/users/c7d53d6ef83c4fe1b57a2ed11ff2f396 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:34:31.709291 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac47a4a-256c-48b2-a542-0f02308ea5eb None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:31.709643 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac47a4a-256c-48b2-a542-0f02308ea5eb None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:31.709987 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac47a4a-256c-48b2-a542-0f02308ea5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:31.737093 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-9ac47a4a-256c-48b2-a542-0f02308ea5eb None None] MFA Rules not processed for user `4ef71702e27d432ba47679a5b4931929`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:31.738454 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-9ac47a4a-256c-48b2-a542-0f02308ea5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:31.801387 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:31.820618 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 974/1924] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:31.820618 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642a937-c309-4305-90dd-9602ec81561d None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:31.820618 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642a937-c309-4305-90dd-9602ec81561d None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:31.820618 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642a937-c309-4305-90dd-9602ec81561d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:31.836988 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-44b5edf1-e819-4de6-b943-7184436ffae6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '831d5de3983d4061a8c3558b3e16e147', 'request_id': 'req-44b5edf1-e819-4de6-b943-7184436ffae6'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:31.839538 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-5642a937-c309-4305-90dd-9602ec81561d None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:31.840783 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-5642a937-c309-4305-90dd-9602ec81561d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:31.908886 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 975/1925] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:31.908886 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642a937-c309-4305-90dd-9602ec81561d None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:31.908886 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-5642a937-c309-4305-90dd-9602ec81561d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:31.927528 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642a937-c309-4305-90dd-9602ec81561d None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:31.932307 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d1370-996c-4549-a1ea-8809c2f27cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:31.933600 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d1370-996c-4549-a1ea-8809c2f27cdd admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:31.933956 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d1370-996c-4549-a1ea-8809c2f27cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:31.934278 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d1370-996c-4549-a1ea-8809c2f27cdd admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:31.935059 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d1370-996c-4549-a1ea-8809c2f27cdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:31.937074 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d1370-996c-4549-a1ea-8809c2f27cdd admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:31.940910 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-44b5edf1-e819-4de6-b943-7184436ffae6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '831d5de3983d4061a8c3558b3e16e147', 'request_id': 'req-44b5edf1-e819-4de6-b943-7184436ffae6'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:31.947751 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-44b5edf1-e819-4de6-b943-7184436ffae6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '831d5de3983d4061a8c3558b3e16e147', 'request_id': 'req-44b5edf1-e819-4de6-b943-7184436ffae6'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:31.959939 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-44b5edf1-e819-4de6-b943-7184436ffae6 admin admin] The token cache is being invalidate because project 831d5de3983d4061a8c3558b3e16e147 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:34:31.960233 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-44b5edf1-e819-4de6-b943-7184436ffae6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:31.960953 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-44b5edf1-e819-4de6-b943-7184436ffae6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:31.962746 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 951/1926] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:34:31 2022] DELETE /identity/v3/projects/831d5de3983d4061a8c3558b3e16e147 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:31.963761 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5edf1-e819-4de6-b943-7184436ffae6 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:31.965263 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-44b5edf1-e819-4de6-b943-7184436ffae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:32.027925 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5edf1-e819-4de6-b943-7184436ffae6 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:32.031791 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1d5e5-d604-41cb-936d-1a7b75b27460 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:32.032355 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1d5e5-d604-41cb-936d-1a7b75b27460 service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:32.032663 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1d5e5-d604-41cb-936d-1a7b75b27460 service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:32.032949 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1d5e5-d604-41cb-936d-1a7b75b27460 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:32.034722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-19b1d5e5-d604-41cb-936d-1a7b75b27460 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:32.052077 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b1d5e5-d604-41cb-936d-1a7b75b27460 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:32.053638 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b1d5e5-d604-41cb-936d-1a7b75b27460 service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:32.064317 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 952/1927] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:34:32.065484 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1d5e5-d604-41cb-936d-1a7b75b27460 service neutron] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:32.066759 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-19b1d5e5-d604-41cb-936d-1a7b75b27460 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:32.078905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1d5e5-d604-41cb-936d-1a7b75b27460 service neutron] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:32.084434 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3bcfb9-5b08-493f-bf75-98c55dff3673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:32.085835 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3bcfb9-5b08-493f-bf75-98c55dff3673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:32.086222 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3bcfb9-5b08-493f-bf75-98c55dff3673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:32.086504 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3bcfb9-5b08-493f-bf75-98c55dff3673 admin admin] PATH_INFO: `/v3/users/67d72de90f3b413eac2c944b9d4114e3` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:32.087754 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3bcfb9-5b08-493f-bf75-98c55dff3673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67d72de90f3b413eac2c944b9d4114e3)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:32.090210 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3bcfb9-5b08-493f-bf75-98c55dff3673 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:32.091739 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 976/1928] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:34:31 2022] POST /identity/v3/projects => generated 387 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:34:32.095870 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d1370-996c-4549-a1ea-8809c2f27cdd admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:32.099874 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-012d1370-996c-4549-a1ea-8809c2f27cdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:32.197684 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d1370-996c-4549-a1ea-8809c2f27cdd admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:32.204943 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3883f09-3991-4e05-8f2b-372a3241f0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:32.206762 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3883f09-3991-4e05-8f2b-372a3241f0c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:32.207146 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3883f09-3991-4e05-8f2b-372a3241f0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:32.207991 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3883f09-3991-4e05-8f2b-372a3241f0c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:32.210519 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3883f09-3991-4e05-8f2b-372a3241f0c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:32.217162 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3883f09-3991-4e05-8f2b-372a3241f0c8 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:32.297844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-5b3bcfb9-5b08-493f-bf75-98c55dff3673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67d72de90f3b413eac2c944b9d4114e3'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:32.360897 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 977/1929] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:34:32 2022] POST /identity/v3/users => generated 300 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 19:34:32.361955 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3883f09-3991-4e05-8f2b-372a3241f0c8 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:32.372392 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3883f09-3991-4e05-8f2b-372a3241f0c8 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:32.378028 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e5df4-a02e-4a3f-bb0b-c9a955f975e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:32.378028 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e5df4-a02e-4a3f-bb0b-c9a955f975e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:32.378230 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e5df4-a02e-4a3f-bb0b-c9a955f975e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:32.378460 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e5df4-a02e-4a3f-bb0b-c9a955f975e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:32.379422 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e5df4-a02e-4a3f-bb0b-c9a955f975e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:32.380816 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e5df4-a02e-4a3f-bb0b-c9a955f975e5 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:32.385055 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-5b3bcfb9-5b08-493f-bf75-98c55dff3673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67d72de90f3b413eac2c944b9d4114e3'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:32.402703 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-5b3bcfb9-5b08-493f-bf75-98c55dff3673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67d72de90f3b413eac2c944b9d4114e3'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:32.404169 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-5b3bcfb9-5b08-493f-bf75-98c55dff3673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67d72de90f3b413eac2c944b9d4114e3'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:32.414093 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 978/1930] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 19:34:32.415340 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e5df4-a02e-4a3f-bb0b-c9a955f975e5 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:32.416509 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-5b3bcfb9-5b08-493f-bf75-98c55dff3673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67d72de90f3b413eac2c944b9d4114e3'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:32.420034 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-a79e5df4-a02e-4a3f-bb0b-c9a955f975e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:32.435484 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e5df4-a02e-4a3f-bb0b-c9a955f975e5 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:32.436800 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 953/1931] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:34:32 2022] DELETE /identity/v3/users/67d72de90f3b413eac2c944b9d4114e3 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:32.514746 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b44b5-de47-4e7f-ad20-9c2c9a938372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:32.515798 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b44b5-de47-4e7f-ad20-9c2c9a938372 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:32.516077 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b44b5-de47-4e7f-ad20-9c2c9a938372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:32.516415 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b44b5-de47-4e7f-ad20-9c2c9a938372 admin admin] PATH_INFO: `/v3/projects/5e5289a4587a4d8f968305cd4398bcd1/users/d3ab0f28a182447498e647508c4552c7/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:32.535147 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b44b5-de47-4e7f-ad20-9c2c9a938372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e5289a4587a4d8f968305cd4398bcd1, user_id=d3ab0f28a182447498e647508c4552c7, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:32.538187 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b44b5-de47-4e7f-ad20-9c2c9a938372 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:32.637760 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 979/1932] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:34:32 2022] PUT /identity/v3/projects/5e5289a4587a4d8f968305cd4398bcd1/users/d3ab0f28a182447498e647508c4552c7/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:32.641050 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3bcfb9-5b08-493f-bf75-98c55dff3673 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:32.653653 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3bcfb9-5b08-493f-bf75-98c55dff3673 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:32.728367 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12666611-f3a4-468a-9f72-bc018af02e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:32.729058 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12666611-f3a4-468a-9f72-bc018af02e99 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:32.729337 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12666611-f3a4-468a-9f72-bc018af02e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:32.729818 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12666611-f3a4-468a-9f72-bc018af02e99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:32.730660 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12666611-f3a4-468a-9f72-bc018af02e99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:32.733430 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12666611-f3a4-468a-9f72-bc018af02e99 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:32.746098 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 954/1933] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:32.750839 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b44b5-de47-4e7f-ad20-9c2c9a938372 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:32.763012 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12666611-f3a4-468a-9f72-bc018af02e99 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:32.764830 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-12666611-f3a4-468a-9f72-bc018af02e99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:32.766633 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b44b5-de47-4e7f-ad20-9c2c9a938372 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:32.771615 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88127dec-3913-4b58-bed7-e765620d93a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:32.772547 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88127dec-3913-4b58-bed7-e765620d93a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:32.772829 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88127dec-3913-4b58-bed7-e765620d93a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:32.773287 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88127dec-3913-4b58-bed7-e765620d93a6 admin admin] PATH_INFO: `/v3/projects/5e5289a4587a4d8f968305cd4398bcd1/users/d3ab0f28a182447498e647508c4552c7/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:32.775915 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88127dec-3913-4b58-bed7-e765620d93a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e5289a4587a4d8f968305cd4398bcd1, user_id=d3ab0f28a182447498e647508c4552c7, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:32.778920 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12666611-f3a4-468a-9f72-bc018af02e99 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:32.779631 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88127dec-3913-4b58-bed7-e765620d93a6 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:32.784399 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f77ab-54f5-41ce-8d86-d44f653cdb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:32.785283 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f77ab-54f5-41ce-8d86-d44f653cdb67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:32.785575 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f77ab-54f5-41ce-8d86-d44f653cdb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:32.785861 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f77ab-54f5-41ce-8d86-d44f653cdb67 admin admin] PATH_INFO: `/v3/projects/1930e80bd0264435b4cd1544cf4de855` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:32.787123 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1f77ab-54f5-41ce-8d86-d44f653cdb67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1930e80bd0264435b4cd1544cf4de855)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:32.789084 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1f77ab-54f5-41ce-8d86-d44f653cdb67 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:32.792360 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 980/1934] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:34:32 2022] PUT /identity/v3/projects/5e5289a4587a4d8f968305cd4398bcd1/users/d3ab0f28a182447498e647508c4552c7/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:32.803164 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f0d0a-580f-48b9-a870-78d5a78986d9 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:32.803479 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f0d0a-580f-48b9-a870-78d5a78986d9 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:32.803766 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f0d0a-580f-48b9-a870-78d5a78986d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:32.866439 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-5d1f0d0a-580f-48b9-a870-78d5a78986d9 None None] MFA Rules not processed for user `d3ab0f28a182447498e647508c4552c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:32.868229 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-5d1f0d0a-580f-48b9-a870-78d5a78986d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:32.992035 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 981/1935] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:32 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:34:33.005050 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f0d0a-580f-48b9-a870-78d5a78986d9 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:33.006867 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-5d1f0d0a-580f-48b9-a870-78d5a78986d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:33.090461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f0d0a-580f-48b9-a870-78d5a78986d9 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:33.124099 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-7a1f77ab-54f5-41ce-8d86-d44f653cdb67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1930e80bd0264435b4cd1544cf4de855', 'request_id': 'req-7a1f77ab-54f5-41ce-8d86-d44f653cdb67'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:33.184324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0cec1c-4033-4a3a-814b-d17f44d6b787 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:33.185763 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cec1c-4033-4a3a-814b-d17f44d6b787 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:33.186227 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cec1c-4033-4a3a-814b-d17f44d6b787 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:33.186673 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cec1c-4033-4a3a-814b-d17f44d6b787 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:33.195873 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-7a1f77ab-54f5-41ce-8d86-d44f653cdb67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1930e80bd0264435b4cd1544cf4de855', 'request_id': 'req-7a1f77ab-54f5-41ce-8d86-d44f653cdb67'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:33.203291 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-7a1f77ab-54f5-41ce-8d86-d44f653cdb67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1930e80bd0264435b4cd1544cf4de855', 'request_id': 'req-7a1f77ab-54f5-41ce-8d86-d44f653cdb67'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:33.218935 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-7a1f77ab-54f5-41ce-8d86-d44f653cdb67 admin admin] The token cache is being invalidate because project 1930e80bd0264435b4cd1544cf4de855 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:34:33.219228 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-7a1f77ab-54f5-41ce-8d86-d44f653cdb67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:33.220132 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-7a1f77ab-54f5-41ce-8d86-d44f653cdb67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:33.221777 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 955/1936] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:34:32 2022] DELETE /identity/v3/projects/1930e80bd0264435b4cd1544cf4de855 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:33.222777 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f77ab-54f5-41ce-8d86-d44f653cdb67 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:33.224202 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-7a1f77ab-54f5-41ce-8d86-d44f653cdb67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:33.246919 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:33.302091 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f77ab-54f5-41ce-8d86-d44f653cdb67 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:33.306980 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0b41f-9122-4d52-bdf5-46f978136b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:33.309005 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0b41f-9122-4d52-bdf5-46f978136b1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:33.309458 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0b41f-9122-4d52-bdf5-46f978136b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:33.309748 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0b41f-9122-4d52-bdf5-46f978136b1f admin admin] PATH_INFO: `/v3/projects/c47dd573bc984f9588f088ab2b9599f2` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:33.311071 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a0b41f-9122-4d52-bdf5-46f978136b1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c47dd573bc984f9588f088ab2b9599f2)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:33.313106 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a0b41f-9122-4d52-bdf5-46f978136b1f admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:33.345058 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0cec1c-4033-4a3a-814b-d17f44d6b787 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:33.346706 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0cec1c-4033-4a3a-814b-d17f44d6b787 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:33.365367 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 982/1937] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 19:34:33.367004 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0cec1c-4033-4a3a-814b-d17f44d6b787 service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:33.381117 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0cec1c-4033-4a3a-814b-d17f44d6b787 service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:33.388460 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3e81a-7559-47e0-a421-f6bc6d6acc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:33.389709 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3e81a-7559-47e0-a421-f6bc6d6acc38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:33.390042 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3e81a-7559-47e0-a421-f6bc6d6acc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:33.390534 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3e81a-7559-47e0-a421-f6bc6d6acc38 admin admin] PATH_INFO: `/v3/users/46072ffb0d454d87a0786f9122495a0a` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:33.392015 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf3e81a-7559-47e0-a421-f6bc6d6acc38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46072ffb0d454d87a0786f9122495a0a)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:33.394206 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf3e81a-7559-47e0-a421-f6bc6d6acc38 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:33.453626 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-e2a0b41f-9122-4d52-bdf5-46f978136b1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c47dd573bc984f9588f088ab2b9599f2', 'request_id': 'req-e2a0b41f-9122-4d52-bdf5-46f978136b1f'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:33.566941 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-e2a0b41f-9122-4d52-bdf5-46f978136b1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c47dd573bc984f9588f088ab2b9599f2', 'request_id': 'req-e2a0b41f-9122-4d52-bdf5-46f978136b1f'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:33.574406 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-e2a0b41f-9122-4d52-bdf5-46f978136b1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c47dd573bc984f9588f088ab2b9599f2', 'request_id': 'req-e2a0b41f-9122-4d52-bdf5-46f978136b1f'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:33.586407 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-e2a0b41f-9122-4d52-bdf5-46f978136b1f admin admin] The token cache is being invalidate because project c47dd573bc984f9588f088ab2b9599f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:34:33.586737 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-e2a0b41f-9122-4d52-bdf5-46f978136b1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:33.587417 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-e2a0b41f-9122-4d52-bdf5-46f978136b1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:33.589331 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 956/1938] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:34:33 2022] DELETE /identity/v3/projects/c47dd573bc984f9588f088ab2b9599f2 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:33.594272 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb93f8e-5157-437c-b35b-1c76d0ed79d4 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:33.594568 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb93f8e-5157-437c-b35b-1c76d0ed79d4 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:33.594930 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb93f8e-5157-437c-b35b-1c76d0ed79d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:33.615456 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-acb93f8e-5157-437c-b35b-1c76d0ed79d4 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:33.616831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-acb93f8e-5157-437c-b35b-1c76d0ed79d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:33.674088 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-6cf3e81a-7559-47e0-a421-f6bc6d6acc38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46072ffb0d454d87a0786f9122495a0a'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:33.690327 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 957/1939] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:34:33.697974 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76830764-c94c-4181-9bbe-cfa1c22889c6 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:33.698371 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76830764-c94c-4181-9bbe-cfa1c22889c6 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:33.698989 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76830764-c94c-4181-9bbe-cfa1c22889c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:33.719854 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-76830764-c94c-4181-9bbe-cfa1c22889c6 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:33.721051 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-76830764-c94c-4181-9bbe-cfa1c22889c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:33.728876 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 958/1940] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:33.733431 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76830764-c94c-4181-9bbe-cfa1c22889c6 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:33.742053 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76830764-c94c-4181-9bbe-cfa1c22889c6 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:33.746591 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7907c5-c3c7-455f-acf9-aeaf6557c4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:33.747214 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7907c5-c3c7-455f-acf9-aeaf6557c4ed admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:33.747533 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7907c5-c3c7-455f-acf9-aeaf6557c4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:33.747807 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7907c5-c3c7-455f-acf9-aeaf6557c4ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:33.748511 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7907c5-c3c7-455f-acf9-aeaf6557c4ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:34:33.748815 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7907c5-c3c7-455f-acf9-aeaf6557c4ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:33.750407 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7907c5-c3c7-455f-acf9-aeaf6557c4ed admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:33.761468 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 959/1941] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:34:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:34:33.765511 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7907c5-c3c7-455f-acf9-aeaf6557c4ed admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:33.775256 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7907c5-c3c7-455f-acf9-aeaf6557c4ed admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:33.780510 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924d7e9-f920-42e6-bb9f-1a6a93530ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:33.781100 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924d7e9-f920-42e6-bb9f-1a6a93530ae2 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:33.781389 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924d7e9-f920-42e6-bb9f-1a6a93530ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:33.781669 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924d7e9-f920-42e6-bb9f-1a6a93530ae2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:33.782466 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9924d7e9-f920-42e6-bb9f-1a6a93530ae2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:33.784825 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9924d7e9-f920-42e6-bb9f-1a6a93530ae2 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:33.786259 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-6cf3e81a-7559-47e0-a421-f6bc6d6acc38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46072ffb0d454d87a0786f9122495a0a'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:33.787016 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-6cf3e81a-7559-47e0-a421-f6bc6d6acc38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46072ffb0d454d87a0786f9122495a0a'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:33.819531 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-6cf3e81a-7559-47e0-a421-f6bc6d6acc38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46072ffb0d454d87a0786f9122495a0a'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:33.837748 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-6cf3e81a-7559-47e0-a421-f6bc6d6acc38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46072ffb0d454d87a0786f9122495a0a'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:33.846714 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 983/1942] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:34:33 2022] DELETE /identity/v3/users/46072ffb0d454d87a0786f9122495a0a => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:33.847451 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3e81a-7559-47e0-a421-f6bc6d6acc38 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:33.849202 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-6cf3e81a-7559-47e0-a421-f6bc6d6acc38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:33.881634 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 960/1943] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:34:33 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 19:34:33.889928 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924d7e9-f920-42e6-bb9f-1a6a93530ae2 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:33.892562 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-9924d7e9-f920-42e6-bb9f-1a6a93530ae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:33.938950 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3e81a-7559-47e0-a421-f6bc6d6acc38 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:33.980379 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924d7e9-f920-42e6-bb9f-1a6a93530ae2 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:33.985937 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42b4f0-f593-4960-b633-1e3a615db451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:33.986754 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42b4f0-f593-4960-b633-1e3a615db451 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:33.987230 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42b4f0-f593-4960-b633-1e3a615db451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:33.987523 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42b4f0-f593-4960-b633-1e3a615db451 admin admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:33.988215 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a42b4f0-f593-4960-b633-1e3a615db451 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:33.990125 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a42b4f0-f593-4960-b633-1e3a615db451 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:34.021299 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34699b-58b2-4ac0-84f1-2ebfce55038f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:34.021299 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34699b-58b2-4ac0-84f1-2ebfce55038f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:34.021299 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34699b-58b2-4ac0-84f1-2ebfce55038f admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:34.021299 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34699b-58b2-4ac0-84f1-2ebfce55038f admin admin] PATH_INFO: `/v3/users/6e97e0a76f9f444c9c1974c0494eba67` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:34.021608 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34699b-58b2-4ac0-84f1-2ebfce55038f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e97e0a76f9f444c9c1974c0494eba67)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:34.021691 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34699b-58b2-4ac0-84f1-2ebfce55038f admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:34.041678 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:34.139949 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 961/1944] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:34:33 2022] POST /identity/v3/users => generated 290 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:34:34.143957 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42b4f0-f593-4960-b633-1e3a615db451 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:34.156522 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42b4f0-f593-4960-b633-1e3a615db451 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:34.163101 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e52da8-db7f-4a54-98b2-8078ca8ed93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:34.165586 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e52da8-db7f-4a54-98b2-8078ca8ed93e admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:34.165586 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e52da8-db7f-4a54-98b2-8078ca8ed93e admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:34.165586 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e52da8-db7f-4a54-98b2-8078ca8ed93e admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:34.165586 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e52da8-db7f-4a54-98b2-8078ca8ed93e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:34.167889 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e52da8-db7f-4a54-98b2-8078ca8ed93e admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:34.181256 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 962/1945] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:34.196492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e52da8-db7f-4a54-98b2-8078ca8ed93e admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:34.212143 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e52da8-db7f-4a54-98b2-8078ca8ed93e admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:34.218079 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce380cd-ea5b-44b3-a3c5-21483733cb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:34.218706 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce380cd-ea5b-44b3-a3c5-21483733cb53 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:34.218996 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce380cd-ea5b-44b3-a3c5-21483733cb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:34.230233 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce380cd-ea5b-44b3-a3c5-21483733cb53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:34.230233 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce380cd-ea5b-44b3-a3c5-21483733cb53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:34.230233 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce380cd-ea5b-44b3-a3c5-21483733cb53 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:34.235491 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 963/1946] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:34.240731 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce380cd-ea5b-44b3-a3c5-21483733cb53 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:34.257801 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce380cd-ea5b-44b3-a3c5-21483733cb53 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:34.264572 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa470f6-2426-4cd3-988c-2812d7bac530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:34.275489 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa470f6-2426-4cd3-988c-2812d7bac530 admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:34.275489 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa470f6-2426-4cd3-988c-2812d7bac530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:34.275489 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa470f6-2426-4cd3-988c-2812d7bac530 admin admin] PATH_INFO: `/v3/projects/a591ee1186794514a8d5f684dfae5819/users/0d38c7557e864e868f5bfe72c41cc8d3/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:34.294286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-0c34699b-58b2-4ac0-84f1-2ebfce55038f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e97e0a76f9f444c9c1974c0494eba67'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:34.297733 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa470f6-2426-4cd3-988c-2812d7bac530 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a591ee1186794514a8d5f684dfae5819, user_id=0d38c7557e864e868f5bfe72c41cc8d3, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:34.301397 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa470f6-2426-4cd3-988c-2812d7bac530 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:34.393008 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-0c34699b-58b2-4ac0-84f1-2ebfce55038f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e97e0a76f9f444c9c1974c0494eba67'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:34.393635 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-0c34699b-58b2-4ac0-84f1-2ebfce55038f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e97e0a76f9f444c9c1974c0494eba67'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:34.415271 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 964/1947] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:34:34 2022] PUT /identity/v3/projects/a591ee1186794514a8d5f684dfae5819/users/0d38c7557e864e868f5bfe72c41cc8d3/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:34:34.416182 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-0c34699b-58b2-4ac0-84f1-2ebfce55038f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e97e0a76f9f444c9c1974c0494eba67'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:34.428633 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c398ba-0ddd-4ff0-ab5c-0e2f5f355904 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:34.429515 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c398ba-0ddd-4ff0-ab5c-0e2f5f355904 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:34.432048 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c398ba-0ddd-4ff0-ab5c-0e2f5f355904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:34.464813 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-0c34699b-58b2-4ac0-84f1-2ebfce55038f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e97e0a76f9f444c9c1974c0494eba67'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:34.483810 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 984/1948] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:34:33 2022] DELETE /identity/v3/users/6e97e0a76f9f444c9c1974c0494eba67 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:34.484932 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34699b-58b2-4ac0-84f1-2ebfce55038f admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:34.486200 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-d6c398ba-0ddd-4ff0-ab5c-0e2f5f355904 None None] MFA Rules not processed for user `0d38c7557e864e868f5bfe72c41cc8d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:34.486328 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-0c34699b-58b2-4ac0-84f1-2ebfce55038f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:34.489452 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-d6c398ba-0ddd-4ff0-ab5c-0e2f5f355904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:34.576504 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34699b-58b2-4ac0-84f1-2ebfce55038f admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:34.581513 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d028f-bb49-43a0-9d52-f1bc39fd90c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:34.582413 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d028f-bb49-43a0-9d52-f1bc39fd90c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:34.585890 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d028f-bb49-43a0-9d52-f1bc39fd90c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:34.586024 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 965/1949] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:34.586137 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d028f-bb49-43a0-9d52-f1bc39fd90c3 admin admin] PATH_INFO: `/v3/projects/116701fd5ba6474e9aaaf87af9baf65d` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:34.586137 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40d028f-bb49-43a0-9d52-f1bc39fd90c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=116701fd5ba6474e9aaaf87af9baf65d)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:34.586293 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132882f8-fc37-4a0b-aef3-291bd0cb5d02 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:34.586293 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132882f8-fc37-4a0b-aef3-291bd0cb5d02 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:34.586293 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132882f8-fc37-4a0b-aef3-291bd0cb5d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:34.586515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40d028f-bb49-43a0-9d52-f1bc39fd90c3 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:34.612894 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-132882f8-fc37-4a0b-aef3-291bd0cb5d02 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:34.614110 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-132882f8-fc37-4a0b-aef3-291bd0cb5d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:34.622885 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 966/1950] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:34.623725 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132882f8-fc37-4a0b-aef3-291bd0cb5d02 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:34.625088 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-132882f8-fc37-4a0b-aef3-291bd0cb5d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:34.639940 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132882f8-fc37-4a0b-aef3-291bd0cb5d02 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:34.645260 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4648ba-c99b-48bf-b1ef-02dd3104021f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:34.645925 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4648ba-c99b-48bf-b1ef-02dd3104021f admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:34.646208 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4648ba-c99b-48bf-b1ef-02dd3104021f admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:34.646600 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4648ba-c99b-48bf-b1ef-02dd3104021f admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:34.647298 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4648ba-c99b-48bf-b1ef-02dd3104021f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:34.649234 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4648ba-c99b-48bf-b1ef-02dd3104021f admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:34.728111 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c40d028f-bb49-43a0-9d52-f1bc39fd90c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '116701fd5ba6474e9aaaf87af9baf65d', 'request_id': 'req-c40d028f-bb49-43a0-9d52-f1bc39fd90c3'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:34.735541 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c40d028f-bb49-43a0-9d52-f1bc39fd90c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '116701fd5ba6474e9aaaf87af9baf65d', 'request_id': 'req-c40d028f-bb49-43a0-9d52-f1bc39fd90c3'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:34.746023 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 967/1951] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:34:34 2022] POST /identity/v3/projects => generated 379 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:34:34.746865 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4648ba-c99b-48bf-b1ef-02dd3104021f admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:34.748459 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-9b4648ba-c99b-48bf-b1ef-02dd3104021f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:34.804217 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4648ba-c99b-48bf-b1ef-02dd3104021f admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:34.809742 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e992f0a-e62c-4d89-90b1-e6cb61a6ea2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:34.810390 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e992f0a-e62c-4d89-90b1-e6cb61a6ea2b service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:34.810685 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e992f0a-e62c-4d89-90b1-e6cb61a6ea2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:34.810960 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e992f0a-e62c-4d89-90b1-e6cb61a6ea2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:34.835306 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c40d028f-bb49-43a0-9d52-f1bc39fd90c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '116701fd5ba6474e9aaaf87af9baf65d', 'request_id': 'req-c40d028f-bb49-43a0-9d52-f1bc39fd90c3'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:34.848723 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c40d028f-bb49-43a0-9d52-f1bc39fd90c3 admin admin] The token cache is being invalidate because project 116701fd5ba6474e9aaaf87af9baf65d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:34:34.849399 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c40d028f-bb49-43a0-9d52-f1bc39fd90c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:34.852641 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:34.853639 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c40d028f-bb49-43a0-9d52-f1bc39fd90c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:34.856133 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 985/1952] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:34:34 2022] DELETE /identity/v3/projects/116701fd5ba6474e9aaaf87af9baf65d => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:34.857189 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d028f-bb49-43a0-9d52-f1bc39fd90c3 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:34.858773 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-c40d028f-bb49-43a0-9d52-f1bc39fd90c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:34.876064 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e992f0a-e62c-4d89-90b1-e6cb61a6ea2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:34.877536 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e992f0a-e62c-4d89-90b1-e6cb61a6ea2b service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:34.888099 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 968/1953] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:34:34.889513 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8630549-20eb-47a7-a304-043ab6fb508b None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:34.889814 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8630549-20eb-47a7-a304-043ab6fb508b None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:34.890099 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8630549-20eb-47a7-a304-043ab6fb508b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:34.909634 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-d8630549-20eb-47a7-a304-043ab6fb508b None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:34.910858 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-d8630549-20eb-47a7-a304-043ab6fb508b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:34.923579 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 969/1954] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:34.926063 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8630549-20eb-47a7-a304-043ab6fb508b None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:34.927938 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-d8630549-20eb-47a7-a304-043ab6fb508b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:34.930545 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d028f-bb49-43a0-9d52-f1bc39fd90c3 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:34.936452 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85f929-c5a0-45f6-9d56-4db530d7d0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:34.937923 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85f929-c5a0-45f6-9d56-4db530d7d0da admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:34.937923 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85f929-c5a0-45f6-9d56-4db530d7d0da admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:34.937923 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85f929-c5a0-45f6-9d56-4db530d7d0da admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:34.938321 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f85f929-c5a0-45f6-9d56-4db530d7d0da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:34.940570 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f85f929-c5a0-45f6-9d56-4db530d7d0da admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:34.941524 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8630549-20eb-47a7-a304-043ab6fb508b None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:34.953798 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4768ad-b54e-43a3-b30d-0dc4db59ddb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:34.954723 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4768ad-b54e-43a3-b30d-0dc4db59ddb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:34.955065 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4768ad-b54e-43a3-b30d-0dc4db59ddb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:34.955352 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4768ad-b54e-43a3-b30d-0dc4db59ddb9 admin admin] PATH_INFO: `/v3/users/4ef71702e27d432ba47679a5b4931929` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:34.957791 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4768ad-b54e-43a3-b30d-0dc4db59ddb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ef71702e27d432ba47679a5b4931929)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:34.959841 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4768ad-b54e-43a3-b30d-0dc4db59ddb9 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:35.106576 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 986/1955] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:34:34 2022] POST /identity/v3/users => generated 296 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:34:35.108105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a12895-9f0e-4482-91c2-02ff648c2122 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:35.114446 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a12895-9f0e-4482-91c2-02ff648c2122 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:35.114446 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a12895-9f0e-4482-91c2-02ff648c2122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:35.129682 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-21a12895-9f0e-4482-91c2-02ff648c2122 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:35.131048 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-21a12895-9f0e-4482-91c2-02ff648c2122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:35.144370 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 987/1956] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:35.145326 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a12895-9f0e-4482-91c2-02ff648c2122 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:35.158650 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a12895-9f0e-4482-91c2-02ff648c2122 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:35.167360 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad81607-340c-4e15-ab8f-f39835fdebe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:35.168326 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad81607-340c-4e15-ab8f-f39835fdebe4 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:35.168758 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad81607-340c-4e15-ab8f-f39835fdebe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:35.169212 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad81607-340c-4e15-ab8f-f39835fdebe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:35.170271 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad81607-340c-4e15-ab8f-f39835fdebe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:35.173011 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad81607-340c-4e15-ab8f-f39835fdebe4 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:35.186270 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 988/1957] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:35.186270 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad81607-340c-4e15-ab8f-f39835fdebe4 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:35.197267 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad81607-340c-4e15-ab8f-f39835fdebe4 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:35.209879 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0e0df-51d0-4781-800c-e7c78491bae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:35.210663 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0e0df-51d0-4781-800c-e7c78491bae4 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:35.211026 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0e0df-51d0-4781-800c-e7c78491bae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:35.211407 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0e0df-51d0-4781-800c-e7c78491bae4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:35.212256 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b0e0df-51d0-4781-800c-e7c78491bae4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:34:35.212640 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b0e0df-51d0-4781-800c-e7c78491bae4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:35.214563 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b0e0df-51d0-4781-800c-e7c78491bae4 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:35.234111 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 989/1958] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:34:35.234239 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0e0df-51d0-4781-800c-e7c78491bae4 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:35.244921 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0e0df-51d0-4781-800c-e7c78491bae4 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:35.250705 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43cd6f-a07a-4aec-9a70-5761097d83df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:35.251751 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43cd6f-a07a-4aec-9a70-5761097d83df admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:35.252112 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43cd6f-a07a-4aec-9a70-5761097d83df admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:35.252483 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43cd6f-a07a-4aec-9a70-5761097d83df admin admin] PATH_INFO: `/v3/projects/a59f524cc6de4f318f80811947815a07/users/89365f5893db44ca97d2d404b666a27c/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:35.268902 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a43cd6f-a07a-4aec-9a70-5761097d83df admin admin] RBAC: Authorizing `identity:create_grant(project_id=a59f524cc6de4f318f80811947815a07, user_id=89365f5893db44ca97d2d404b666a27c, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:35.272036 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a43cd6f-a07a-4aec-9a70-5761097d83df admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:35.275320 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:35.296773 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-9a4768ad-b54e-43a3-b30d-0dc4db59ddb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ef71702e27d432ba47679a5b4931929'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:35.363683 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-9a4768ad-b54e-43a3-b30d-0dc4db59ddb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ef71702e27d432ba47679a5b4931929'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:35.371482 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 990/1959] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:34:35 2022] PUT /identity/v3/projects/a59f524cc6de4f318f80811947815a07/users/89365f5893db44ca97d2d404b666a27c/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:35.371482 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43cd6f-a07a-4aec-9a70-5761097d83df admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:35.385218 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-9a4768ad-b54e-43a3-b30d-0dc4db59ddb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ef71702e27d432ba47679a5b4931929'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:35.387582 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-9a4768ad-b54e-43a3-b30d-0dc4db59ddb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ef71702e27d432ba47679a5b4931929'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:35.397117 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-9a4768ad-b54e-43a3-b30d-0dc4db59ddb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ef71702e27d432ba47679a5b4931929'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:35.407419 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 970/1960] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:34:34 2022] DELETE /identity/v3/users/4ef71702e27d432ba47679a5b4931929 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:35.407419 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4768ad-b54e-43a3-b30d-0dc4db59ddb9 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:35.407419 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-9a4768ad-b54e-43a3-b30d-0dc4db59ddb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:35.483937 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43cd6f-a07a-4aec-9a70-5761097d83df admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:35.520725 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4768ad-b54e-43a3-b30d-0dc4db59ddb9 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:35.529048 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98205c1f-e738-49c1-9f9e-0f7b52e32b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:35.529737 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98205c1f-e738-49c1-9f9e-0f7b52e32b14 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:35.530017 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98205c1f-e738-49c1-9f9e-0f7b52e32b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:35.530289 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98205c1f-e738-49c1-9f9e-0f7b52e32b14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:35.531026 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98205c1f-e738-49c1-9f9e-0f7b52e32b14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:35.532763 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98205c1f-e738-49c1-9f9e-0f7b52e32b14 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:35.544397 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 971/1961] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:35.549359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe97a3-6c39-4113-8510-0895cb34f190 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:35.549359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe97a3-6c39-4113-8510-0895cb34f190 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:35.549592 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe97a3-6c39-4113-8510-0895cb34f190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:35.570215 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-dabe97a3-6c39-4113-8510-0895cb34f190 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:35.571690 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-dabe97a3-6c39-4113-8510-0895cb34f190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:35.581379 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 972/1962] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:35.581674 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c2d25-8ec9-4c18-bb3d-f32324dfe977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:35.582213 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe97a3-6c39-4113-8510-0895cb34f190 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:35.582677 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c2d25-8ec9-4c18-bb3d-f32324dfe977 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:35.583127 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c2d25-8ec9-4c18-bb3d-f32324dfe977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:35.583603 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c2d25-8ec9-4c18-bb3d-f32324dfe977 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:35.583936 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-dabe97a3-6c39-4113-8510-0895cb34f190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:35.591294 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c2d25-8ec9-4c18-bb3d-f32324dfe977 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:35.593573 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c2d25-8ec9-4c18-bb3d-f32324dfe977 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:35.597190 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe97a3-6c39-4113-8510-0895cb34f190 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:35.602064 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351fbf19-cb4d-4a93-8f1b-203d74c6efdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:35.603192 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fbf19-cb4d-4a93-8f1b-203d74c6efdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:35.603192 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fbf19-cb4d-4a93-8f1b-203d74c6efdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:35.603567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fbf19-cb4d-4a93-8f1b-203d74c6efdf admin admin] PATH_INFO: `/v3/projects/e6a0ce7066f54225b3ffc215c9afc379` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:35.604845 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351fbf19-cb4d-4a93-8f1b-203d74c6efdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6a0ce7066f54225b3ffc215c9afc379)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:35.606816 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351fbf19-cb4d-4a93-8f1b-203d74c6efdf admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:35.697009 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 991/1963] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:34:35 2022] POST /identity/v3/projects => generated 381 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:34:35.697927 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c2d25-8ec9-4c18-bb3d-f32324dfe977 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:35.734815 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-351fbf19-cb4d-4a93-8f1b-203d74c6efdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6a0ce7066f54225b3ffc215c9afc379', 'request_id': 'req-351fbf19-cb4d-4a93-8f1b-203d74c6efdf'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:35.768415 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c2d25-8ec9-4c18-bb3d-f32324dfe977 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:35.832013 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff13f3-629e-4ac8-ad6e-5fe39b99b655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:35.832911 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff13f3-629e-4ac8-ad6e-5fe39b99b655 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:35.833538 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff13f3-629e-4ac8-ad6e-5fe39b99b655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:35.833835 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff13f3-629e-4ac8-ad6e-5fe39b99b655 admin admin] PATH_INFO: `/v3/projects/a59f524cc6de4f318f80811947815a07/users/89365f5893db44ca97d2d404b666a27c/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:35.835861 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ff13f3-629e-4ac8-ad6e-5fe39b99b655 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a59f524cc6de4f318f80811947815a07, user_id=89365f5893db44ca97d2d404b666a27c, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:35.839719 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ff13f3-629e-4ac8-ad6e-5fe39b99b655 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:35.850036 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 992/1964] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:34:35 2022] PUT /identity/v3/projects/a59f524cc6de4f318f80811947815a07/users/89365f5893db44ca97d2d404b666a27c/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:35.850679 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff13f3-629e-4ac8-ad6e-5fe39b99b655 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:35.857152 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-48ff13f3-629e-4ac8-ad6e-5fe39b99b655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:35.877042 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-351fbf19-cb4d-4a93-8f1b-203d74c6efdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6a0ce7066f54225b3ffc215c9afc379', 'request_id': 'req-351fbf19-cb4d-4a93-8f1b-203d74c6efdf'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:35.877042 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-351fbf19-cb4d-4a93-8f1b-203d74c6efdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6a0ce7066f54225b3ffc215c9afc379', 'request_id': 'req-351fbf19-cb4d-4a93-8f1b-203d74c6efdf'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:35.885329 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-351fbf19-cb4d-4a93-8f1b-203d74c6efdf admin admin] The token cache is being invalidate because project e6a0ce7066f54225b3ffc215c9afc379 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:34:35.885621 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-351fbf19-cb4d-4a93-8f1b-203d74c6efdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:35.887020 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-351fbf19-cb4d-4a93-8f1b-203d74c6efdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:35.888504 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 973/1965] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:34:35 2022] DELETE /identity/v3/projects/e6a0ce7066f54225b3ffc215c9afc379 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:35.893628 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351fbf19-cb4d-4a93-8f1b-203d74c6efdf admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:35.894991 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-351fbf19-cb4d-4a93-8f1b-203d74c6efdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:35.908996 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351fbf19-cb4d-4a93-8f1b-203d74c6efdf admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:35.924019 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff13f3-629e-4ac8-ad6e-5fe39b99b655 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:35.927665 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e70bd47-39c4-4289-b2a0-85c6d39df8a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:35.928456 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70bd47-39c4-4289-b2a0-85c6d39df8a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:35.928708 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70bd47-39c4-4289-b2a0-85c6d39df8a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:35.929041 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70bd47-39c4-4289-b2a0-85c6d39df8a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:35.930885 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-1e70bd47-39c4-4289-b2a0-85c6d39df8a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:35.972878 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee13cfd-d837-4f4c-9430-71bab052b2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:35.973933 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee13cfd-d837-4f4c-9430-71bab052b2e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:35.973933 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee13cfd-d837-4f4c-9430-71bab052b2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:35.974176 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee13cfd-d837-4f4c-9430-71bab052b2e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:35.974776 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee13cfd-d837-4f4c-9430-71bab052b2e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:35.976816 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee13cfd-d837-4f4c-9430-71bab052b2e2 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:35.999556 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e70bd47-39c4-4289-b2a0-85c6d39df8a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:36.001000 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e70bd47-39c4-4289-b2a0-85c6d39df8a4 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:36.015169 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 993/1966] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:34:36.015169 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bbd692-8a35-489f-954d-326ee815f692 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:36.015169 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bbd692-8a35-489f-954d-326ee815f692 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:36.015169 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bbd692-8a35-489f-954d-326ee815f692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:36.041767 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-26bbd692-8a35-489f-954d-326ee815f692 None None] MFA Rules not processed for user `89365f5893db44ca97d2d404b666a27c`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:36.043277 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-26bbd692-8a35-489f-954d-326ee815f692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:36.103552 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 974/1967] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:34:35 2022] POST /identity/v3/users => generated 291 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:34:36.105096 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1495b0-cf85-40d0-90cb-0a7dd380365a None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:36.105513 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1495b0-cf85-40d0-90cb-0a7dd380365a None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:36.105872 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1495b0-cf85-40d0-90cb-0a7dd380365a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:36.121168 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 994/1968] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:36 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:36.122376 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bbd692-8a35-489f-954d-326ee815f692 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:36.132535 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-da1495b0-cf85-40d0-90cb-0a7dd380365a None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:36.134023 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-da1495b0-cf85-40d0-90cb-0a7dd380365a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:36.137415 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bbd692-8a35-489f-954d-326ee815f692 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:36.146388 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc98908-331e-47cf-abed-a4184f9587d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:36.146388 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc98908-331e-47cf-abed-a4184f9587d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:36.146388 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc98908-331e-47cf-abed-a4184f9587d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:36.146667 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 975/1969] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:36.146775 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc98908-331e-47cf-abed-a4184f9587d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:36.146775 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc98908-331e-47cf-abed-a4184f9587d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:36.146993 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1495b0-cf85-40d0-90cb-0a7dd380365a None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:36.146993 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-da1495b0-cf85-40d0-90cb-0a7dd380365a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:36.147147 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc98908-331e-47cf-abed-a4184f9587d3 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:36.161176 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 995/1970] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:36.162768 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4201f-7717-4d20-b794-2b46ca4b1d79 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:36.163058 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4201f-7717-4d20-b794-2b46ca4b1d79 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:36.163336 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4201f-7717-4d20-b794-2b46ca4b1d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:36.185162 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-f8e4201f-7717-4d20-b794-2b46ca4b1d79 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:36.187250 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f8e4201f-7717-4d20-b794-2b46ca4b1d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:36.201428 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 996/1971] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:36.202324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4201f-7717-4d20-b794-2b46ca4b1d79 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:36.213914 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4201f-7717-4d20-b794-2b46ca4b1d79 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:36.220308 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233bee6-c6b0-4313-a393-08a6eea61ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:36.220990 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233bee6-c6b0-4313-a393-08a6eea61ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:36.221279 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233bee6-c6b0-4313-a393-08a6eea61ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:36.221987 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233bee6-c6b0-4313-a393-08a6eea61ca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:36.222184 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1495b0-cf85-40d0-90cb-0a7dd380365a None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:36.222415 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b233bee6-c6b0-4313-a393-08a6eea61ca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:36.224219 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b233bee6-c6b0-4313-a393-08a6eea61ca6 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:36.226594 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df1040-77f6-410b-8ad8-b3693cc07439 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:36.227258 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df1040-77f6-410b-8ad8-b3693cc07439 service cinder] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:36.227583 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df1040-77f6-410b-8ad8-b3693cc07439 service cinder] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:36.227859 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df1040-77f6-410b-8ad8-b3693cc07439 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:36.237074 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 997/1972] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:36.237954 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233bee6-c6b0-4313-a393-08a6eea61ca6 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:36.243264 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df1040-77f6-410b-8ad8-b3693cc07439 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:36.245037 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df1040-77f6-410b-8ad8-b3693cc07439 service cinder] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:36.252619 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233bee6-c6b0-4313-a393-08a6eea61ca6 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:36.258611 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3674169-ce82-4f21-8cd3-1f3898b60d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:36.259933 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3674169-ce82-4f21-8cd3-1f3898b60d5f admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:36.260229 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3674169-ce82-4f21-8cd3-1f3898b60d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:36.261480 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3674169-ce82-4f21-8cd3-1f3898b60d5f admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:36.262473 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3674169-ce82-4f21-8cd3-1f3898b60d5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:34:36.263046 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3674169-ce82-4f21-8cd3-1f3898b60d5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:36.264996 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3674169-ce82-4f21-8cd3-1f3898b60d5f admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:36.270838 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 976/1973] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:36 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:34:36.274150 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df1040-77f6-410b-8ad8-b3693cc07439 service cinder] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:36.299189 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df1040-77f6-410b-8ad8-b3693cc07439 service cinder] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:36.315009 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 998/1974] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:34:36.315499 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4d814-a4fc-4e36-bce3-0ea8b0baaf76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:36.316451 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4d814-a4fc-4e36-bce3-0ea8b0baaf76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:36.319027 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3674169-ce82-4f21-8cd3-1f3898b60d5f admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:36.319156 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4d814-a4fc-4e36-bce3-0ea8b0baaf76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:36.319156 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4d814-a4fc-4e36-bce3-0ea8b0baaf76 admin admin] PATH_INFO: `/v3/projects/188af2f8882d4e6e966bd6031c4b6fe4/users/d1a57a63100247e0887076c4121a77f4/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:36.336333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3674169-ce82-4f21-8cd3-1f3898b60d5f admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:36.345430 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b4d814-a4fc-4e36-bce3-0ea8b0baaf76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=188af2f8882d4e6e966bd6031c4b6fe4, user_id=d1a57a63100247e0887076c4121a77f4, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:36.350574 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b4d814-a4fc-4e36-bce3-0ea8b0baaf76 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:36.351151 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc251a3-d770-46ca-b0da-34b0301a18a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:36.352838 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc251a3-d770-46ca-b0da-34b0301a18a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:36.353110 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc251a3-d770-46ca-b0da-34b0301a18a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:36.353396 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc251a3-d770-46ca-b0da-34b0301a18a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:36.355889 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc251a3-d770-46ca-b0da-34b0301a18a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:36.357888 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc251a3-d770-46ca-b0da-34b0301a18a5 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:36.504406 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 977/1975] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:34:36 2022] PUT /identity/v3/projects/188af2f8882d4e6e966bd6031c4b6fe4/users/d1a57a63100247e0887076c4121a77f4/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:36.506085 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 999/1976] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:34:36 2022] POST /identity/v3/projects => generated 363 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:34:36.510022 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4d814-a4fc-4e36-bce3-0ea8b0baaf76 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:36.515744 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d64de-0390-41f7-8dbb-5fc49498e6ac None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:36.516093 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d64de-0390-41f7-8dbb-5fc49498e6ac None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:36.516329 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d64de-0390-41f7-8dbb-5fc49498e6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:36.548117 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-944d64de-0390-41f7-8dbb-5fc49498e6ac None None] MFA Rules not processed for user `d1a57a63100247e0887076c4121a77f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:36.549892 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-944d64de-0390-41f7-8dbb-5fc49498e6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:36.593865 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4d814-a4fc-4e36-bce3-0ea8b0baaf76 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:36.659134 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1000/1977] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:36.660401 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d64de-0390-41f7-8dbb-5fc49498e6ac None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:36.661906 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-944d64de-0390-41f7-8dbb-5fc49498e6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:36.673463 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b6116-f440-4de6-83e0-6f12240a2093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:36.675187 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b6116-f440-4de6-83e0-6f12240a2093 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:36.676273 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b6116-f440-4de6-83e0-6f12240a2093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:36.676567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b6116-f440-4de6-83e0-6f12240a2093 admin admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:36.677843 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665b6116-f440-4de6-83e0-6f12240a2093 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:36.680136 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665b6116-f440-4de6-83e0-6f12240a2093 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:36.734275 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d64de-0390-41f7-8dbb-5fc49498e6ac None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:36.738859 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f3d47-223f-4e44-a617-2b2909316ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:36.739791 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f3d47-223f-4e44-a617-2b2909316ab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:36.740078 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f3d47-223f-4e44-a617-2b2909316ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:36.740358 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f3d47-223f-4e44-a617-2b2909316ab6 admin admin] PATH_INFO: `/v3/projects/4b787ef5b7094418b63cdba480c67ae4` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:36.741595 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f3d47-223f-4e44-a617-2b2909316ab6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b787ef5b7094418b63cdba480c67ae4)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:36.743569 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f3d47-223f-4e44-a617-2b2909316ab6 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:36.808478 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 978/1978] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:34:36 2022] POST /identity/v3/users => generated 282 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:34:36.809657 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b6116-f440-4de6-83e0-6f12240a2093 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:36.821618 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b6116-f440-4de6-83e0-6f12240a2093 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:36.827631 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f417f8-860e-4a73-ab55-60c4666bb0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:36.828296 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f417f8-860e-4a73-ab55-60c4666bb0a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:36.828584 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f417f8-860e-4a73-ab55-60c4666bb0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:36.828869 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f417f8-860e-4a73-ab55-60c4666bb0a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:36.829562 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f417f8-860e-4a73-ab55-60c4666bb0a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:36.832226 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f417f8-860e-4a73-ab55-60c4666bb0a7 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:36.886547 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ab1f3d47-223f-4e44-a617-2b2909316ab6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b787ef5b7094418b63cdba480c67ae4', 'request_id': 'req-ab1f3d47-223f-4e44-a617-2b2909316ab6'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:36.903188 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ab1f3d47-223f-4e44-a617-2b2909316ab6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b787ef5b7094418b63cdba480c67ae4', 'request_id': 'req-ab1f3d47-223f-4e44-a617-2b2909316ab6'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:36.989854 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 979/1979] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:34:36 2022] POST /identity/v3/projects => generated 383 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:34:36.990689 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f417f8-860e-4a73-ab55-60c4666bb0a7 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:37.006316 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ab1f3d47-223f-4e44-a617-2b2909316ab6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b787ef5b7094418b63cdba480c67ae4', 'request_id': 'req-ab1f3d47-223f-4e44-a617-2b2909316ab6'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:37.022880 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ab1f3d47-223f-4e44-a617-2b2909316ab6 admin admin] The token cache is being invalidate because project 4b787ef5b7094418b63cdba480c67ae4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:34:37.023270 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ab1f3d47-223f-4e44-a617-2b2909316ab6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:37.024099 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ab1f3d47-223f-4e44-a617-2b2909316ab6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:37.026013 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1001/1980] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:34:36 2022] DELETE /identity/v3/projects/4b787ef5b7094418b63cdba480c67ae4 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:37.027125 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f3d47-223f-4e44-a617-2b2909316ab6 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:37.028735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ab1f3d47-223f-4e44-a617-2b2909316ab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:37.044161 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:37.059756 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f417f8-860e-4a73-ab55-60c4666bb0a7 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:37.064505 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c2563-400a-4ceb-90d4-22cf652bafed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:37.065499 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c2563-400a-4ceb-90d4-22cf652bafed admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:37.065706 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c2563-400a-4ceb-90d4-22cf652bafed admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:37.065980 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c2563-400a-4ceb-90d4-22cf652bafed admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:37.066809 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c2563-400a-4ceb-90d4-22cf652bafed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:37.068440 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c2563-400a-4ceb-90d4-22cf652bafed admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:37.082229 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 980/1981] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:37.082229 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c2563-400a-4ceb-90d4-22cf652bafed admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:37.084846 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-470c2563-400a-4ceb-90d4-22cf652bafed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:37.099317 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c2563-400a-4ceb-90d4-22cf652bafed admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:37.105153 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464edab-08ef-4342-893b-99999f123eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:37.106093 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464edab-08ef-4342-893b-99999f123eeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:37.106381 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464edab-08ef-4342-893b-99999f123eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:37.106689 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464edab-08ef-4342-893b-99999f123eeb admin admin] PATH_INFO: `/v3/users/d3ab0f28a182447498e647508c4552c7` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:37.107932 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464edab-08ef-4342-893b-99999f123eeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3ab0f28a182447498e647508c4552c7)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:37.110001 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464edab-08ef-4342-893b-99999f123eeb admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:37.124824 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f3d47-223f-4e44-a617-2b2909316ab6 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:37.130524 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b7f28-97e6-4412-80d5-c21bd2fd46cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:37.131373 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b7f28-97e6-4412-80d5-c21bd2fd46cb admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:37.131760 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b7f28-97e6-4412-80d5-c21bd2fd46cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:37.132140 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b7f28-97e6-4412-80d5-c21bd2fd46cb admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:37.133031 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b7f28-97e6-4412-80d5-c21bd2fd46cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:37.135339 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b7f28-97e6-4412-80d5-c21bd2fd46cb admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:37.258479 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1002/1982] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:34:37 2022] POST /identity/v3/users => generated 298 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:34:37.259558 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b7f28-97e6-4412-80d5-c21bd2fd46cb admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:37.263606 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-998b7f28-97e6-4412-80d5-c21bd2fd46cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:37.276443 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b7f28-97e6-4412-80d5-c21bd2fd46cb admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:37.282038 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbda1c8-c488-43c4-8e11-56dffdcfd63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:37.282720 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbda1c8-c488-43c4-8e11-56dffdcfd63c admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:37.283009 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbda1c8-c488-43c4-8e11-56dffdcfd63c admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:37.283289 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbda1c8-c488-43c4-8e11-56dffdcfd63c admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:37.284060 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbda1c8-c488-43c4-8e11-56dffdcfd63c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:37.285671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbda1c8-c488-43c4-8e11-56dffdcfd63c admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:37.296138 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1003/1983] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:37.297050 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbda1c8-c488-43c4-8e11-56dffdcfd63c admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:37.308175 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbda1c8-c488-43c4-8e11-56dffdcfd63c admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:37.312988 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c75a3-0a9a-4a5b-85a9-ad5e7fbb4d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:37.314990 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c75a3-0a9a-4a5b-85a9-ad5e7fbb4d20 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:37.314990 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c75a3-0a9a-4a5b-85a9-ad5e7fbb4d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:37.314990 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c75a3-0a9a-4a5b-85a9-ad5e7fbb4d20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:37.315240 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c75a3-0a9a-4a5b-85a9-ad5e7fbb4d20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:37.316908 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c75a3-0a9a-4a5b-85a9-ad5e7fbb4d20 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:37.331604 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1004/1984] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:37.331604 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c75a3-0a9a-4a5b-85a9-ad5e7fbb4d20 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:37.335751 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:37.343206 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c75a3-0a9a-4a5b-85a9-ad5e7fbb4d20 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:37.349217 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762c780-3f1e-47ce-8ac0-32a54e7f1d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:37.350120 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762c780-3f1e-47ce-8ac0-32a54e7f1d43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:37.350452 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762c780-3f1e-47ce-8ac0-32a54e7f1d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:37.350681 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762c780-3f1e-47ce-8ac0-32a54e7f1d43 admin admin] PATH_INFO: `/v3/projects/4fe00d6408bd4d2283e05bb77043d2a8/users/6b8326fa655a490f99241739bc985c54/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:37.356398 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-c464edab-08ef-4342-893b-99999f123eeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3ab0f28a182447498e647508c4552c7'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:37.367059 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1762c780-3f1e-47ce-8ac0-32a54e7f1d43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fe00d6408bd4d2283e05bb77043d2a8, user_id=6b8326fa655a490f99241739bc985c54, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:37.369742 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1762c780-3f1e-47ce-8ac0-32a54e7f1d43 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:37.437358 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-c464edab-08ef-4342-893b-99999f123eeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3ab0f28a182447498e647508c4552c7'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:37.457567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-c464edab-08ef-4342-893b-99999f123eeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3ab0f28a182447498e647508c4552c7'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:37.458427 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-c464edab-08ef-4342-893b-99999f123eeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3ab0f28a182447498e647508c4552c7'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:37.470310 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-c464edab-08ef-4342-893b-99999f123eeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3ab0f28a182447498e647508c4552c7'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:37.478148 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 981/1986] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:34:37 2022] DELETE /identity/v3/users/d3ab0f28a182447498e647508c4552c7 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:37.478775 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464edab-08ef-4342-893b-99999f123eeb admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:37.484203 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1005/1986] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:34:37 2022] PUT /identity/v3/projects/4fe00d6408bd4d2283e05bb77043d2a8/users/6b8326fa655a490f99241739bc985c54/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:37.486033 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ad08a-55b0-42eb-9daa-27c3616d6159 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:37.486418 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ad08a-55b0-42eb-9daa-27c3616d6159 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:37.486815 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ad08a-55b0-42eb-9daa-27c3616d6159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:37.493649 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-c464edab-08ef-4342-893b-99999f123eeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:37.518335 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-8a3ad08a-55b0-42eb-9daa-27c3616d6159 None None] MFA Rules not processed for user `6b8326fa655a490f99241739bc985c54`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:37.519751 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-8a3ad08a-55b0-42eb-9daa-27c3616d6159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:37.605539 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464edab-08ef-4342-893b-99999f123eeb admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:37.612745 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4658012f-cc4c-4aa5-98ee-802fee0b074e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:37.614355 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658012f-cc4c-4aa5-98ee-802fee0b074e admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:37.620598 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658012f-cc4c-4aa5-98ee-802fee0b074e admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:37.620598 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658012f-cc4c-4aa5-98ee-802fee0b074e admin admin] PATH_INFO: `/v3/projects/f9c6cc9bb4964c5c87b35d83687c341f/users/3376b797779249b5baed148266317d77/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:37.653812 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4658012f-cc4c-4aa5-98ee-802fee0b074e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9c6cc9bb4964c5c87b35d83687c341f, user_id=3376b797779249b5baed148266317d77, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:37.656887 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4658012f-cc4c-4aa5-98ee-802fee0b074e admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:37.668610 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1006/1987] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:37 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:37.676568 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ad08a-55b0-42eb-9daa-27c3616d6159 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:37.683635 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-8a3ad08a-55b0-42eb-9daa-27c3616d6159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:37.756057 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ad08a-55b0-42eb-9daa-27c3616d6159 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:37.762614 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bcea75-5427-481a-aa75-fa689c450b6d tempest-VolumeQuotaClassesTest-120112701 tempest-VolumeQuotaClassesTest-120112701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89365f5893db44ca97d2d404b666a27c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a59f524cc6de4f318f80811947815a07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:37.763313 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bcea75-5427-481a-aa75-fa689c450b6d tempest-VolumeQuotaClassesTest-120112701 tempest-VolumeQuotaClassesTest-120112701-project-admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:37.763639 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bcea75-5427-481a-aa75-fa689c450b6d tempest-VolumeQuotaClassesTest-120112701 tempest-VolumeQuotaClassesTest-120112701-project-admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:37.763930 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bcea75-5427-481a-aa75-fa689c450b6d tempest-VolumeQuotaClassesTest-120112701 tempest-VolumeQuotaClassesTest-120112701-project-admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:37.764795 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bcea75-5427-481a-aa75-fa689c450b6d tempest-VolumeQuotaClassesTest-120112701 tempest-VolumeQuotaClassesTest-120112701-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:34:37.765115 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bcea75-5427-481a-aa75-fa689c450b6d tempest-VolumeQuotaClassesTest-120112701 tempest-VolumeQuotaClassesTest-120112701-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:37.766789 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bcea75-5427-481a-aa75-fa689c450b6d tempest-VolumeQuotaClassesTest-120112701 tempest-VolumeQuotaClassesTest-120112701-project-admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:37.784127 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1007/1988] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:34:37.785092 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bcea75-5427-481a-aa75-fa689c450b6d tempest-VolumeQuotaClassesTest-120112701 tempest-VolumeQuotaClassesTest-120112701-project-admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:37.786830 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-13bcea75-5427-481a-aa75-fa689c450b6d tempest-VolumeQuotaClassesTest-120112701 tempest-VolumeQuotaClassesTest-120112701-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:37.789439 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 982/1989] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:34:37 2022] PUT /identity/v3/projects/f9c6cc9bb4964c5c87b35d83687c341f/users/3376b797779249b5baed148266317d77/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:37.793337 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4658012f-cc4c-4aa5-98ee-802fee0b074e admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:37.912224 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bcea75-5427-481a-aa75-fa689c450b6d tempest-VolumeQuotaClassesTest-120112701 tempest-VolumeQuotaClassesTest-120112701-project-admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:37.920144 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4658012f-cc4c-4aa5-98ee-802fee0b074e admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:37.936129 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4195278-4b07-4a02-9c53-293565edf98f tempest-VolumeQuotaClassesTest-120112701 tempest-VolumeQuotaClassesTest-120112701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89365f5893db44ca97d2d404b666a27c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a59f524cc6de4f318f80811947815a07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:37.939558 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4195278-4b07-4a02-9c53-293565edf98f tempest-VolumeQuotaClassesTest-120112701 tempest-VolumeQuotaClassesTest-120112701-project-admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:37.940157 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4195278-4b07-4a02-9c53-293565edf98f tempest-VolumeQuotaClassesTest-120112701 tempest-VolumeQuotaClassesTest-120112701-project-admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:37.940457 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4195278-4b07-4a02-9c53-293565edf98f tempest-VolumeQuotaClassesTest-120112701 tempest-VolumeQuotaClassesTest-120112701-project-admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:37.942391 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4195278-4b07-4a02-9c53-293565edf98f tempest-VolumeQuotaClassesTest-120112701 tempest-VolumeQuotaClassesTest-120112701-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:37.947474 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4195278-4b07-4a02-9c53-293565edf98f tempest-VolumeQuotaClassesTest-120112701 tempest-VolumeQuotaClassesTest-120112701-project-admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:37.984438 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c78d25-eba2-4247-94bb-6e1bc2579b34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:37.985288 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c78d25-eba2-4247-94bb-6e1bc2579b34 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:37.985578 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c78d25-eba2-4247-94bb-6e1bc2579b34 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:37.985856 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c78d25-eba2-4247-94bb-6e1bc2579b34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:38.057130 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c78d25-eba2-4247-94bb-6e1bc2579b34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:38.060171 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c78d25-eba2-4247-94bb-6e1bc2579b34 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:38.060911 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 983/1990] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:34:37 2022] POST /identity/v3/projects => generated 354 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:34:38.062334 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4195278-4b07-4a02-9c53-293565edf98f tempest-VolumeQuotaClassesTest-120112701 tempest-VolumeQuotaClassesTest-120112701-project-admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:38.087855 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1008/1991] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:37 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:34:38.091359 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c78d25-eba2-4247-94bb-6e1bc2579b34 service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:38.119391 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c78d25-eba2-4247-94bb-6e1bc2579b34 service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:38.136290 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4195278-4b07-4a02-9c53-293565edf98f tempest-VolumeQuotaClassesTest-120112701 tempest-VolumeQuotaClassesTest-120112701-project-admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:38.144754 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37273a40-5a58-486b-ab86-cf7de29bf4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:38.145624 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37273a40-5a58-486b-ab86-cf7de29bf4bc admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:38.145987 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37273a40-5a58-486b-ab86-cf7de29bf4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:38.146343 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37273a40-5a58-486b-ab86-cf7de29bf4bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:38.147670 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37273a40-5a58-486b-ab86-cf7de29bf4bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:38.150372 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37273a40-5a58-486b-ab86-cf7de29bf4bc admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:38.170181 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 984/1992] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:38.171134 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37273a40-5a58-486b-ab86-cf7de29bf4bc admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:38.173021 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-37273a40-5a58-486b-ab86-cf7de29bf4bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:38.193941 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37273a40-5a58-486b-ab86-cf7de29bf4bc admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:38.200413 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e66dc-5f60-4907-a480-c208eaac53db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:38.201301 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e66dc-5f60-4907-a480-c208eaac53db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:38.201873 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e66dc-5f60-4907-a480-c208eaac53db admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:38.202167 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e66dc-5f60-4907-a480-c208eaac53db admin admin] PATH_INFO: `/v3/projects/5e5289a4587a4d8f968305cd4398bcd1` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:38.207708 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e66dc-5f60-4907-a480-c208eaac53db admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e5289a4587a4d8f968305cd4398bcd1)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:38.210590 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e66dc-5f60-4907-a480-c208eaac53db admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:38.240356 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322177a-b455-4e6b-8489-ec281ba666f5 tempest-VolumeQuotaClassesTest-120112701 tempest-VolumeQuotaClassesTest-120112701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89365f5893db44ca97d2d404b666a27c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a59f524cc6de4f318f80811947815a07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:38.241132 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322177a-b455-4e6b-8489-ec281ba666f5 tempest-VolumeQuotaClassesTest-120112701 tempest-VolumeQuotaClassesTest-120112701-project-admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:38.241535 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322177a-b455-4e6b-8489-ec281ba666f5 tempest-VolumeQuotaClassesTest-120112701 tempest-VolumeQuotaClassesTest-120112701-project-admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:38.241982 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322177a-b455-4e6b-8489-ec281ba666f5 tempest-VolumeQuotaClassesTest-120112701 tempest-VolumeQuotaClassesTest-120112701-project-admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:38.243582 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322177a-b455-4e6b-8489-ec281ba666f5 tempest-VolumeQuotaClassesTest-120112701 tempest-VolumeQuotaClassesTest-120112701-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:34:38.243976 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322177a-b455-4e6b-8489-ec281ba666f5 tempest-VolumeQuotaClassesTest-120112701 tempest-VolumeQuotaClassesTest-120112701-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:38.254754 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322177a-b455-4e6b-8489-ec281ba666f5 tempest-VolumeQuotaClassesTest-120112701 tempest-VolumeQuotaClassesTest-120112701-project-admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:38.269063 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1009/1993] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:34:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:34:38.270053 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322177a-b455-4e6b-8489-ec281ba666f5 tempest-VolumeQuotaClassesTest-120112701 tempest-VolumeQuotaClassesTest-120112701-project-admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:38.307992 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322177a-b455-4e6b-8489-ec281ba666f5 tempest-VolumeQuotaClassesTest-120112701 tempest-VolumeQuotaClassesTest-120112701-project-admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:38.322650 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8f6df-e9d1-4aca-844e-81446c6ea99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:38.323987 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8f6df-e9d1-4aca-844e-81446c6ea99b admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:38.324335 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8f6df-e9d1-4aca-844e-81446c6ea99b admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:38.324710 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8f6df-e9d1-4aca-844e-81446c6ea99b admin admin] PATH_INFO: `/v3/projects/f9c6cc9bb4964c5c87b35d83687c341f/users/3376b797779249b5baed148266317d77/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:38.334402 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8f6df-e9d1-4aca-844e-81446c6ea99b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9c6cc9bb4964c5c87b35d83687c341f, user_id=3376b797779249b5baed148266317d77, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:38.337313 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8f6df-e9d1-4aca-844e-81446c6ea99b admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:38.350877 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1010/1994] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:34:38 2022] PUT /identity/v3/projects/f9c6cc9bb4964c5c87b35d83687c341f/users/3376b797779249b5baed148266317d77/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:38.351877 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8f6df-e9d1-4aca-844e-81446c6ea99b admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:38.404152 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-ba5e66dc-5f60-4907-a480-c208eaac53db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e5289a4587a4d8f968305cd4398bcd1', 'request_id': 'req-ba5e66dc-5f60-4907-a480-c208eaac53db'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:38.456124 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8f6df-e9d1-4aca-844e-81446c6ea99b admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:38.530469 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-ba5e66dc-5f60-4907-a480-c208eaac53db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e5289a4587a4d8f968305cd4398bcd1', 'request_id': 'req-ba5e66dc-5f60-4907-a480-c208eaac53db'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:38.548505 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-ba5e66dc-5f60-4907-a480-c208eaac53db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e5289a4587a4d8f968305cd4398bcd1', 'request_id': 'req-ba5e66dc-5f60-4907-a480-c208eaac53db'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:38.551795 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99d702-633b-43d4-a0c9-c99ee96e34e4 tempest-VolumeQuotaClassesTest-120112701 tempest-VolumeQuotaClassesTest-120112701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89365f5893db44ca97d2d404b666a27c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a59f524cc6de4f318f80811947815a07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:38.552975 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99d702-633b-43d4-a0c9-c99ee96e34e4 tempest-VolumeQuotaClassesTest-120112701 tempest-VolumeQuotaClassesTest-120112701-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:38.553367 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99d702-633b-43d4-a0c9-c99ee96e34e4 tempest-VolumeQuotaClassesTest-120112701 tempest-VolumeQuotaClassesTest-120112701-project-admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:38.553749 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99d702-633b-43d4-a0c9-c99ee96e34e4 tempest-VolumeQuotaClassesTest-120112701 tempest-VolumeQuotaClassesTest-120112701-project-admin] PATH_INFO: `/v3/projects/fad2a391c5324b43aa857fd53f0eb9d2` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:38.556585 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b99d702-633b-43d4-a0c9-c99ee96e34e4 tempest-VolumeQuotaClassesTest-120112701 tempest-VolumeQuotaClassesTest-120112701-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fad2a391c5324b43aa857fd53f0eb9d2)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:38.564319 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b99d702-633b-43d4-a0c9-c99ee96e34e4 tempest-VolumeQuotaClassesTest-120112701 tempest-VolumeQuotaClassesTest-120112701-project-admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:38.571677 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-ba5e66dc-5f60-4907-a480-c208eaac53db admin admin] The token cache is being invalidate because project 5e5289a4587a4d8f968305cd4398bcd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:34:38.572169 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-ba5e66dc-5f60-4907-a480-c208eaac53db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:38.573945 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-ba5e66dc-5f60-4907-a480-c208eaac53db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:38.579137 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 985/1995] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:34:38 2022] DELETE /identity/v3/projects/5e5289a4587a4d8f968305cd4398bcd1 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:38.579137 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198e110-cea8-4bee-9b2b-52d8c433d8e2 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:38.579137 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198e110-cea8-4bee-9b2b-52d8c433d8e2 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:38.579137 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198e110-cea8-4bee-9b2b-52d8c433d8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:38.612211 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-b198e110-cea8-4bee-9b2b-52d8c433d8e2 None None] MFA Rules not processed for user `3376b797779249b5baed148266317d77`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:38.613472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-b198e110-cea8-4bee-9b2b-52d8c433d8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:38.685552 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 986/1996] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:38.686983 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13324022-58c0-425a-8671-96b1c3a7df3c None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:38.687398 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13324022-58c0-425a-8671-96b1c3a7df3c None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:38.687809 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13324022-58c0-425a-8671-96b1c3a7df3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:38.717831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-13324022-58c0-425a-8671-96b1c3a7df3c None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:38.719041 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-13324022-58c0-425a-8671-96b1c3a7df3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:38.722852 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-8b99d702-633b-43d4-a0c9-c99ee96e34e4 tempest-VolumeQuotaClassesTest-120112701 tempest-VolumeQuotaClassesTest-120112701-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fad2a391c5324b43aa857fd53f0eb9d2', 'request_id': 'req-8b99d702-633b-43d4-a0c9-c99ee96e34e4'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:38.731333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-8b99d702-633b-43d4-a0c9-c99ee96e34e4 tempest-VolumeQuotaClassesTest-120112701 tempest-VolumeQuotaClassesTest-120112701-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fad2a391c5324b43aa857fd53f0eb9d2', 'request_id': 'req-8b99d702-633b-43d4-a0c9-c99ee96e34e4'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:38.787205 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 987/1997] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:38.788263 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13324022-58c0-425a-8671-96b1c3a7df3c None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:38.790937 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-13324022-58c0-425a-8671-96b1c3a7df3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:38.859489 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13324022-58c0-425a-8671-96b1c3a7df3c None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:38.863894 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-8b99d702-633b-43d4-a0c9-c99ee96e34e4 tempest-VolumeQuotaClassesTest-120112701 tempest-VolumeQuotaClassesTest-120112701-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fad2a391c5324b43aa857fd53f0eb9d2', 'request_id': 'req-8b99d702-633b-43d4-a0c9-c99ee96e34e4'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:38.864739 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8badb81b-1bfe-41eb-8b28-a14490488b60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:38.865481 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8badb81b-1bfe-41eb-8b28-a14490488b60 service cinder] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:38.865906 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8badb81b-1bfe-41eb-8b28-a14490488b60 service cinder] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:38.866020 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8badb81b-1bfe-41eb-8b28-a14490488b60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:38.883615 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-8b99d702-633b-43d4-a0c9-c99ee96e34e4 tempest-VolumeQuotaClassesTest-120112701 tempest-VolumeQuotaClassesTest-120112701-project-admin] The token cache is being invalidate because project fad2a391c5324b43aa857fd53f0eb9d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:34:38.884591 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-8b99d702-633b-43d4-a0c9-c99ee96e34e4 tempest-VolumeQuotaClassesTest-120112701 tempest-VolumeQuotaClassesTest-120112701-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:38.886770 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-8b99d702-633b-43d4-a0c9-c99ee96e34e4 tempest-VolumeQuotaClassesTest-120112701 tempest-VolumeQuotaClassesTest-120112701-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:38.889291 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1011/1998] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:34:38 2022] DELETE /identity/v3/projects/fad2a391c5324b43aa857fd53f0eb9d2 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:38.891237 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48c847-cc89-4189-8086-059b87fffe34 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:38.891762 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48c847-cc89-4189-8086-059b87fffe34 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:38.892907 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48c847-cc89-4189-8086-059b87fffe34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:38.914981 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-ff48c847-cc89-4189-8086-059b87fffe34 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:38.917076 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ff48c847-cc89-4189-8086-059b87fffe34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:38.919392 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:38.930465 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1012/1999] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:38.935389 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48c847-cc89-4189-8086-059b87fffe34 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:38.948029 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48c847-cc89-4189-8086-059b87fffe34 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:38.955372 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957cc16b-8118-4cc5-b51f-a509efb1552b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:38.955997 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957cc16b-8118-4cc5-b51f-a509efb1552b admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:38.955997 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957cc16b-8118-4cc5-b51f-a509efb1552b admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:38.956223 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957cc16b-8118-4cc5-b51f-a509efb1552b admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:38.957024 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957cc16b-8118-4cc5-b51f-a509efb1552b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:34:38.957338 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957cc16b-8118-4cc5-b51f-a509efb1552b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:38.959152 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957cc16b-8118-4cc5-b51f-a509efb1552b admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:38.974563 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1013/2000] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:34:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:34:38.979978 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957cc16b-8118-4cc5-b51f-a509efb1552b admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:38.993339 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8badb81b-1bfe-41eb-8b28-a14490488b60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:38.996684 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8badb81b-1bfe-41eb-8b28-a14490488b60 service cinder] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:38.997744 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957cc16b-8118-4cc5-b51f-a509efb1552b admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:39.009128 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 988/2001] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:34:39.011702 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a6a55-2b28-4681-981a-c3b2edb52640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:39.012715 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a6a55-2b28-4681-981a-c3b2edb52640 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:39.013155 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a6a55-2b28-4681-981a-c3b2edb52640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:39.013522 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a6a55-2b28-4681-981a-c3b2edb52640 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:39.014288 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a6a55-2b28-4681-981a-c3b2edb52640 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:39.016963 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a6a55-2b28-4681-981a-c3b2edb52640 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:39.178628 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8badb81b-1bfe-41eb-8b28-a14490488b60 service cinder] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:39.192253 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8badb81b-1bfe-41eb-8b28-a14490488b60 service cinder] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:39.199812 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1014/2002] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:34:38 2022] POST /identity/v3/projects => generated 373 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:34:39.201322 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a6a55-2b28-4681-981a-c3b2edb52640 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:39.249531 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ffe9d4-09a6-4e89-be81-712e7e759b11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:39.250450 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffe9d4-09a6-4e89-be81-712e7e759b11 service cinder] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:39.250450 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffe9d4-09a6-4e89-be81-712e7e759b11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:39.250724 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffe9d4-09a6-4e89-be81-712e7e759b11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:39.253260 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-d8ffe9d4-09a6-4e89-be81-712e7e759b11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:39.276475 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a6a55-2b28-4681-981a-c3b2edb52640 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:39.281398 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d3b45-f5a9-48ce-b8e9-14def6d8f653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:39.282238 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d3b45-f5a9-48ce-b8e9-14def6d8f653 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:39.282671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d3b45-f5a9-48ce-b8e9-14def6d8f653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:39.283147 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d3b45-f5a9-48ce-b8e9-14def6d8f653 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:39.284003 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d3b45-f5a9-48ce-b8e9-14def6d8f653 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:39.286601 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d3b45-f5a9-48ce-b8e9-14def6d8f653 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:39.321034 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ffe9d4-09a6-4e89-be81-712e7e759b11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:39.322607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ffe9d4-09a6-4e89-be81-712e7e759b11 service cinder] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:39.338405 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 989/2003] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 19:34:39.404345 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1015/2004] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:34:39 2022] POST /identity/v3/users => generated 287 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:34:39.405625 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ffe9d4-09a6-4e89-be81-712e7e759b11 service cinder] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:39.417788 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ffe9d4-09a6-4e89-be81-712e7e759b11 service cinder] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:39.428531 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929b94e-1e05-42b9-8686-3ee4c0e7c2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:39.428531 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929b94e-1e05-42b9-8686-3ee4c0e7c2f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:39.428531 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929b94e-1e05-42b9-8686-3ee4c0e7c2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:39.428531 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929b94e-1e05-42b9-8686-3ee4c0e7c2f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:39.429543 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3929b94e-1e05-42b9-8686-3ee4c0e7c2f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:39.429543 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3929b94e-1e05-42b9-8686-3ee4c0e7c2f8 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:39.438227 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 990/2005] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:39.442396 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d3b45-f5a9-48ce-b8e9-14def6d8f653 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:39.454494 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d3b45-f5a9-48ce-b8e9-14def6d8f653 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:39.460734 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3e33e-ad22-4eba-ad16-9735ee35eb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:39.461422 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3e33e-ad22-4eba-ad16-9735ee35eb42 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:39.461715 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3e33e-ad22-4eba-ad16-9735ee35eb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:39.462048 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3e33e-ad22-4eba-ad16-9735ee35eb42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:39.462826 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3e33e-ad22-4eba-ad16-9735ee35eb42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:39.464695 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3e33e-ad22-4eba-ad16-9735ee35eb42 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:39.483472 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1016/2006] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:39 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:39.487576 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929b94e-1e05-42b9-8686-3ee4c0e7c2f8 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:39.499159 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929b94e-1e05-42b9-8686-3ee4c0e7c2f8 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:39.504196 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6f764-2077-4e87-a28c-ea88d41a5e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:39.505096 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6f764-2077-4e87-a28c-ea88d41a5e30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:39.505381 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6f764-2077-4e87-a28c-ea88d41a5e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:39.505662 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6f764-2077-4e87-a28c-ea88d41a5e30 admin admin] PATH_INFO: `/v3/projects/91c83794dce84876b1f56fbd8719f43c/users/9ad072f4c2ed41ac8ffafd8fc2034b39/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:39.520926 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6f764-2077-4e87-a28c-ea88d41a5e30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91c83794dce84876b1f56fbd8719f43c, user_id=9ad072f4c2ed41ac8ffafd8fc2034b39, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:39.523917 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6f764-2077-4e87-a28c-ea88d41a5e30 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:39.642169 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 991/2007] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:34:39 2022] PUT /identity/v3/projects/91c83794dce84876b1f56fbd8719f43c/users/9ad072f4c2ed41ac8ffafd8fc2034b39/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:39.647219 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca920537-24a3-427a-96f8-e8685abfa572 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:39.647767 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca920537-24a3-427a-96f8-e8685abfa572 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:39.648017 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca920537-24a3-427a-96f8-e8685abfa572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:39.686687 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-ca920537-24a3-427a-96f8-e8685abfa572 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:39.687979 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ca920537-24a3-427a-96f8-e8685abfa572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:39.764982 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1017/2008] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:39.803838 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6f764-2077-4e87-a28c-ea88d41a5e30 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:39.806459 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-afa6f764-2077-4e87-a28c-ea88d41a5e30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:39.882579 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6f764-2077-4e87-a28c-ea88d41a5e30 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:39.886899 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21054727-a8e5-4a4d-9730-507ddfabf881 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:39.887849 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21054727-a8e5-4a4d-9730-507ddfabf881 service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:39.888386 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21054727-a8e5-4a4d-9730-507ddfabf881 service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:39.888763 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21054727-a8e5-4a4d-9730-507ddfabf881 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:39.902828 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21054727-a8e5-4a4d-9730-507ddfabf881 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:39.904546 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21054727-a8e5-4a4d-9730-507ddfabf881 service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:39.917631 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 992/2009] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:34:39.923827 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca920537-24a3-427a-96f8-e8685abfa572 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:39.925593 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ca920537-24a3-427a-96f8-e8685abfa572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:39.940834 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca920537-24a3-427a-96f8-e8685abfa572 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:39.947330 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1bc6e1-e6ca-4826-81bb-102b7ff23589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:39.948969 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1bc6e1-e6ca-4826-81bb-102b7ff23589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:39.949426 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1bc6e1-e6ca-4826-81bb-102b7ff23589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:39.950174 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1bc6e1-e6ca-4826-81bb-102b7ff23589 admin admin] PATH_INFO: `/v3/users/0d38c7557e864e868f5bfe72c41cc8d3` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:39.952838 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1bc6e1-e6ca-4826-81bb-102b7ff23589 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d38c7557e864e868f5bfe72c41cc8d3)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:39.956973 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1bc6e1-e6ca-4826-81bb-102b7ff23589 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:40.218011 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:40.257453 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-2b1bc6e1-e6ca-4826-81bb-102b7ff23589 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d38c7557e864e868f5bfe72c41cc8d3'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:40.429967 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-2b1bc6e1-e6ca-4826-81bb-102b7ff23589 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d38c7557e864e868f5bfe72c41cc8d3'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:40.430619 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-2b1bc6e1-e6ca-4826-81bb-102b7ff23589 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d38c7557e864e868f5bfe72c41cc8d3'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:40.441961 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-2b1bc6e1-e6ca-4826-81bb-102b7ff23589 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d38c7557e864e868f5bfe72c41cc8d3'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:40.456786 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-2b1bc6e1-e6ca-4826-81bb-102b7ff23589 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d38c7557e864e868f5bfe72c41cc8d3'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:40.462983 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1018/2010] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:34:39 2022] DELETE /identity/v3/users/0d38c7557e864e868f5bfe72c41cc8d3 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:40.467919 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5d1ae-a72e-43fb-a18a-3f217a0ba860 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:40.468206 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5d1ae-a72e-43fb-a18a-3f217a0ba860 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:40.468483 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5d1ae-a72e-43fb-a18a-3f217a0ba860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:40.487931 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-2ae5d1ae-a72e-43fb-a18a-3f217a0ba860 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:40.489056 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-2ae5d1ae-a72e-43fb-a18a-3f217a0ba860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:40.561090 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 993/2011] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:34:40.575228 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1bc6e1-e6ca-4826-81bb-102b7ff23589 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:40.577574 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-2b1bc6e1-e6ca-4826-81bb-102b7ff23589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:40.677867 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1bc6e1-e6ca-4826-81bb-102b7ff23589 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:40.688193 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10f529-742a-4bd2-8693-68f028a3beb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:40.688796 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10f529-742a-4bd2-8693-68f028a3beb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:40.689155 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10f529-742a-4bd2-8693-68f028a3beb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:40.690275 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10f529-742a-4bd2-8693-68f028a3beb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:40.711873 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c10f529-742a-4bd2-8693-68f028a3beb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:40.713491 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c10f529-742a-4bd2-8693-68f028a3beb4 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:40.731367 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1019/2012] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:34:41.513361 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:41.562414 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5d1ae-a72e-43fb-a18a-3f217a0ba860 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:41.564165 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-2ae5d1ae-a72e-43fb-a18a-3f217a0ba860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:41.594934 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5d1ae-a72e-43fb-a18a-3f217a0ba860 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:41.602149 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1558bb-2eb3-47f3-bcbb-1342d2e26940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:41.602475 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1558bb-2eb3-47f3-bcbb-1342d2e26940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:41.602762 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1558bb-2eb3-47f3-bcbb-1342d2e26940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:41.603115 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1558bb-2eb3-47f3-bcbb-1342d2e26940 admin admin] PATH_INFO: `/v3/projects/a591ee1186794514a8d5f684dfae5819` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:41.604553 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1558bb-2eb3-47f3-bcbb-1342d2e26940 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a591ee1186794514a8d5f684dfae5819)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:41.606937 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1558bb-2eb3-47f3-bcbb-1342d2e26940 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:41.754670 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-3d1558bb-2eb3-47f3-bcbb-1342d2e26940 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a591ee1186794514a8d5f684dfae5819', 'request_id': 'req-3d1558bb-2eb3-47f3-bcbb-1342d2e26940'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:41.863369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-3d1558bb-2eb3-47f3-bcbb-1342d2e26940 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a591ee1186794514a8d5f684dfae5819', 'request_id': 'req-3d1558bb-2eb3-47f3-bcbb-1342d2e26940'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:41.873642 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-3d1558bb-2eb3-47f3-bcbb-1342d2e26940 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a591ee1186794514a8d5f684dfae5819', 'request_id': 'req-3d1558bb-2eb3-47f3-bcbb-1342d2e26940'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:41.888737 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-3d1558bb-2eb3-47f3-bcbb-1342d2e26940 admin admin] The token cache is being invalidate because project a591ee1186794514a8d5f684dfae5819 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:34:41.889157 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-3d1558bb-2eb3-47f3-bcbb-1342d2e26940 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:41.889893 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-3d1558bb-2eb3-47f3-bcbb-1342d2e26940 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:41.891661 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 994/2013] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:34:41 2022] DELETE /identity/v3/projects/a591ee1186794514a8d5f684dfae5819 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:41.896361 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10f529-742a-4bd2-8693-68f028a3beb4 service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:41.908452 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10f529-742a-4bd2-8693-68f028a3beb4 service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:41.971000 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92baeffd-1f4f-4271-ad80-98c1472c891d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:41.972065 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92baeffd-1f4f-4271-ad80-98c1472c891d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:41.972354 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92baeffd-1f4f-4271-ad80-98c1472c891d admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:41.972632 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92baeffd-1f4f-4271-ad80-98c1472c891d admin admin] PATH_INFO: `/v3/users/89365f5893db44ca97d2d404b666a27c` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:41.974090 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92baeffd-1f4f-4271-ad80-98c1472c891d admin admin] RBAC: Authorizing `identity:delete_user(user_id=89365f5893db44ca97d2d404b666a27c)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:41.976081 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92baeffd-1f4f-4271-ad80-98c1472c891d admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:42.208922 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-92baeffd-1f4f-4271-ad80-98c1472c891d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89365f5893db44ca97d2d404b666a27c'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:42.316317 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-92baeffd-1f4f-4271-ad80-98c1472c891d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89365f5893db44ca97d2d404b666a27c'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:42.317066 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-92baeffd-1f4f-4271-ad80-98c1472c891d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89365f5893db44ca97d2d404b666a27c'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:42.328088 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-92baeffd-1f4f-4271-ad80-98c1472c891d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89365f5893db44ca97d2d404b666a27c'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:42.357429 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-92baeffd-1f4f-4271-ad80-98c1472c891d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89365f5893db44ca97d2d404b666a27c'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:42.371777 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1020/2014] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:34:41 2022] DELETE /identity/v3/users/89365f5893db44ca97d2d404b666a27c => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:42.674305 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85b892-dba4-43c8-b248-cc192dd4ee73 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:42.674305 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85b892-dba4-43c8-b248-cc192dd4ee73 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:42.674305 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85b892-dba4-43c8-b248-cc192dd4ee73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:42.696577 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92baeffd-1f4f-4271-ad80-98c1472c891d admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:42.699076 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-92baeffd-1f4f-4271-ad80-98c1472c891d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:42.720055 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-5d85b892-dba4-43c8-b248-cc192dd4ee73 None None] MFA Rules not processed for user `9ad072f4c2ed41ac8ffafd8fc2034b39`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:42.722688 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-5d85b892-dba4-43c8-b248-cc192dd4ee73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:42.861811 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 995/2015] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:42.869064 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92baeffd-1f4f-4271-ad80-98c1472c891d admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:42.869529 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85b892-dba4-43c8-b248-cc192dd4ee73 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:42.872068 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-5d85b892-dba4-43c8-b248-cc192dd4ee73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:42.886844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85b892-dba4-43c8-b248-cc192dd4ee73 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:42.892796 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec07402-22b7-4d71-a644-1a620cdf1f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:42.893940 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec07402-22b7-4d71-a644-1a620cdf1f36 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:42.894456 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec07402-22b7-4d71-a644-1a620cdf1f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:42.894895 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec07402-22b7-4d71-a644-1a620cdf1f36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:42.895773 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec07402-22b7-4d71-a644-1a620cdf1f36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:42.897554 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e08dd-5c1c-4332-b093-a8d205a39e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:42.899041 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec07402-22b7-4d71-a644-1a620cdf1f36 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:42.902606 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e08dd-5c1c-4332-b093-a8d205a39e21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:42.906428 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e08dd-5c1c-4332-b093-a8d205a39e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:42.906428 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e08dd-5c1c-4332-b093-a8d205a39e21 admin admin] PATH_INFO: `/v3/users/d1a57a63100247e0887076c4121a77f4` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:42.914844 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e08dd-5c1c-4332-b093-a8d205a39e21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1a57a63100247e0887076c4121a77f4)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:42.919221 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e08dd-5c1c-4332-b093-a8d205a39e21 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:43.060350 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 996/2016] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:34:42 2022] POST /identity/v3/projects => generated 373 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:34:43.064433 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec07402-22b7-4d71-a644-1a620cdf1f36 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:43.124598 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:43.186135 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-733e08dd-5c1c-4332-b093-a8d205a39e21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1a57a63100247e0887076c4121a77f4'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:43.210132 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec07402-22b7-4d71-a644-1a620cdf1f36 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:43.217813 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc37f1c-28f7-41d2-8119-cf1fdf656e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:43.218531 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc37f1c-28f7-41d2-8119-cf1fdf656e21 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:43.218819 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc37f1c-28f7-41d2-8119-cf1fdf656e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:43.219148 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc37f1c-28f7-41d2-8119-cf1fdf656e21 admin admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:43.219908 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc37f1c-28f7-41d2-8119-cf1fdf656e21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:43.221885 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc37f1c-28f7-41d2-8119-cf1fdf656e21 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:43.351912 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-733e08dd-5c1c-4332-b093-a8d205a39e21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1a57a63100247e0887076c4121a77f4'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:43.352778 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-733e08dd-5c1c-4332-b093-a8d205a39e21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1a57a63100247e0887076c4121a77f4'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:43.364035 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-733e08dd-5c1c-4332-b093-a8d205a39e21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1a57a63100247e0887076c4121a77f4'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:43.380238 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-733e08dd-5c1c-4332-b093-a8d205a39e21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1a57a63100247e0887076c4121a77f4'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:43.393227 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1021/2017] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:34:42 2022] DELETE /identity/v3/users/d1a57a63100247e0887076c4121a77f4 => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:43.393227 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e08dd-5c1c-4332-b093-a8d205a39e21 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:43.396269 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 997/2018] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:34:43 2022] POST /identity/v3/users => generated 293 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:34:43.396959 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-733e08dd-5c1c-4332-b093-a8d205a39e21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:43.398198 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a306f-b9f0-4614-8a49-ceafbcd0e3b2 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:43.398544 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a306f-b9f0-4614-8a49-ceafbcd0e3b2 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:43.398832 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a306f-b9f0-4614-8a49-ceafbcd0e3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:43.425243 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-be3a306f-b9f0-4614-8a49-ceafbcd0e3b2 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:43.433327 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-be3a306f-b9f0-4614-8a49-ceafbcd0e3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:43.504741 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 998/2019] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:43.505933 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a306f-b9f0-4614-8a49-ceafbcd0e3b2 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:43.507468 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-be3a306f-b9f0-4614-8a49-ceafbcd0e3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:43.521722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a306f-b9f0-4614-8a49-ceafbcd0e3b2 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:43.528393 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f49e0-2536-4bea-8189-205fb20ba4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:43.529003 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f49e0-2536-4bea-8189-205fb20ba4ad admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:43.529298 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f49e0-2536-4bea-8189-205fb20ba4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:43.529579 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f49e0-2536-4bea-8189-205fb20ba4ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:43.530450 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05f49e0-2536-4bea-8189-205fb20ba4ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:43.536819 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05f49e0-2536-4bea-8189-205fb20ba4ad admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:43.539233 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e08dd-5c1c-4332-b093-a8d205a39e21 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:43.547903 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f683e-c4e4-4017-abc8-2bb70f71c67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:43.548795 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f683e-c4e4-4017-abc8-2bb70f71c67e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:43.549084 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f683e-c4e4-4017-abc8-2bb70f71c67e admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:43.549369 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f683e-c4e4-4017-abc8-2bb70f71c67e admin admin] PATH_INFO: `/v3/projects/a59f524cc6de4f318f80811947815a07` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:43.550664 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210f683e-c4e4-4017-abc8-2bb70f71c67e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a59f524cc6de4f318f80811947815a07)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:43.552816 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210f683e-c4e4-4017-abc8-2bb70f71c67e admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:43.556411 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 999/2020] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:43.557723 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f49e0-2536-4bea-8189-205fb20ba4ad admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:43.559568 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-e05f49e0-2536-4bea-8189-205fb20ba4ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:43.584360 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:43.630546 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f49e0-2536-4bea-8189-205fb20ba4ad admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:43.634712 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790d3ee-134d-4d01-8b3e-6c6c0a67d290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:43.635591 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790d3ee-134d-4d01-8b3e-6c6c0a67d290 service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:43.635785 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790d3ee-134d-4d01-8b3e-6c6c0a67d290 service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:43.636654 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790d3ee-134d-4d01-8b3e-6c6c0a67d290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:43.653786 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8790d3ee-134d-4d01-8b3e-6c6c0a67d290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:43.655289 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8790d3ee-134d-4d01-8b3e-6c6c0a67d290 service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:43.665767 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1000/2021] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:34:43.666394 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790d3ee-134d-4d01-8b3e-6c6c0a67d290 service neutron] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:43.677425 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790d3ee-134d-4d01-8b3e-6c6c0a67d290 service neutron] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:43.682571 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e2c70-57da-4086-a08b-c16afe307ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:43.683821 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e2c70-57da-4086-a08b-c16afe307ae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:43.684082 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e2c70-57da-4086-a08b-c16afe307ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:43.684355 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e2c70-57da-4086-a08b-c16afe307ae5 admin admin] PATH_INFO: `/v3/projects/288b678a02c64942be83319f5f9946d0/users/1768cc77c26840dbafd527d47d2bdebf/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:43.725305 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27e2c70-57da-4086-a08b-c16afe307ae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=288b678a02c64942be83319f5f9946d0, user_id=1768cc77c26840dbafd527d47d2bdebf, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:43.730989 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27e2c70-57da-4086-a08b-c16afe307ae5 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:43.741460 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-210f683e-c4e4-4017-abc8-2bb70f71c67e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a59f524cc6de4f318f80811947815a07', 'request_id': 'req-210f683e-c4e4-4017-abc8-2bb70f71c67e'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:43.749505 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-210f683e-c4e4-4017-abc8-2bb70f71c67e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a59f524cc6de4f318f80811947815a07', 'request_id': 'req-210f683e-c4e4-4017-abc8-2bb70f71c67e'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:43.880231 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1001/2022] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:34:43 2022] PUT /identity/v3/projects/288b678a02c64942be83319f5f9946d0/users/1768cc77c26840dbafd527d47d2bdebf/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:43.882380 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-210f683e-c4e4-4017-abc8-2bb70f71c67e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a59f524cc6de4f318f80811947815a07', 'request_id': 'req-210f683e-c4e4-4017-abc8-2bb70f71c67e'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:43.887726 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e2c70-57da-4086-a08b-c16afe307ae5 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:43.895244 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-210f683e-c4e4-4017-abc8-2bb70f71c67e admin admin] The token cache is being invalidate because project a59f524cc6de4f318f80811947815a07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:34:43.895769 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-210f683e-c4e4-4017-abc8-2bb70f71c67e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:43.896548 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-210f683e-c4e4-4017-abc8-2bb70f71c67e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:43.898313 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1022/2023] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:34:43 2022] DELETE /identity/v3/projects/a59f524cc6de4f318f80811947815a07 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:43.903273 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc7720-b2da-4ff5-ac33-30cb4a4a0a9d None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:43.903609 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc7720-b2da-4ff5-ac33-30cb4a4a0a9d None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:43.903896 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc7720-b2da-4ff5-ac33-30cb4a4a0a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:43.924455 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-5ffc7720-b2da-4ff5-ac33-30cb4a4a0a9d None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:43.925678 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-5ffc7720-b2da-4ff5-ac33-30cb4a4a0a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:43.964016 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e2c70-57da-4086-a08b-c16afe307ae5 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:43.969588 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0717a8d-28c4-4d30-8e2c-0b8d5fe1748a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:43.970266 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0717a8d-28c4-4d30-8e2c-0b8d5fe1748a admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:43.970554 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0717a8d-28c4-4d30-8e2c-0b8d5fe1748a admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:43.970838 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0717a8d-28c4-4d30-8e2c-0b8d5fe1748a admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:43.971603 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0717a8d-28c4-4d30-8e2c-0b8d5fe1748a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:43.973473 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0717a8d-28c4-4d30-8e2c-0b8d5fe1748a admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:43.984898 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1002/2024] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:43.988841 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0717a8d-28c4-4d30-8e2c-0b8d5fe1748a admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:43.990743 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-e0717a8d-28c4-4d30-8e2c-0b8d5fe1748a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:44.005692 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1023/2025] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:34:44.012489 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0717a8d-28c4-4d30-8e2c-0b8d5fe1748a admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:44.014632 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab3ee5-3906-4d51-bdaa-ae0559a2bdf4 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:44.014930 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab3ee5-3906-4d51-bdaa-ae0559a2bdf4 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:44.015212 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab3ee5-3906-4d51-bdaa-ae0559a2bdf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:44.023227 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa8bd9-d3f7-4bb7-b7bd-f535c685255f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:44.027695 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa8bd9-d3f7-4bb7-b7bd-f535c685255f admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:44.027695 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa8bd9-d3f7-4bb7-b7bd-f535c685255f admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:44.027695 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa8bd9-d3f7-4bb7-b7bd-f535c685255f admin admin] PATH_INFO: `/v3/projects/288b678a02c64942be83319f5f9946d0/users/1768cc77c26840dbafd527d47d2bdebf/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:44.028311 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa8bd9-d3f7-4bb7-b7bd-f535c685255f admin admin] RBAC: Authorizing `identity:create_grant(project_id=288b678a02c64942be83319f5f9946d0, user_id=1768cc77c26840dbafd527d47d2bdebf, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:44.031733 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa8bd9-d3f7-4bb7-b7bd-f535c685255f admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:44.042829 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-63ab3ee5-3906-4d51-bdaa-ae0559a2bdf4 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:44.044117 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-63ab3ee5-3906-4d51-bdaa-ae0559a2bdf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:44.048484 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1003/2026] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:34:43 2022] PUT /identity/v3/projects/288b678a02c64942be83319f5f9946d0/users/1768cc77c26840dbafd527d47d2bdebf/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:34:44.114755 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1024/2027] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:44.119070 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa8bd9-d3f7-4bb7-b7bd-f535c685255f admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:44.130733 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa8bd9-d3f7-4bb7-b7bd-f535c685255f admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:44.135836 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0166ce8-4bc3-4069-825f-45e928fd7d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:44.136605 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0166ce8-4bc3-4069-825f-45e928fd7d86 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:44.136886 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0166ce8-4bc3-4069-825f-45e928fd7d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:44.137162 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0166ce8-4bc3-4069-825f-45e928fd7d86 admin admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:44.137916 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0166ce8-4bc3-4069-825f-45e928fd7d86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:34:44.138219 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0166ce8-4bc3-4069-825f-45e928fd7d86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:44.139990 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0166ce8-4bc3-4069-825f-45e928fd7d86 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:44.152686 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1004/2028] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:34:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:34:44.157064 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab3ee5-3906-4d51-bdaa-ae0559a2bdf4 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:44.167894 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab3ee5-3906-4d51-bdaa-ae0559a2bdf4 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:44.175243 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541bc7d6-711e-4cc3-bec8-3e9edfb2e4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:44.176191 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0166ce8-4bc3-4069-825f-45e928fd7d86 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:44.176403 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bc7d6-711e-4cc3-bec8-3e9edfb2e4c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:44.176782 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bc7d6-711e-4cc3-bec8-3e9edfb2e4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:44.177173 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bc7d6-711e-4cc3-bec8-3e9edfb2e4c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:44.178225 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541bc7d6-711e-4cc3-bec8-3e9edfb2e4c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:44.178493 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-f0166ce8-4bc3-4069-825f-45e928fd7d86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:44.181057 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541bc7d6-711e-4cc3-bec8-3e9edfb2e4c7 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:44.195476 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0166ce8-4bc3-4069-825f-45e928fd7d86 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:44.204311 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b3fff-28d0-4a32-a926-d05ca4ffb2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:44.205544 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b3fff-28d0-4a32-a926-d05ca4ffb2dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:44.206093 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b3fff-28d0-4a32-a926-d05ca4ffb2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:44.206584 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b3fff-28d0-4a32-a926-d05ca4ffb2dd admin admin] PATH_INFO: `/v3/projects/188af2f8882d4e6e966bd6031c4b6fe4` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:44.208464 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b3fff-28d0-4a32-a926-d05ca4ffb2dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=188af2f8882d4e6e966bd6031c4b6fe4)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:44.214584 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b3fff-28d0-4a32-a926-d05ca4ffb2dd admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:44.288670 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1025/2029] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:34:44 2022] POST /identity/v3/projects => generated 375 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:34:44.293141 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541bc7d6-711e-4cc3-bec8-3e9edfb2e4c7 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:44.335027 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-619b3fff-28d0-4a32-a926-d05ca4ffb2dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '188af2f8882d4e6e966bd6031c4b6fe4', 'request_id': 'req-619b3fff-28d0-4a32-a926-d05ca4ffb2dd'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:44.367120 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541bc7d6-711e-4cc3-bec8-3e9edfb2e4c7 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:44.420977 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-619b3fff-28d0-4a32-a926-d05ca4ffb2dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '188af2f8882d4e6e966bd6031c4b6fe4', 'request_id': 'req-619b3fff-28d0-4a32-a926-d05ca4ffb2dd'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:44.427212 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-619b3fff-28d0-4a32-a926-d05ca4ffb2dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '188af2f8882d4e6e966bd6031c4b6fe4', 'request_id': 'req-619b3fff-28d0-4a32-a926-d05ca4ffb2dd'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:44.441385 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-619b3fff-28d0-4a32-a926-d05ca4ffb2dd admin admin] The token cache is being invalidate because project 188af2f8882d4e6e966bd6031c4b6fe4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:34:44.441783 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-619b3fff-28d0-4a32-a926-d05ca4ffb2dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:44.442490 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-619b3fff-28d0-4a32-a926-d05ca4ffb2dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:44.443399 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e5b4e-93dc-4ea9-9989-47335f1bc894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:44.444296 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e5b4e-93dc-4ea9-9989-47335f1bc894 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:44.444555 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e5b4e-93dc-4ea9-9989-47335f1bc894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:44.444674 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1005/2030] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:34:44 2022] DELETE /identity/v3/projects/188af2f8882d4e6e966bd6031c4b6fe4 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:44.444955 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e5b4e-93dc-4ea9-9989-47335f1bc894 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:44.445655 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40e5b4e-93dc-4ea9-9989-47335f1bc894 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:44.447755 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40e5b4e-93dc-4ea9-9989-47335f1bc894 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:44.448357 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b3fff-28d0-4a32-a926-d05ca4ffb2dd admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:44.449971 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-619b3fff-28d0-4a32-a926-d05ca4ffb2dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:44.467424 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b3fff-28d0-4a32-a926-d05ca4ffb2dd admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:44.472256 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef96f64-f60a-4c7d-9b1f-019791918c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:44.473140 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef96f64-f60a-4c7d-9b1f-019791918c1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:44.473421 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef96f64-f60a-4c7d-9b1f-019791918c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:44.473697 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef96f64-f60a-4c7d-9b1f-019791918c1d admin admin] PATH_INFO: `/v3/users/3376b797779249b5baed148266317d77` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:44.475048 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef96f64-f60a-4c7d-9b1f-019791918c1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3376b797779249b5baed148266317d77)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:44.477761 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef96f64-f60a-4c7d-9b1f-019791918c1d admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:44.526965 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1026/2031] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:34:44 2022] POST /identity/v3/users => generated 288 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:34:44.528076 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e5b4e-93dc-4ea9-9989-47335f1bc894 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:44.530277 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-e40e5b4e-93dc-4ea9-9989-47335f1bc894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:44.545353 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e5b4e-93dc-4ea9-9989-47335f1bc894 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:44.551361 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232c5f0-a6e9-465e-868b-a6e425c39917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:44.551826 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232c5f0-a6e9-465e-868b-a6e425c39917 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:44.552204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232c5f0-a6e9-465e-868b-a6e425c39917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:44.552585 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232c5f0-a6e9-465e-868b-a6e425c39917 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:44.553482 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d232c5f0-a6e9-465e-868b-a6e425c39917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:44.555170 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d232c5f0-a6e9-465e-868b-a6e425c39917 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:44.566158 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1027/2032] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:44.570152 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232c5f0-a6e9-465e-868b-a6e425c39917 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:44.581220 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232c5f0-a6e9-465e-868b-a6e425c39917 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:44.585978 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33460e-e2ab-4eab-99a6-9fa5bc43b2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:44.586627 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33460e-e2ab-4eab-99a6-9fa5bc43b2de admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:44.586909 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33460e-e2ab-4eab-99a6-9fa5bc43b2de admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:44.587185 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33460e-e2ab-4eab-99a6-9fa5bc43b2de admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:44.587946 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac33460e-e2ab-4eab-99a6-9fa5bc43b2de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:44.590299 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac33460e-e2ab-4eab-99a6-9fa5bc43b2de admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:44.602518 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1028/2033] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:44.611748 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33460e-e2ab-4eab-99a6-9fa5bc43b2de admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:44.625887 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33460e-e2ab-4eab-99a6-9fa5bc43b2de admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:44.628951 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53b84d-8144-4b56-9c7d-71a9cb4bd179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:44.629866 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53b84d-8144-4b56-9c7d-71a9cb4bd179 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:44.630164 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53b84d-8144-4b56-9c7d-71a9cb4bd179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:44.630439 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53b84d-8144-4b56-9c7d-71a9cb4bd179 admin admin] PATH_INFO: `/v3/projects/c7f3a6507d6a4016b25e0de19c1e7989/users/ff4fee13431b458aa8656473b792495a/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:44.654395 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f53b84d-8144-4b56-9c7d-71a9cb4bd179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7f3a6507d6a4016b25e0de19c1e7989, user_id=ff4fee13431b458aa8656473b792495a, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:44.655047 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f53b84d-8144-4b56-9c7d-71a9cb4bd179 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:44.687943 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-7ef96f64-f60a-4c7d-9b1f-019791918c1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3376b797779249b5baed148266317d77'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:44.746564 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1029/2034] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:34:44 2022] PUT /identity/v3/projects/c7f3a6507d6a4016b25e0de19c1e7989/users/ff4fee13431b458aa8656473b792495a/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:34:44.757665 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302dd42-c79b-427c-93c4-0662b178db2e None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:44.757954 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302dd42-c79b-427c-93c4-0662b178db2e None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:44.758261 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302dd42-c79b-427c-93c4-0662b178db2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:44.774947 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-7ef96f64-f60a-4c7d-9b1f-019791918c1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3376b797779249b5baed148266317d77'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:44.786505 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-3302dd42-c79b-427c-93c4-0662b178db2e None None] MFA Rules not processed for user `ff4fee13431b458aa8656473b792495a`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:44.787770 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3302dd42-c79b-427c-93c4-0662b178db2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:44.791809 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-7ef96f64-f60a-4c7d-9b1f-019791918c1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3376b797779249b5baed148266317d77'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:44.792686 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-7ef96f64-f60a-4c7d-9b1f-019791918c1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3376b797779249b5baed148266317d77'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:44.799751 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-7ef96f64-f60a-4c7d-9b1f-019791918c1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3376b797779249b5baed148266317d77'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:44.807641 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1006/2035] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:34:44 2022] DELETE /identity/v3/users/3376b797779249b5baed148266317d77 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:34:44.874073 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1030/2036] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:34:44.883226 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef96f64-f60a-4c7d-9b1f-019791918c1d admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:44.885903 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-7ef96f64-f60a-4c7d-9b1f-019791918c1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:44.993216 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef96f64-f60a-4c7d-9b1f-019791918c1d admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:44.998005 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a900ed-377b-4ddf-b555-94df706e2abb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a23a8e608f94d5d8153dcf7e79250f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:44.998659 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a900ed-377b-4ddf-b555-94df706e2abb service glance] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:44.999099 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a900ed-377b-4ddf-b555-94df706e2abb service glance] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:44.999296 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a900ed-377b-4ddf-b555-94df706e2abb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:45.061196 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a900ed-377b-4ddf-b555-94df706e2abb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:45.063265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a900ed-377b-4ddf-b555-94df706e2abb service glance] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:45.075633 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1007/2037] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:34:45.314383 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302dd42-c79b-427c-93c4-0662b178db2e None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:45.315975 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3302dd42-c79b-427c-93c4-0662b178db2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:45.431368 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302dd42-c79b-427c-93c4-0662b178db2e None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:45.448198 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:45.451015 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7929ac-719c-43a8-b150-8dd4e9536a50 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:45.451384 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7929ac-719c-43a8-b150-8dd4e9536a50 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:45.455470 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7929ac-719c-43a8-b150-8dd4e9536a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:45.491730 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-be7929ac-719c-43a8-b150-8dd4e9536a50 None None] MFA Rules not processed for user `1768cc77c26840dbafd527d47d2bdebf`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:45.493303 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-be7929ac-719c-43a8-b150-8dd4e9536a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:45.517573 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8c5b0-4e77-4c6b-be87-5ec423a82f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:45.518731 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8c5b0-4e77-4c6b-be87-5ec423a82f2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:45.519177 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8c5b0-4e77-4c6b-be87-5ec423a82f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:45.519785 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8c5b0-4e77-4c6b-be87-5ec423a82f2a admin admin] PATH_INFO: `/v3/projects/f9c6cc9bb4964c5c87b35d83687c341f` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:45.521703 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d8c5b0-4e77-4c6b-be87-5ec423a82f2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9c6cc9bb4964c5c87b35d83687c341f)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:45.524358 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d8c5b0-4e77-4c6b-be87-5ec423a82f2a admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:45.586440 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1008/2038] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:45 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:34:45.599024 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304cbd3b-f520-46a4-8b46-559735c79407 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:45.604607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304cbd3b-f520-46a4-8b46-559735c79407 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:45.604607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304cbd3b-f520-46a4-8b46-559735c79407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:45.622175 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-304cbd3b-f520-46a4-8b46-559735c79407 None None] MFA Rules not processed for user `9ad072f4c2ed41ac8ffafd8fc2034b39`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:45.623348 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-304cbd3b-f520-46a4-8b46-559735c79407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:45.684797 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-06d8c5b0-4e77-4c6b-be87-5ec423a82f2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9c6cc9bb4964c5c87b35d83687c341f', 'request_id': 'req-06d8c5b0-4e77-4c6b-be87-5ec423a82f2a'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:45.691664 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-06d8c5b0-4e77-4c6b-be87-5ec423a82f2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9c6cc9bb4964c5c87b35d83687c341f', 'request_id': 'req-06d8c5b0-4e77-4c6b-be87-5ec423a82f2a'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:45.694923 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1009/2039] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:34:45.708654 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304cbd3b-f520-46a4-8b46-559735c79407 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:45.710335 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-304cbd3b-f520-46a4-8b46-559735c79407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:45.769790 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-06d8c5b0-4e77-4c6b-be87-5ec423a82f2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9c6cc9bb4964c5c87b35d83687c341f', 'request_id': 'req-06d8c5b0-4e77-4c6b-be87-5ec423a82f2a'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:45.784267 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-06d8c5b0-4e77-4c6b-be87-5ec423a82f2a admin admin] The token cache is being invalidate because project f9c6cc9bb4964c5c87b35d83687c341f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:34:45.784653 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-06d8c5b0-4e77-4c6b-be87-5ec423a82f2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:45.785207 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-06d8c5b0-4e77-4c6b-be87-5ec423a82f2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:45.787088 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1031/2040] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:34:45 2022] DELETE /identity/v3/projects/f9c6cc9bb4964c5c87b35d83687c341f => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:45.791772 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee6625-7c55-4abf-8598-6b8ec2aee1e0 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:45.792269 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee6625-7c55-4abf-8598-6b8ec2aee1e0 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:45.792670 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee6625-7c55-4abf-8598-6b8ec2aee1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:45.801607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304cbd3b-f520-46a4-8b46-559735c79407 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:45.812962 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:45.817873 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-c2ee6625-7c55-4abf-8598-6b8ec2aee1e0 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:45.820512 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-c2ee6625-7c55-4abf-8598-6b8ec2aee1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:45.884059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf19255-6aa4-4b2e-92b3-aded70b5adc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:45.884965 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf19255-6aa4-4b2e-92b3-aded70b5adc4 service nova] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:45.885422 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf19255-6aa4-4b2e-92b3-aded70b5adc4 service nova] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:45.886310 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf19255-6aa4-4b2e-92b3-aded70b5adc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:45.888571 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-cbf19255-6aa4-4b2e-92b3-aded70b5adc4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:45.899593 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1032/2041] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:34:45.905433 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771185ba-7f9c-409e-a909-64a8e89c8aa2 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:45.905996 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771185ba-7f9c-409e-a909-64a8e89c8aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:45.906348 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771185ba-7f9c-409e-a909-64a8e89c8aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:45.925358 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-771185ba-7f9c-409e-a909-64a8e89c8aa2 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:45.926861 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-771185ba-7f9c-409e-a909-64a8e89c8aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:45.935998 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1033/2042] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:45.940401 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771185ba-7f9c-409e-a909-64a8e89c8aa2 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:45.950242 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771185ba-7f9c-409e-a909-64a8e89c8aa2 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:45.956308 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e13df7-3acb-47c6-917e-7451119a9cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:45.959220 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e13df7-3acb-47c6-917e-7451119a9cff admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:45.959220 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e13df7-3acb-47c6-917e-7451119a9cff admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:45.959220 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e13df7-3acb-47c6-917e-7451119a9cff admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:45.959220 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e13df7-3acb-47c6-917e-7451119a9cff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:34:45.959220 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e13df7-3acb-47c6-917e-7451119a9cff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:45.961487 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e13df7-3acb-47c6-917e-7451119a9cff admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:45.980474 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf19255-6aa4-4b2e-92b3-aded70b5adc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:45.982151 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1034/2043] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:34:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:34:45.982151 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e13df7-3acb-47c6-917e-7451119a9cff admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:45.982379 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf19255-6aa4-4b2e-92b3-aded70b5adc4 service nova] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:45.997815 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e13df7-3acb-47c6-917e-7451119a9cff admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:46.002873 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1010/2044] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:34:46.015944 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f9bb4-d772-4ef6-b47e-c12bb88c088c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:46.015944 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f9bb4-d772-4ef6-b47e-c12bb88c088c admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:46.015944 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f9bb4-d772-4ef6-b47e-c12bb88c088c admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:46.015944 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f9bb4-d772-4ef6-b47e-c12bb88c088c admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:46.016286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3f9bb4-d772-4ef6-b47e-c12bb88c088c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:46.016286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3f9bb4-d772-4ef6-b47e-c12bb88c088c admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:46.151995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf19255-6aa4-4b2e-92b3-aded70b5adc4 service nova] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:46.152476 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1035/2045] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:34:45 2022] POST /identity/v3/projects => generated 371 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:34:46.168178 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf19255-6aa4-4b2e-92b3-aded70b5adc4 service nova] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:46.268698 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e27b1-2068-455b-8428-2b7592931dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:46.269716 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e27b1-2068-455b-8428-2b7592931dfb admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:46.270187 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e27b1-2068-455b-8428-2b7592931dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:46.270606 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e27b1-2068-455b-8428-2b7592931dfb admin admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:46.273124 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e27b1-2068-455b-8428-2b7592931dfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:46.276045 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e27b1-2068-455b-8428-2b7592931dfb admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:46.361464 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1011/2046] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:34:46 2022] POST /identity/v3/users => generated 286 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 19:34:46.362275 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f9bb4-d772-4ef6-b47e-c12bb88c088c admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:46.373285 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f9bb4-d772-4ef6-b47e-c12bb88c088c admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:46.378547 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b50896-52d4-4aba-a432-296579092b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:46.379523 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b50896-52d4-4aba-a432-296579092b75 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:46.379860 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b50896-52d4-4aba-a432-296579092b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:46.380154 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b50896-52d4-4aba-a432-296579092b75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:46.380894 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b50896-52d4-4aba-a432-296579092b75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:46.382519 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b50896-52d4-4aba-a432-296579092b75 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:46.396961 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1036/2047] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 19:34:46.398366 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e27b1-2068-455b-8428-2b7592931dfb admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:46.409162 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e27b1-2068-455b-8428-2b7592931dfb admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:46.414213 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff64ade2-615d-4bb1-be9a-a4da6b86a926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:46.414914 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64ade2-615d-4bb1-be9a-a4da6b86a926 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:46.415198 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64ade2-615d-4bb1-be9a-a4da6b86a926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:46.415501 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64ade2-615d-4bb1-be9a-a4da6b86a926 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:46.416225 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff64ade2-615d-4bb1-be9a-a4da6b86a926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:46.417862 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff64ade2-615d-4bb1-be9a-a4da6b86a926 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:46.431654 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1012/2048] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:46.433403 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b50896-52d4-4aba-a432-296579092b75 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:46.444676 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b50896-52d4-4aba-a432-296579092b75 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:46.449740 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de42ae-9e41-4170-b11c-5a191e57a6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:46.453291 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de42ae-9e41-4170-b11c-5a191e57a6c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:46.453291 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de42ae-9e41-4170-b11c-5a191e57a6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:46.453291 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de42ae-9e41-4170-b11c-5a191e57a6c0 admin admin] PATH_INFO: `/v3/projects/e76258ec8bc8418ca8d84c09d419e643/users/8e12e9c081a042fa9673caa12d03c06f/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:46.468259 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de42ae-9e41-4170-b11c-5a191e57a6c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e76258ec8bc8418ca8d84c09d419e643, user_id=8e12e9c081a042fa9673caa12d03c06f, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:46.470968 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de42ae-9e41-4170-b11c-5a191e57a6c0 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:46.550335 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1037/2049] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:34:46 2022] PUT /identity/v3/projects/e76258ec8bc8418ca8d84c09d419e643/users/8e12e9c081a042fa9673caa12d03c06f/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:34:46.562172 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2cf97-330c-4b94-968d-f75c57a68687 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:46.562463 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2cf97-330c-4b94-968d-f75c57a68687 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:46.562771 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2cf97-330c-4b94-968d-f75c57a68687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:46.595544 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-4ec2cf97-330c-4b94-968d-f75c57a68687 None None] MFA Rules not processed for user `8e12e9c081a042fa9673caa12d03c06f`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:46.619202 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-4ec2cf97-330c-4b94-968d-f75c57a68687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:46.701025 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1013/2050] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:46.715002 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de42ae-9e41-4170-b11c-5a191e57a6c0 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:46.718097 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-d5de42ae-9e41-4170-b11c-5a191e57a6c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:46.812240 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de42ae-9e41-4170-b11c-5a191e57a6c0 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:46.816937 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92f82d-87ae-4110-a1f0-814dadc3031f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:46.817694 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92f82d-87ae-4110-a1f0-814dadc3031f service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:46.817925 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92f82d-87ae-4110-a1f0-814dadc3031f service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:46.818245 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92f82d-87ae-4110-a1f0-814dadc3031f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:46.827256 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d92f82d-87ae-4110-a1f0-814dadc3031f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:46.828781 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d92f82d-87ae-4110-a1f0-814dadc3031f service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:46.840593 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1038/2051] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:34:46.863255 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec2cf97-330c-4b94-968d-f75c57a68687 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:46.994744 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec2cf97-330c-4b94-968d-f75c57a68687 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:47.012250 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a22e093-c1f2-44dc-a50d-251d0ade4556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:47.013005 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22e093-c1f2-44dc-a50d-251d0ade4556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:47.016702 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22e093-c1f2-44dc-a50d-251d0ade4556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:47.016702 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22e093-c1f2-44dc-a50d-251d0ade4556 admin admin] PATH_INFO: `/v3/users/8e12e9c081a042fa9673caa12d03c06f` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:47.016702 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a22e093-c1f2-44dc-a50d-251d0ade4556 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e12e9c081a042fa9673caa12d03c06f)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:47.017300 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a22e093-c1f2-44dc-a50d-251d0ade4556 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:47.347877 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-7a22e093-c1f2-44dc-a50d-251d0ade4556 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e12e9c081a042fa9673caa12d03c06f'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:47.410290 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-7a22e093-c1f2-44dc-a50d-251d0ade4556 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e12e9c081a042fa9673caa12d03c06f'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:47.419889 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-7a22e093-c1f2-44dc-a50d-251d0ade4556 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e12e9c081a042fa9673caa12d03c06f'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:47.420628 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-7a22e093-c1f2-44dc-a50d-251d0ade4556 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e12e9c081a042fa9673caa12d03c06f'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:47.428413 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-7a22e093-c1f2-44dc-a50d-251d0ade4556 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e12e9c081a042fa9673caa12d03c06f'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:47.435128 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1014/2052] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:34:46 2022] DELETE /identity/v3/users/8e12e9c081a042fa9673caa12d03c06f => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:47.440400 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ac031-eaff-45df-8cda-ca1dac52fccd None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:47.440885 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ac031-eaff-45df-8cda-ca1dac52fccd None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:47.441036 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ac031-eaff-45df-8cda-ca1dac52fccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:47.463315 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-ee4ac031-eaff-45df-8cda-ca1dac52fccd None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:47.464896 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ee4ac031-eaff-45df-8cda-ca1dac52fccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:47.537350 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1039/2053] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:47.545105 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a22e093-c1f2-44dc-a50d-251d0ade4556 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:47.546545 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-7a22e093-c1f2-44dc-a50d-251d0ade4556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:47.627212 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a22e093-c1f2-44dc-a50d-251d0ade4556 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:47.630770 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a5780-288f-459b-a75e-f9d764c64a08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:47.631420 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a5780-288f-459b-a75e-f9d764c64a08 service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:47.631729 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a5780-288f-459b-a75e-f9d764c64a08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:47.632007 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a5780-288f-459b-a75e-f9d764c64a08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:47.640958 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a5780-288f-459b-a75e-f9d764c64a08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:47.642485 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a5780-288f-459b-a75e-f9d764c64a08 service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:47.651910 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1015/2054] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:34:47.695856 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:47.958574 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:48.092954 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4ac031-eaff-45df-8cda-ca1dac52fccd None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:48.095065 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ee4ac031-eaff-45df-8cda-ca1dac52fccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:48.119091 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4ac031-eaff-45df-8cda-ca1dac52fccd None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:48.121485 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9661c1-e461-4e37-9942-c9cfb721724c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:48.122361 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9661c1-e461-4e37-9942-c9cfb721724c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:48.122878 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9661c1-e461-4e37-9942-c9cfb721724c admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:48.123164 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9661c1-e461-4e37-9942-c9cfb721724c admin admin] PATH_INFO: `/v3/projects/e76258ec8bc8418ca8d84c09d419e643` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:48.124908 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9661c1-e461-4e37-9942-c9cfb721724c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e76258ec8bc8418ca8d84c09d419e643)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:48.128231 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9661c1-e461-4e37-9942-c9cfb721724c admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:48.283516 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-9b9661c1-e461-4e37-9942-c9cfb721724c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e76258ec8bc8418ca8d84c09d419e643', 'request_id': 'req-9b9661c1-e461-4e37-9942-c9cfb721724c'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:48.290332 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-9b9661c1-e461-4e37-9942-c9cfb721724c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e76258ec8bc8418ca8d84c09d419e643', 'request_id': 'req-9b9661c1-e461-4e37-9942-c9cfb721724c'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:48.406356 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-9b9661c1-e461-4e37-9942-c9cfb721724c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e76258ec8bc8418ca8d84c09d419e643', 'request_id': 'req-9b9661c1-e461-4e37-9942-c9cfb721724c'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:48.418306 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-9b9661c1-e461-4e37-9942-c9cfb721724c admin admin] The token cache is being invalidate because project e76258ec8bc8418ca8d84c09d419e643 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:34:48.418527 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-9b9661c1-e461-4e37-9942-c9cfb721724c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:48.419196 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-9b9661c1-e461-4e37-9942-c9cfb721724c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:48.421464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1040/2055] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:34:48 2022] DELETE /identity/v3/projects/e76258ec8bc8418ca8d84c09d419e643 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:48.426668 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2d170-795a-401d-a6d0-cd2dfe136d74 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:48.427856 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2d170-795a-401d-a6d0-cd2dfe136d74 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:48.428373 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2d170-795a-401d-a6d0-cd2dfe136d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:48.450730 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-cca2d170-795a-401d-a6d0-cd2dfe136d74 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:48.452189 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-cca2d170-795a-401d-a6d0-cd2dfe136d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:48.527118 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1016/2056] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:48.533609 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5c994-a930-4711-bf89-9c42beda224c None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:48.534145 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5c994-a930-4711-bf89-9c42beda224c None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:48.534416 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5c994-a930-4711-bf89-9c42beda224c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:48.560541 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-f5f5c994-a930-4711-bf89-9c42beda224c None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:48.560541 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f5f5c994-a930-4711-bf89-9c42beda224c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:48.564701 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1041/2057] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:48.569706 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2d170-795a-401d-a6d0-cd2dfe136d74 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:48.581122 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2d170-795a-401d-a6d0-cd2dfe136d74 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:48.589222 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d0b1c-4554-4a17-9c4f-b3823f0394bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:48.589222 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d0b1c-4554-4a17-9c4f-b3823f0394bc admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:48.589222 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d0b1c-4554-4a17-9c4f-b3823f0394bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:48.589222 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d0b1c-4554-4a17-9c4f-b3823f0394bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:48.589632 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d0b1c-4554-4a17-9c4f-b3823f0394bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:34:48.589632 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d0b1c-4554-4a17-9c4f-b3823f0394bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:48.590956 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d0b1c-4554-4a17-9c4f-b3823f0394bc admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:48.609604 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1017/2058] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:34:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:34:48.610861 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f5c994-a930-4711-bf89-9c42beda224c None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:48.621521 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f5c994-a930-4711-bf89-9c42beda224c None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:48.627411 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f7124-8e52-47e2-8511-5091871804d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:48.628225 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f7124-8e52-47e2-8511-5091871804d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:48.628518 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f7124-8e52-47e2-8511-5091871804d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:48.628820 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f7124-8e52-47e2-8511-5091871804d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:48.629586 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f7124-8e52-47e2-8511-5091871804d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:48.631642 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f7124-8e52-47e2-8511-5091871804d9 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:48.754772 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1042/2059] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:34:48 2022] POST /identity/v3/projects => generated 375 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:34:48.759275 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d0b1c-4554-4a17-9c4f-b3823f0394bc admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:48.771064 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d0b1c-4554-4a17-9c4f-b3823f0394bc admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:48.846558 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe68f5-48c3-4cbe-9a6f-0c57aca3a08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:48.847236 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe68f5-48c3-4cbe-9a6f-0c57aca3a08f admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:48.847593 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe68f5-48c3-4cbe-9a6f-0c57aca3a08f admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:48.847873 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe68f5-48c3-4cbe-9a6f-0c57aca3a08f admin admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:48.848584 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe68f5-48c3-4cbe-9a6f-0c57aca3a08f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:48.850476 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe68f5-48c3-4cbe-9a6f-0c57aca3a08f admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:48.952760 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1018/2060] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:34:48 2022] POST /identity/v3/users => generated 288 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:34:48.958175 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f7124-8e52-47e2-8511-5091871804d9 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:48.969849 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f7124-8e52-47e2-8511-5091871804d9 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:48.974745 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6793949-1ad1-49f7-a177-61588cb0f64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:48.975463 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6793949-1ad1-49f7-a177-61588cb0f64c admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:48.975760 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6793949-1ad1-49f7-a177-61588cb0f64c admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:48.976089 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6793949-1ad1-49f7-a177-61588cb0f64c admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:48.976877 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6793949-1ad1-49f7-a177-61588cb0f64c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:48.978557 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6793949-1ad1-49f7-a177-61588cb0f64c admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:48.991603 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1043/2061] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:48.996008 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe68f5-48c3-4cbe-9a6f-0c57aca3a08f admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:49.006691 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe68f5-48c3-4cbe-9a6f-0c57aca3a08f admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:49.012635 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610db0a-bcfa-4110-8229-a4f59042704a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:49.013306 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610db0a-bcfa-4110-8229-a4f59042704a admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:49.013596 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610db0a-bcfa-4110-8229-a4f59042704a admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:49.013877 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610db0a-bcfa-4110-8229-a4f59042704a admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:49.015948 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610db0a-bcfa-4110-8229-a4f59042704a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:49.016351 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610db0a-bcfa-4110-8229-a4f59042704a admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:49.026990 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1019/2062] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:49.031126 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6793949-1ad1-49f7-a177-61588cb0f64c admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:49.042324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6793949-1ad1-49f7-a177-61588cb0f64c admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:49.051266 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c851258-dfe3-46b1-92da-5918229f8068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:49.052212 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c851258-dfe3-46b1-92da-5918229f8068 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:49.052496 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c851258-dfe3-46b1-92da-5918229f8068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:49.052772 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c851258-dfe3-46b1-92da-5918229f8068 admin admin] PATH_INFO: `/v3/projects/4c0aa977c08a465886afa88547d995b1/users/96be338da48448d2aa991bed2b4e2494/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:49.071613 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c851258-dfe3-46b1-92da-5918229f8068 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c0aa977c08a465886afa88547d995b1, user_id=96be338da48448d2aa991bed2b4e2494, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:49.075772 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c851258-dfe3-46b1-92da-5918229f8068 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:49.190772 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1044/2063] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:34:49 2022] PUT /identity/v3/projects/4c0aa977c08a465886afa88547d995b1/users/96be338da48448d2aa991bed2b4e2494/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:49.201352 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5caef2-70c8-4987-8e2f-b38752dea71c None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:49.201687 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5caef2-70c8-4987-8e2f-b38752dea71c None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:49.201971 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5caef2-70c8-4987-8e2f-b38752dea71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:49.238278 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-3a5caef2-70c8-4987-8e2f-b38752dea71c None None] MFA Rules not processed for user `96be338da48448d2aa991bed2b4e2494`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:49.239683 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-3a5caef2-70c8-4987-8e2f-b38752dea71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:49.309017 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1020/2064] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:49.312122 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c851258-dfe3-46b1-92da-5918229f8068 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:49.395321 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c851258-dfe3-46b1-92da-5918229f8068 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:49.400549 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745761a-816d-48ff-9a4a-97a6b1a9fd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:49.401382 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745761a-816d-48ff-9a4a-97a6b1a9fd5c admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:49.401738 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745761a-816d-48ff-9a4a-97a6b1a9fd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:49.402102 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745761a-816d-48ff-9a4a-97a6b1a9fd5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:49.402871 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e745761a-816d-48ff-9a4a-97a6b1a9fd5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:49.405134 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e745761a-816d-48ff-9a4a-97a6b1a9fd5c admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:49.551919 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1045/2065] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:34:49 2022] POST /identity/v3/projects => generated 375 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:34:49.553355 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5caef2-70c8-4987-8e2f-b38752dea71c None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:49.565334 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5caef2-70c8-4987-8e2f-b38752dea71c None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:49.628599 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9893a8b-42fe-4355-bf76-91f94c740649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:49.629298 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9893a8b-42fe-4355-bf76-91f94c740649 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:49.629585 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9893a8b-42fe-4355-bf76-91f94c740649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:49.629866 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9893a8b-42fe-4355-bf76-91f94c740649 admin admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:49.631090 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9893a8b-42fe-4355-bf76-91f94c740649 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:49.632622 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9893a8b-42fe-4355-bf76-91f94c740649 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:49.750198 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1021/2066] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:34:49 2022] POST /identity/v3/users => generated 288 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 19:34:49.754785 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745761a-816d-48ff-9a4a-97a6b1a9fd5c admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:49.772638 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745761a-816d-48ff-9a4a-97a6b1a9fd5c admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:49.779001 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8616cb-cc88-4fa4-af9e-eef7f1da48ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:49.779715 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8616cb-cc88-4fa4-af9e-eef7f1da48ac admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:49.780000 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8616cb-cc88-4fa4-af9e-eef7f1da48ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:49.780273 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8616cb-cc88-4fa4-af9e-eef7f1da48ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:49.781172 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8616cb-cc88-4fa4-af9e-eef7f1da48ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:49.782759 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8616cb-cc88-4fa4-af9e-eef7f1da48ac admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:49.794971 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1046/2067] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:49.799617 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9893a8b-42fe-4355-bf76-91f94c740649 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:49.811231 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9893a8b-42fe-4355-bf76-91f94c740649 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:49.816180 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab8cf2-1fd3-453e-81a3-00c0c4e04114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:49.816843 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab8cf2-1fd3-453e-81a3-00c0c4e04114 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:49.817128 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab8cf2-1fd3-453e-81a3-00c0c4e04114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:49.817406 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab8cf2-1fd3-453e-81a3-00c0c4e04114 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:49.818157 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab8cf2-1fd3-453e-81a3-00c0c4e04114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:49.819824 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab8cf2-1fd3-453e-81a3-00c0c4e04114 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:49.830694 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1022/2068] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:49.835047 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8616cb-cc88-4fa4-af9e-eef7f1da48ac admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:49.846796 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8616cb-cc88-4fa4-af9e-eef7f1da48ac admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:49.851544 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2e150-af54-4fa5-88c5-e32652138486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:49.852443 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2e150-af54-4fa5-88c5-e32652138486 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:49.852731 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2e150-af54-4fa5-88c5-e32652138486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:49.853011 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2e150-af54-4fa5-88c5-e32652138486 admin admin] PATH_INFO: `/v3/projects/017aced6f8d4496da2f2b4b52186a054/users/0469157c86414cacb83b3980abf615b9/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:49.869722 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2e150-af54-4fa5-88c5-e32652138486 admin admin] RBAC: Authorizing `identity:create_grant(project_id=017aced6f8d4496da2f2b4b52186a054, user_id=0469157c86414cacb83b3980abf615b9, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:49.873285 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2e150-af54-4fa5-88c5-e32652138486 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:49.950585 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:50.039595 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1047/2069] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:34:49 2022] PUT /identity/v3/projects/017aced6f8d4496da2f2b4b52186a054/users/0469157c86414cacb83b3980abf615b9/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:50.051629 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112eeee8-dc96-4a60-b0cc-07d1505a3329 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:50.052095 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112eeee8-dc96-4a60-b0cc-07d1505a3329 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:50.052603 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112eeee8-dc96-4a60-b0cc-07d1505a3329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:50.101354 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-112eeee8-dc96-4a60-b0cc-07d1505a3329 None None] MFA Rules not processed for user `0469157c86414cacb83b3980abf615b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:50.102976 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-112eeee8-dc96-4a60-b0cc-07d1505a3329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:50.195477 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1023/2070] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:50.198171 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2e150-af54-4fa5-88c5-e32652138486 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:50.279943 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2e150-af54-4fa5-88c5-e32652138486 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:50.284986 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab43bd-2959-4501-8f80-bf00df08135e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:50.285678 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab43bd-2959-4501-8f80-bf00df08135e admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:50.285962 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab43bd-2959-4501-8f80-bf00df08135e admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:50.286242 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab43bd-2959-4501-8f80-bf00df08135e admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:50.286965 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab43bd-2959-4501-8f80-bf00df08135e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:50.288936 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab43bd-2959-4501-8f80-bf00df08135e admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:50.414153 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112eeee8-dc96-4a60-b0cc-07d1505a3329 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:50.424901 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1048/2071] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:34:50 2022] POST /identity/v3/projects => generated 375 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:34:50.439378 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112eeee8-dc96-4a60-b0cc-07d1505a3329 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:50.528096 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea068d4-71d3-4576-8122-e5f42c085397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:50.528998 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea068d4-71d3-4576-8122-e5f42c085397 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:50.529356 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea068d4-71d3-4576-8122-e5f42c085397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:50.529756 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea068d4-71d3-4576-8122-e5f42c085397 admin admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:50.530570 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea068d4-71d3-4576-8122-e5f42c085397 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:50.532656 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea068d4-71d3-4576-8122-e5f42c085397 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:50.595300 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:50.664125 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1024/2072] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:34:50 2022] POST /identity/v3/users => generated 294 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 19:34:50.670490 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab43bd-2959-4501-8f80-bf00df08135e admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:50.683138 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab43bd-2959-4501-8f80-bf00df08135e admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:50.692464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013219a-665f-4a45-9598-930da4617e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:50.693544 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013219a-665f-4a45-9598-930da4617e11 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:50.696360 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013219a-665f-4a45-9598-930da4617e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:50.696360 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013219a-665f-4a45-9598-930da4617e11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:50.696360 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7013219a-665f-4a45-9598-930da4617e11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:50.697216 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7013219a-665f-4a45-9598-930da4617e11 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:50.714451 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1049/2073] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:50.718762 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea068d4-71d3-4576-8122-e5f42c085397 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:50.729619 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea068d4-71d3-4576-8122-e5f42c085397 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:50.735138 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be42a0d9-719a-4a3f-8462-9cf7cf37ec9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:50.736088 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be42a0d9-719a-4a3f-8462-9cf7cf37ec9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:50.736380 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be42a0d9-719a-4a3f-8462-9cf7cf37ec9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:50.736664 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be42a0d9-719a-4a3f-8462-9cf7cf37ec9f admin admin] PATH_INFO: `/v3/projects/969d67a8bce543308c49ec78857ace67/users/8bda9fa5619f4b558c0578234afcddac/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:50.754454 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be42a0d9-719a-4a3f-8462-9cf7cf37ec9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=969d67a8bce543308c49ec78857ace67, user_id=8bda9fa5619f4b558c0578234afcddac, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:50.757038 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be42a0d9-719a-4a3f-8462-9cf7cf37ec9f admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:50.876733 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1025/2074] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:34:50 2022] PUT /identity/v3/projects/969d67a8bce543308c49ec78857ace67/users/8bda9fa5619f4b558c0578234afcddac/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:50.880830 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013219a-665f-4a45-9598-930da4617e11 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:50.893756 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013219a-665f-4a45-9598-930da4617e11 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:50.965682 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1563c6c9-96dc-42d6-b4a9-bdb226304f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:50.966331 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563c6c9-96dc-42d6-b4a9-bdb226304f22 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:50.966613 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563c6c9-96dc-42d6-b4a9-bdb226304f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:50.966889 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563c6c9-96dc-42d6-b4a9-bdb226304f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:50.967751 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1563c6c9-96dc-42d6-b4a9-bdb226304f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:50.969383 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1563c6c9-96dc-42d6-b4a9-bdb226304f22 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:50.981516 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1050/2075] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:50.985186 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be42a0d9-719a-4a3f-8462-9cf7cf37ec9f admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:50.997489 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be42a0d9-719a-4a3f-8462-9cf7cf37ec9f admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:51.002710 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8ffab-40b2-487f-aec1-e7b13739d0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:51.003647 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8ffab-40b2-487f-aec1-e7b13739d0f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:51.003933 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8ffab-40b2-487f-aec1-e7b13739d0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:51.004204 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8ffab-40b2-487f-aec1-e7b13739d0f9 admin admin] PATH_INFO: `/v3/projects/969d67a8bce543308c49ec78857ace67/users/8bda9fa5619f4b558c0578234afcddac/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:51.006484 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde8ffab-40b2-487f-aec1-e7b13739d0f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=969d67a8bce543308c49ec78857ace67, user_id=8bda9fa5619f4b558c0578234afcddac, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:51.009973 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde8ffab-40b2-487f-aec1-e7b13739d0f9 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:51.022780 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1026/2076] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:34:50 2022] PUT /identity/v3/projects/969d67a8bce543308c49ec78857ace67/users/8bda9fa5619f4b558c0578234afcddac/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:51.041608 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9dea8-ed9e-4063-ae63-b8d26d0615cb None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:51.042053 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9dea8-ed9e-4063-ae63-b8d26d0615cb None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:51.042346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9dea8-ed9e-4063-ae63-b8d26d0615cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:51.070477 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-18e9dea8-ed9e-4063-ae63-b8d26d0615cb None None] MFA Rules not processed for user `8bda9fa5619f4b558c0578234afcddac`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:51.071830 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-18e9dea8-ed9e-4063-ae63-b8d26d0615cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:51.161468 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1051/2077] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:51 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:51.174847 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8ffab-40b2-487f-aec1-e7b13739d0f9 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:51.177170 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-bde8ffab-40b2-487f-aec1-e7b13739d0f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:51.256314 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8ffab-40b2-487f-aec1-e7b13739d0f9 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:51.262149 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc0a11-1b52-4930-b8fe-26cacb0b7a63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:51.263597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc0a11-1b52-4930-b8fe-26cacb0b7a63 service cinder] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:51.264075 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc0a11-1b52-4930-b8fe-26cacb0b7a63 service cinder] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:51.264535 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc0a11-1b52-4930-b8fe-26cacb0b7a63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:51.387558 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc0a11-1b52-4930-b8fe-26cacb0b7a63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:51.389036 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc0a11-1b52-4930-b8fe-26cacb0b7a63 service cinder] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:51.425128 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1027/2078] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:34:51.961451 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:53.025629 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:54.014814 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9dea8-ed9e-4063-ae63-b8d26d0615cb None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:54.016675 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-18e9dea8-ed9e-4063-ae63-b8d26d0615cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:54.039376 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9dea8-ed9e-4063-ae63-b8d26d0615cb None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:54.039376 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e17c8e-2518-4ba1-9440-cd2dd4da2d1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:54.039376 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e17c8e-2518-4ba1-9440-cd2dd4da2d1b service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:54.039376 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e17c8e-2518-4ba1-9440-cd2dd4da2d1b service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:54.039742 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e17c8e-2518-4ba1-9440-cd2dd4da2d1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:54.129960 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e17c8e-2518-4ba1-9440-cd2dd4da2d1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:54.131800 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e17c8e-2518-4ba1-9440-cd2dd4da2d1b service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:54.143148 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1052/2079] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:34:54.455607 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:54.718721 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:55.380744 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc0a11-1b52-4930-b8fe-26cacb0b7a63 service cinder] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:55.382240 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-30dc0a11-1b52-4930-b8fe-26cacb0b7a63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:55.452556 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc0a11-1b52-4930-b8fe-26cacb0b7a63 service cinder] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:55.457329 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ee902-82b5-462b-9391-dc55689354dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:55.458227 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ee902-82b5-462b-9391-dc55689354dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:55.458525 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ee902-82b5-462b-9391-dc55689354dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:55.458802 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ee902-82b5-462b-9391-dc55689354dc admin admin] PATH_INFO: `/v3/users/445eaa80c49d4b77abe929421fa65d01` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:55.460067 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ee902-82b5-462b-9391-dc55689354dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=445eaa80c49d4b77abe929421fa65d01)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:55.462061 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ee902-82b5-462b-9391-dc55689354dc admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:55.672261 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-6e6ee902-82b5-462b-9391-dc55689354dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '445eaa80c49d4b77abe929421fa65d01'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:55.742877 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-6e6ee902-82b5-462b-9391-dc55689354dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '445eaa80c49d4b77abe929421fa65d01'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:55.755879 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-6e6ee902-82b5-462b-9391-dc55689354dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '445eaa80c49d4b77abe929421fa65d01'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:55.759156 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-6e6ee902-82b5-462b-9391-dc55689354dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '445eaa80c49d4b77abe929421fa65d01'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:55.763589 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-6e6ee902-82b5-462b-9391-dc55689354dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '445eaa80c49d4b77abe929421fa65d01'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:55.769855 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1028/2080] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:34:55 2022] DELETE /identity/v3/users/445eaa80c49d4b77abe929421fa65d01 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:55.797014 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e17c8e-2518-4ba1-9440-cd2dd4da2d1b service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:55.806212 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e17c8e-2518-4ba1-9440-cd2dd4da2d1b service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:55.869247 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18625f-05f8-40cd-8016-f6275e0fdf7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:55.870081 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18625f-05f8-40cd-8016-f6275e0fdf7a service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:55.870364 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18625f-05f8-40cd-8016-f6275e0fdf7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:55.870642 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18625f-05f8-40cd-8016-f6275e0fdf7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:55.872530 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-7d18625f-05f8-40cd-8016-f6275e0fdf7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:55.931954 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:55.945657 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d18625f-05f8-40cd-8016-f6275e0fdf7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:55.947190 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d18625f-05f8-40cd-8016-f6275e0fdf7a service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:55.958976 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1053/2081] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:55 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:34:56.142385 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ee902-82b5-462b-9391-dc55689354dc admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:56.144471 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-6e6ee902-82b5-462b-9391-dc55689354dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:56.222552 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:56.235472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ee902-82b5-462b-9391-dc55689354dc admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:56.240212 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6603d3f-1410-451a-b2d1-ebf9e07b271e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:56.241209 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6603d3f-1410-451a-b2d1-ebf9e07b271e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:56.241419 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6603d3f-1410-451a-b2d1-ebf9e07b271e admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:56.241809 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6603d3f-1410-451a-b2d1-ebf9e07b271e admin admin] PATH_INFO: `/v3/projects/8059826b15f448dfa9a8be590b589334` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:56.243049 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6603d3f-1410-451a-b2d1-ebf9e07b271e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8059826b15f448dfa9a8be590b589334)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:56.245717 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6603d3f-1410-451a-b2d1-ebf9e07b271e admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:56.390583 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-b6603d3f-1410-451a-b2d1-ebf9e07b271e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8059826b15f448dfa9a8be590b589334', 'request_id': 'req-b6603d3f-1410-451a-b2d1-ebf9e07b271e'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:56.500490 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-b6603d3f-1410-451a-b2d1-ebf9e07b271e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8059826b15f448dfa9a8be590b589334', 'request_id': 'req-b6603d3f-1410-451a-b2d1-ebf9e07b271e'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:56.506490 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-b6603d3f-1410-451a-b2d1-ebf9e07b271e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8059826b15f448dfa9a8be590b589334', 'request_id': 'req-b6603d3f-1410-451a-b2d1-ebf9e07b271e'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:56.518538 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-b6603d3f-1410-451a-b2d1-ebf9e07b271e admin admin] The token cache is being invalidate because project 8059826b15f448dfa9a8be590b589334 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:34:56.518830 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-b6603d3f-1410-451a-b2d1-ebf9e07b271e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:56.519534 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-b6603d3f-1410-451a-b2d1-ebf9e07b271e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:34:56.521089 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1029/2082] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:34:56 2022] DELETE /identity/v3/projects/8059826b15f448dfa9a8be590b589334 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:56.526110 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7728b0-2670-4056-97c0-f144fa849cb6 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:56.526711 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7728b0-2670-4056-97c0-f144fa849cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:56.527239 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7728b0-2670-4056-97c0-f144fa849cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:56.547002 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-0d7728b0-2670-4056-97c0-f144fa849cb6 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:56.548348 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-0d7728b0-2670-4056-97c0-f144fa849cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:56.611215 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1054/2083] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:56.620620 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b174993-2bd7-48f1-88cf-fa294c0781ad None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:56.625061 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b174993-2bd7-48f1-88cf-fa294c0781ad None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:56.625061 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b174993-2bd7-48f1-88cf-fa294c0781ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:56.640655 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-9b174993-2bd7-48f1-88cf-fa294c0781ad None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:56.641866 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-9b174993-2bd7-48f1-88cf-fa294c0781ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:56.649713 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1030/2084] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:56.654231 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7728b0-2670-4056-97c0-f144fa849cb6 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:56.665294 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7728b0-2670-4056-97c0-f144fa849cb6 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:56.671086 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c18e7-a7bf-4853-bd33-b1024d0b1191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:56.671786 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c18e7-a7bf-4853-bd33-b1024d0b1191 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:56.672143 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c18e7-a7bf-4853-bd33-b1024d0b1191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:56.672384 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c18e7-a7bf-4853-bd33-b1024d0b1191 admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:56.673105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c18e7-a7bf-4853-bd33-b1024d0b1191 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:34:56.673643 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c18e7-a7bf-4853-bd33-b1024d0b1191 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:56.674995 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c18e7-a7bf-4853-bd33-b1024d0b1191 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:56.687220 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1055/2085] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:34:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:34:56.692094 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b174993-2bd7-48f1-88cf-fa294c0781ad None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:56.701829 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b174993-2bd7-48f1-88cf-fa294c0781ad None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:56.706501 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90965110-4166-4892-b37a-300e4898368e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:56.707153 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90965110-4166-4892-b37a-300e4898368e admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:56.707502 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90965110-4166-4892-b37a-300e4898368e admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:56.707832 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90965110-4166-4892-b37a-300e4898368e admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:56.708586 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90965110-4166-4892-b37a-300e4898368e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:56.710509 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90965110-4166-4892-b37a-300e4898368e admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:56.794762 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1031/2086] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:34:56 2022] POST /identity/v3/projects => generated 365 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:34:56.798885 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c18e7-a7bf-4853-bd33-b1024d0b1191 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:56.820101 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c18e7-a7bf-4853-bd33-b1024d0b1191 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:56.881683 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a749e-804c-4a70-9bab-4b78d2192e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:56.882432 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a749e-804c-4a70-9bab-4b78d2192e6c admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:56.882716 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a749e-804c-4a70-9bab-4b78d2192e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:56.882994 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a749e-804c-4a70-9bab-4b78d2192e6c admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:56.883783 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a749e-804c-4a70-9bab-4b78d2192e6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:56.885733 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a749e-804c-4a70-9bab-4b78d2192e6c admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:56.911889 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:56.981930 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1056/2087] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:34:56 2022] POST /identity/v3/users => generated 283 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:34:56.986174 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90965110-4166-4892-b37a-300e4898368e admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:56.997072 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90965110-4166-4892-b37a-300e4898368e admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:57.004638 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af928e-8cb0-44e8-bcc4-ca1af8ffcebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:57.004638 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af928e-8cb0-44e8-bcc4-ca1af8ffcebd admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:57.004638 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af928e-8cb0-44e8-bcc4-ca1af8ffcebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:57.004638 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af928e-8cb0-44e8-bcc4-ca1af8ffcebd admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:57.005088 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8af928e-8cb0-44e8-bcc4-ca1af8ffcebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:57.005854 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8af928e-8cb0-44e8-bcc4-ca1af8ffcebd admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:57.019580 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1032/2088] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:57.026858 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a749e-804c-4a70-9bab-4b78d2192e6c admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:57.033226 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a749e-804c-4a70-9bab-4b78d2192e6c admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:57.038625 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c114985-043b-4909-81c0-8167897f88fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:57.039278 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c114985-043b-4909-81c0-8167897f88fb admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:57.039543 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c114985-043b-4909-81c0-8167897f88fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:57.039805 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c114985-043b-4909-81c0-8167897f88fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:57.040568 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c114985-043b-4909-81c0-8167897f88fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:57.042861 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c114985-043b-4909-81c0-8167897f88fb admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:57.055370 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1057/2089] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:57.059646 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af928e-8cb0-44e8-bcc4-ca1af8ffcebd admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:57.072673 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af928e-8cb0-44e8-bcc4-ca1af8ffcebd admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:57.078195 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7a177-4c36-4480-bddd-9617f636fd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:57.079258 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7a177-4c36-4480-bddd-9617f636fd3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:57.079588 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7a177-4c36-4480-bddd-9617f636fd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:57.080177 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7a177-4c36-4480-bddd-9617f636fd3b admin admin] PATH_INFO: `/v3/projects/5cab8cd564834150b728ebb8450fec63/users/2cac3fb50c45464c885a348bf1db97d6/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:57.101525 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7a177-4c36-4480-bddd-9617f636fd3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cab8cd564834150b728ebb8450fec63, user_id=2cac3fb50c45464c885a348bf1db97d6, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:57.105243 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7a177-4c36-4480-bddd-9617f636fd3b admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:57.177712 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1033/2090] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:34:57 2022] PUT /identity/v3/projects/5cab8cd564834150b728ebb8450fec63/users/2cac3fb50c45464c885a348bf1db97d6/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:34:57.187621 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec35ec-4429-4d99-8151-d738cd90fe5a None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:57.187919 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec35ec-4429-4d99-8151-d738cd90fe5a None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:57.188228 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec35ec-4429-4d99-8151-d738cd90fe5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:57.219784 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-53ec35ec-4429-4d99-8151-d738cd90fe5a None None] MFA Rules not processed for user `2cac3fb50c45464c885a348bf1db97d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:57.220910 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-53ec35ec-4429-4d99-8151-d738cd90fe5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:57.257840 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:57.300628 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1058/2091] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:57 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:57.314202 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7a177-4c36-4480-bddd-9617f636fd3b admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:57.398648 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7a177-4c36-4480-bddd-9617f636fd3b admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:57.405553 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d742c-5f55-48b3-958f-953199e533dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:57.406362 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d742c-5f55-48b3-958f-953199e533dd admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:57.406642 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d742c-5f55-48b3-958f-953199e533dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:57.406914 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d742c-5f55-48b3-958f-953199e533dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:57.407644 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d742c-5f55-48b3-958f-953199e533dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:57.409732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d742c-5f55-48b3-958f-953199e533dd admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:57.431835 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:57.514464 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1034/2092] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:34:57 2022] POST /identity/v3/projects => generated 363 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:34:57.518483 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec35ec-4429-4d99-8151-d738cd90fe5a None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:57.530374 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec35ec-4429-4d99-8151-d738cd90fe5a None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:57.587236 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f0f415-55ca-4aff-827b-456d0aa349f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:57.590096 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0f415-55ca-4aff-827b-456d0aa349f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:57.590385 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0f415-55ca-4aff-827b-456d0aa349f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:57.590663 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0f415-55ca-4aff-827b-456d0aa349f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:57.591365 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f0f415-55ca-4aff-827b-456d0aa349f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:57.593327 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f0f415-55ca-4aff-827b-456d0aa349f0 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:57.715265 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1059/2093] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:34:57 2022] POST /identity/v3/users => generated 288 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:34:57.719640 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d742c-5f55-48b3-958f-953199e533dd admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:57.730419 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d742c-5f55-48b3-958f-953199e533dd admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:57.735331 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712dea89-e9b6-4609-9215-453d6f780b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:57.737773 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712dea89-e9b6-4609-9215-453d6f780b91 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:57.737773 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712dea89-e9b6-4609-9215-453d6f780b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:57.737773 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712dea89-e9b6-4609-9215-453d6f780b91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:57.737773 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712dea89-e9b6-4609-9215-453d6f780b91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:57.738857 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712dea89-e9b6-4609-9215-453d6f780b91 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:57.750445 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1035/2094] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:57.754742 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f0f415-55ca-4aff-827b-456d0aa349f0 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:57.766478 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f0f415-55ca-4aff-827b-456d0aa349f0 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:57.770322 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1434e79-bcab-45e7-980b-65231135b299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:57.771224 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1434e79-bcab-45e7-980b-65231135b299 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:57.771542 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1434e79-bcab-45e7-980b-65231135b299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:57.771854 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1434e79-bcab-45e7-980b-65231135b299 admin admin] PATH_INFO: `/v3/projects/187ff3f130b745809e488cf8d464d5a9/users/f8b278ad787046dc8eb8b28f339469d2/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:57.787251 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1434e79-bcab-45e7-980b-65231135b299 admin admin] RBAC: Authorizing `identity:create_grant(project_id=187ff3f130b745809e488cf8d464d5a9, user_id=f8b278ad787046dc8eb8b28f339469d2, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:57.789984 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1434e79-bcab-45e7-980b-65231135b299 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:57.884654 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1060/2095] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:34:57 2022] PUT /identity/v3/projects/187ff3f130b745809e488cf8d464d5a9/users/f8b278ad787046dc8eb8b28f339469d2/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:57.889677 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712dea89-e9b6-4609-9215-453d6f780b91 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:57.899569 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712dea89-e9b6-4609-9215-453d6f780b91 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:57.962475 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c36cc-3099-4693-aaf7-d52409b611f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:57.963130 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c36cc-3099-4693-aaf7-d52409b611f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:57.963487 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c36cc-3099-4693-aaf7-d52409b611f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:57.963714 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c36cc-3099-4693-aaf7-d52409b611f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:57.964446 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c36cc-3099-4693-aaf7-d52409b611f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:57.966066 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c36cc-3099-4693-aaf7-d52409b611f6 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:57.976535 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1036/2096] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:34:57.981088 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1434e79-bcab-45e7-980b-65231135b299 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:57.992711 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1434e79-bcab-45e7-980b-65231135b299 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:58.000419 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1034bd-1706-4362-b8b9-2b5e6886d43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:58.001411 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1034bd-1706-4362-b8b9-2b5e6886d43c admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:58.001762 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1034bd-1706-4362-b8b9-2b5e6886d43c admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:58.002047 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1034bd-1706-4362-b8b9-2b5e6886d43c admin admin] PATH_INFO: `/v3/projects/187ff3f130b745809e488cf8d464d5a9/users/f8b278ad787046dc8eb8b28f339469d2/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:58.004040 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1034bd-1706-4362-b8b9-2b5e6886d43c admin admin] RBAC: Authorizing `identity:create_grant(project_id=187ff3f130b745809e488cf8d464d5a9, user_id=f8b278ad787046dc8eb8b28f339469d2, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:58.007112 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1034bd-1706-4362-b8b9-2b5e6886d43c admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:58.022418 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1061/2097] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:34:57 2022] PUT /identity/v3/projects/187ff3f130b745809e488cf8d464d5a9/users/f8b278ad787046dc8eb8b28f339469d2/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:34:58.028969 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7bcae-53e8-46cb-aee4-b55c40526684 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:58.029275 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7bcae-53e8-46cb-aee4-b55c40526684 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:58.029554 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7bcae-53e8-46cb-aee4-b55c40526684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:58.056872 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-39b7bcae-53e8-46cb-aee4-b55c40526684 None None] MFA Rules not processed for user `f8b278ad787046dc8eb8b28f339469d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:34:58.058565 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-39b7bcae-53e8-46cb-aee4-b55c40526684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:58.130867 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1037/2098] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:34:58 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:34:58.142316 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1034bd-1706-4362-b8b9-2b5e6886d43c admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:58.144048 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-1f1034bd-1706-4362-b8b9-2b5e6886d43c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:34:58.204123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1034bd-1706-4362-b8b9-2b5e6886d43c admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:58.207969 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3d879-b033-4657-99a8-0b99800160d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:58.208611 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3d879-b033-4657-99a8-0b99800160d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:58.208990 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3d879-b033-4657-99a8-0b99800160d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:58.209393 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3d879-b033-4657-99a8-0b99800160d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:58.218424 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3d879-b033-4657-99a8-0b99800160d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:58.219953 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3d879-b033-4657-99a8-0b99800160d6 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:58.230676 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1062/2099] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:58 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:34:58.443782 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7bcae-53e8-46cb-aee4-b55c40526684 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:34:58.454937 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7bcae-53e8-46cb-aee4-b55c40526684 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:34:58.459032 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80df760-89e4-4dce-b49d-abebad329654 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:34:58.467545 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80df760-89e4-4dce-b49d-abebad329654 service cinder] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:34:58.467545 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80df760-89e4-4dce-b49d-abebad329654 service cinder] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:34:58.467545 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80df760-89e4-4dce-b49d-abebad329654 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:34:58.514830 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:58.520736 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80df760-89e4-4dce-b49d-abebad329654 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:34:58.522302 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80df760-89e4-4dce-b49d-abebad329654 service cinder] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:34:58.534828 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1038/2100] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:34:58 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:34:58.763707 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:34:59.149525 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:00.276008 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:00.557770 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:00.646095 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3d879-b033-4657-99a8-0b99800160d6 service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:00.647751 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-b2f3d879-b033-4657-99a8-0b99800160d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:00.726388 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3d879-b033-4657-99a8-0b99800160d6 service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:00.729381 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f08ca-6c32-4921-9136-8450da254751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:00.730257 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f08ca-6c32-4921-9136-8450da254751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:00.730540 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f08ca-6c32-4921-9136-8450da254751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:00.730815 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f08ca-6c32-4921-9136-8450da254751 admin admin] PATH_INFO: `/v3/users/96be338da48448d2aa991bed2b4e2494` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:00.732035 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4f08ca-6c32-4921-9136-8450da254751 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96be338da48448d2aa991bed2b4e2494)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:00.734027 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4f08ca-6c32-4921-9136-8450da254751 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:00.961039 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-4c4f08ca-6c32-4921-9136-8450da254751 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96be338da48448d2aa991bed2b4e2494'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:01.026059 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-4c4f08ca-6c32-4921-9136-8450da254751 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96be338da48448d2aa991bed2b4e2494'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:01.035591 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-4c4f08ca-6c32-4921-9136-8450da254751 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96be338da48448d2aa991bed2b4e2494'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:01.035591 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-4c4f08ca-6c32-4921-9136-8450da254751 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96be338da48448d2aa991bed2b4e2494'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:01.048545 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-4c4f08ca-6c32-4921-9136-8450da254751 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96be338da48448d2aa991bed2b4e2494'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:01.054987 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1063/2101] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:35:00 2022] DELETE /identity/v3/users/96be338da48448d2aa991bed2b4e2494 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:01.066131 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1dc97-0ab3-48fb-bffd-449f446fb17f None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:01.066131 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1dc97-0ab3-48fb-bffd-449f446fb17f None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:01.066131 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1dc97-0ab3-48fb-bffd-449f446fb17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:01.079022 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-f5c1dc97-0ab3-48fb-bffd-449f446fb17f None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:01.080243 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-f5c1dc97-0ab3-48fb-bffd-449f446fb17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:01.138081 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1039/2102] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:35:01.147777 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f08ca-6c32-4921-9136-8450da254751 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:01.149200 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-4c4f08ca-6c32-4921-9136-8450da254751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:01.207800 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f08ca-6c32-4921-9136-8450da254751 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:01.211335 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad088e-d277-4a1f-b0ba-29df98abe56d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:01.212023 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad088e-d277-4a1f-b0ba-29df98abe56d service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:01.212306 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad088e-d277-4a1f-b0ba-29df98abe56d service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:01.212643 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad088e-d277-4a1f-b0ba-29df98abe56d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:01.222306 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad088e-d277-4a1f-b0ba-29df98abe56d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:01.223827 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad088e-d277-4a1f-b0ba-29df98abe56d service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:01.233470 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1064/2103] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:35:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:35:01.606305 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:01.708387 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1dc97-0ab3-48fb-bffd-449f446fb17f None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:01.710066 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-f5c1dc97-0ab3-48fb-bffd-449f446fb17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:01.724480 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1dc97-0ab3-48fb-bffd-449f446fb17f None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:01.729429 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f23c6-1bd7-482b-9bb9-f36b8f9c04bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:01.730300 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f23c6-1bd7-482b-9bb9-f36b8f9c04bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:01.731341 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f23c6-1bd7-482b-9bb9-f36b8f9c04bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:01.731341 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f23c6-1bd7-482b-9bb9-f36b8f9c04bf admin admin] PATH_INFO: `/v3/projects/4c0aa977c08a465886afa88547d995b1` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:01.732557 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f23c6-1bd7-482b-9bb9-f36b8f9c04bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c0aa977c08a465886afa88547d995b1)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:01.734463 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f23c6-1bd7-482b-9bb9-f36b8f9c04bf admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:01.863735 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-9c3f23c6-1bd7-482b-9bb9-f36b8f9c04bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c0aa977c08a465886afa88547d995b1', 'request_id': 'req-9c3f23c6-1bd7-482b-9bb9-f36b8f9c04bf'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:01.892170 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:01.972080 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-9c3f23c6-1bd7-482b-9bb9-f36b8f9c04bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c0aa977c08a465886afa88547d995b1', 'request_id': 'req-9c3f23c6-1bd7-482b-9bb9-f36b8f9c04bf'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:01.978249 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-9c3f23c6-1bd7-482b-9bb9-f36b8f9c04bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c0aa977c08a465886afa88547d995b1', 'request_id': 'req-9c3f23c6-1bd7-482b-9bb9-f36b8f9c04bf'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:01.990567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-9c3f23c6-1bd7-482b-9bb9-f36b8f9c04bf admin admin] The token cache is being invalidate because project 4c0aa977c08a465886afa88547d995b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:35:01.990860 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-9c3f23c6-1bd7-482b-9bb9-f36b8f9c04bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:01.991522 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-9c3f23c6-1bd7-482b-9bb9-f36b8f9c04bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:01.993043 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1040/2104] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:35:01 2022] DELETE /identity/v3/projects/4c0aa977c08a465886afa88547d995b1 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:01.998431 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad088e-d277-4a1f-b0ba-29df98abe56d service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:02.013486 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad088e-d277-4a1f-b0ba-29df98abe56d service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:02.076669 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4665671c-a2d4-4a30-a3c3-d6aec872dbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:02.077854 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665671c-a2d4-4a30-a3c3-d6aec872dbc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:02.077854 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665671c-a2d4-4a30-a3c3-d6aec872dbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:02.078035 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665671c-a2d4-4a30-a3c3-d6aec872dbc3 admin admin] PATH_INFO: `/v3/users/0469157c86414cacb83b3980abf615b9` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:02.079684 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4665671c-a2d4-4a30-a3c3-d6aec872dbc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0469157c86414cacb83b3980abf615b9)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:02.081933 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4665671c-a2d4-4a30-a3c3-d6aec872dbc3 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:02.240629 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f23c6-1bd7-482b-9bb9-f36b8f9c04bf admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:02.242345 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-9c3f23c6-1bd7-482b-9bb9-f36b8f9c04bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:02.277776 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-4665671c-a2d4-4a30-a3c3-d6aec872dbc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0469157c86414cacb83b3980abf615b9'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:02.310219 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f23c6-1bd7-482b-9bb9-f36b8f9c04bf admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:02.313833 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e12a3a-26ba-499a-af14-fd37b8789e60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:02.314478 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e12a3a-26ba-499a-af14-fd37b8789e60 service cinder] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:02.314763 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e12a3a-26ba-499a-af14-fd37b8789e60 service cinder] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:02.315310 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e12a3a-26ba-499a-af14-fd37b8789e60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:02.317206 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-78e12a3a-26ba-499a-af14-fd37b8789e60 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:02.356255 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-4665671c-a2d4-4a30-a3c3-d6aec872dbc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0469157c86414cacb83b3980abf615b9'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:02.357171 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-4665671c-a2d4-4a30-a3c3-d6aec872dbc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0469157c86414cacb83b3980abf615b9'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:02.366976 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-4665671c-a2d4-4a30-a3c3-d6aec872dbc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0469157c86414cacb83b3980abf615b9'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:02.382707 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-4665671c-a2d4-4a30-a3c3-d6aec872dbc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0469157c86414cacb83b3980abf615b9'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:02.389235 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1065/2105] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:35:01 2022] DELETE /identity/v3/users/0469157c86414cacb83b3980abf615b9 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:02.389579 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e12a3a-26ba-499a-af14-fd37b8789e60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:02.391022 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e12a3a-26ba-499a-af14-fd37b8789e60 service cinder] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:02.405092 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1041/2106] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:35:02 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 19:35:02.503751 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:02.650388 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:02.905482 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4665671c-a2d4-4a30-a3c3-d6aec872dbc3 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:02.906942 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-4665671c-a2d4-4a30-a3c3-d6aec872dbc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:02.989182 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4665671c-a2d4-4a30-a3c3-d6aec872dbc3 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:02.993775 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e62c8-40ea-4446-bfe3-c8902ad3bc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:02.994943 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e62c8-40ea-4446-bfe3-c8902ad3bc4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:02.995232 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e62c8-40ea-4446-bfe3-c8902ad3bc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:02.995546 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e62c8-40ea-4446-bfe3-c8902ad3bc4c admin admin] PATH_INFO: `/v3/projects/017aced6f8d4496da2f2b4b52186a054` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:02.996740 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e62c8-40ea-4446-bfe3-c8902ad3bc4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=017aced6f8d4496da2f2b4b52186a054)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:02.998685 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e62c8-40ea-4446-bfe3-c8902ad3bc4c admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:03.135235 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-883e62c8-40ea-4446-bfe3-c8902ad3bc4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '017aced6f8d4496da2f2b4b52186a054', 'request_id': 'req-883e62c8-40ea-4446-bfe3-c8902ad3bc4c'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:03.141447 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-883e62c8-40ea-4446-bfe3-c8902ad3bc4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '017aced6f8d4496da2f2b4b52186a054', 'request_id': 'req-883e62c8-40ea-4446-bfe3-c8902ad3bc4c'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:03.216572 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:03.217242 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-883e62c8-40ea-4446-bfe3-c8902ad3bc4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '017aced6f8d4496da2f2b4b52186a054', 'request_id': 'req-883e62c8-40ea-4446-bfe3-c8902ad3bc4c'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:03.232370 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-883e62c8-40ea-4446-bfe3-c8902ad3bc4c admin admin] The token cache is being invalidate because project 017aced6f8d4496da2f2b4b52186a054 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:35:03.232663 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-883e62c8-40ea-4446-bfe3-c8902ad3bc4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:03.233324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-883e62c8-40ea-4446-bfe3-c8902ad3bc4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:03.238324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1066/2107] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:35:02 2022] DELETE /identity/v3/projects/017aced6f8d4496da2f2b4b52186a054 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:03.239397 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e12a3a-26ba-499a-af14-fd37b8789e60 service cinder] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:03.240978 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-78e12a3a-26ba-499a-af14-fd37b8789e60 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:03.256537 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e12a3a-26ba-499a-af14-fd37b8789e60 service cinder] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:03.330227 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac192f3-722a-4595-bbc1-74e95977bebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:03.331127 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac192f3-722a-4595-bbc1-74e95977bebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:03.331412 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac192f3-722a-4595-bbc1-74e95977bebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:03.331730 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac192f3-722a-4595-bbc1-74e95977bebf admin admin] PATH_INFO: `/v3/users/8bda9fa5619f4b558c0578234afcddac` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:03.332909 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac192f3-722a-4595-bbc1-74e95977bebf admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bda9fa5619f4b558c0578234afcddac)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:03.334977 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac192f3-722a-4595-bbc1-74e95977bebf admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:03.517066 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-5ac192f3-722a-4595-bbc1-74e95977bebf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bda9fa5619f4b558c0578234afcddac'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:03.591567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-5ac192f3-722a-4595-bbc1-74e95977bebf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bda9fa5619f4b558c0578234afcddac'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:03.604031 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-5ac192f3-722a-4595-bbc1-74e95977bebf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bda9fa5619f4b558c0578234afcddac'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:03.604624 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-5ac192f3-722a-4595-bbc1-74e95977bebf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bda9fa5619f4b558c0578234afcddac'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:03.611251 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-5ac192f3-722a-4595-bbc1-74e95977bebf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bda9fa5619f4b558c0578234afcddac'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:03.617189 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1042/2108] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:35:03 2022] DELETE /identity/v3/users/8bda9fa5619f4b558c0578234afcddac => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:35:03.795981 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:04.156453 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e62c8-40ea-4446-bfe3-c8902ad3bc4c admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:04.158293 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-883e62c8-40ea-4446-bfe3-c8902ad3bc4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:04.177804 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e62c8-40ea-4446-bfe3-c8902ad3bc4c admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:04.242241 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:04.250976 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645020c5-f454-44d0-bae8-15741b5539e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:04.251961 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645020c5-f454-44d0-bae8-15741b5539e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:04.252330 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645020c5-f454-44d0-bae8-15741b5539e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:04.252657 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645020c5-f454-44d0-bae8-15741b5539e6 admin admin] PATH_INFO: `/v3/projects/969d67a8bce543308c49ec78857ace67` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:04.253846 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645020c5-f454-44d0-bae8-15741b5539e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=969d67a8bce543308c49ec78857ace67)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:04.255792 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645020c5-f454-44d0-bae8-15741b5539e6 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:04.393385 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-645020c5-f454-44d0-bae8-15741b5539e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '969d67a8bce543308c49ec78857ace67', 'request_id': 'req-645020c5-f454-44d0-bae8-15741b5539e6'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:04.399598 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-645020c5-f454-44d0-bae8-15741b5539e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '969d67a8bce543308c49ec78857ace67', 'request_id': 'req-645020c5-f454-44d0-bae8-15741b5539e6'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:04.477323 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-645020c5-f454-44d0-bae8-15741b5539e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '969d67a8bce543308c49ec78857ace67', 'request_id': 'req-645020c5-f454-44d0-bae8-15741b5539e6'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:04.492435 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-645020c5-f454-44d0-bae8-15741b5539e6 admin admin] The token cache is being invalidate because project 969d67a8bce543308c49ec78857ace67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:35:04.498822 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-645020c5-f454-44d0-bae8-15741b5539e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:04.498822 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-645020c5-f454-44d0-bae8-15741b5539e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:04.498822 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1067/2109] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:35:04 2022] DELETE /identity/v3/projects/969d67a8bce543308c49ec78857ace67 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:04.505516 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e7586-b47c-41c4-8c49-d178c1d96854 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:04.505880 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e7586-b47c-41c4-8c49-d178c1d96854 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:04.506228 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e7586-b47c-41c4-8c49-d178c1d96854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:04.526375 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-520e7586-b47c-41c4-8c49-d178c1d96854 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:04.528446 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-520e7586-b47c-41c4-8c49-d178c1d96854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:04.596260 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1043/2110] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:35:04.605410 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68b918-d433-49ec-bd1d-852874883550 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:04.605734 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68b918-d433-49ec-bd1d-852874883550 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:04.606047 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68b918-d433-49ec-bd1d-852874883550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:04.625010 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-fb68b918-d433-49ec-bd1d-852874883550 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:04.626300 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-fb68b918-d433-49ec-bd1d-852874883550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:04.634575 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1068/2111] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:35:04.639739 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e7586-b47c-41c4-8c49-d178c1d96854 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:04.649394 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e7586-b47c-41c4-8c49-d178c1d96854 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:04.654963 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc7e32-b759-4e73-9a99-0a0543007784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:04.662060 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc7e32-b759-4e73-9a99-0a0543007784 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:04.662060 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc7e32-b759-4e73-9a99-0a0543007784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:04.662060 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc7e32-b759-4e73-9a99-0a0543007784 admin admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:04.662060 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc7e32-b759-4e73-9a99-0a0543007784 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:35:04.662060 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc7e32-b759-4e73-9a99-0a0543007784 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:04.662060 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc7e32-b759-4e73-9a99-0a0543007784 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:04.670283 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1044/2112] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:35:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:35:04.674622 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68b918-d433-49ec-bd1d-852874883550 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:04.680608 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:04.685879 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68b918-d433-49ec-bd1d-852874883550 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:04.691316 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a0645-7516-43d3-b53f-5592f4e53a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:04.691826 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a0645-7516-43d3-b53f-5592f4e53a11 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:04.692112 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a0645-7516-43d3-b53f-5592f4e53a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:04.692389 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a0645-7516-43d3-b53f-5592f4e53a11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:04.693238 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a0645-7516-43d3-b53f-5592f4e53a11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:04.695309 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a0645-7516-43d3-b53f-5592f4e53a11 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:04.773927 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1069/2113] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:35:04 2022] POST /identity/v3/projects => generated 391 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:35:04.778001 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc7e32-b759-4e73-9a99-0a0543007784 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:04.790272 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc7e32-b759-4e73-9a99-0a0543007784 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:04.847823 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591be5ac-9128-4832-a7f2-ef67da7085a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:04.848584 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591be5ac-9128-4832-a7f2-ef67da7085a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:04.848799 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591be5ac-9128-4832-a7f2-ef67da7085a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:04.849077 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591be5ac-9128-4832-a7f2-ef67da7085a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:04.849892 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591be5ac-9128-4832-a7f2-ef67da7085a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:04.852030 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591be5ac-9128-4832-a7f2-ef67da7085a9 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:04.952483 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1045/2114] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:35:04 2022] POST /identity/v3/users => generated 296 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:35:04.953967 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a0645-7516-43d3-b53f-5592f4e53a11 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:04.965457 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a0645-7516-43d3-b53f-5592f4e53a11 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:04.970240 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1b7c5-68f1-4427-9a39-6d4e11ace9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:04.971162 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1b7c5-68f1-4427-9a39-6d4e11ace9c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:04.971162 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1b7c5-68f1-4427-9a39-6d4e11ace9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:04.971533 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1b7c5-68f1-4427-9a39-6d4e11ace9c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:04.972263 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced1b7c5-68f1-4427-9a39-6d4e11ace9c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:04.973839 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced1b7c5-68f1-4427-9a39-6d4e11ace9c4 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:04.985184 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1070/2115] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:35:04.989111 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591be5ac-9128-4832-a7f2-ef67da7085a9 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:04.999768 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591be5ac-9128-4832-a7f2-ef67da7085a9 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:05.004394 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f028e-277e-40ca-bbad-845fbeeb798a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:05.005082 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f028e-277e-40ca-bbad-845fbeeb798a admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:05.005365 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f028e-277e-40ca-bbad-845fbeeb798a admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:05.005662 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f028e-277e-40ca-bbad-845fbeeb798a admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:05.006362 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f028e-277e-40ca-bbad-845fbeeb798a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:05.007970 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f028e-277e-40ca-bbad-845fbeeb798a admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:05.018191 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1046/2116] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:35:05.022162 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1b7c5-68f1-4427-9a39-6d4e11ace9c4 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:05.032235 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1b7c5-68f1-4427-9a39-6d4e11ace9c4 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:05.036930 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af5144-29e4-40f3-b36f-cd8f998265b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:05.037811 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af5144-29e4-40f3-b36f-cd8f998265b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:05.038092 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af5144-29e4-40f3-b36f-cd8f998265b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:05.038366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af5144-29e4-40f3-b36f-cd8f998265b5 admin admin] PATH_INFO: `/v3/projects/42e1555bbf8e413ba629ace51de5488a/users/53213307fabe49b4b5c6f0cbec2562d6/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:05.054611 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af5144-29e4-40f3-b36f-cd8f998265b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42e1555bbf8e413ba629ace51de5488a, user_id=53213307fabe49b4b5c6f0cbec2562d6, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:05.058034 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af5144-29e4-40f3-b36f-cd8f998265b5 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:05.121643 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1071/2117] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:35:05 2022] PUT /identity/v3/projects/42e1555bbf8e413ba629ace51de5488a/users/53213307fabe49b4b5c6f0cbec2562d6/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:35:05.131903 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4ed70-5b83-46b8-bff4-724be47aa90e None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:05.132202 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4ed70-5b83-46b8-bff4-724be47aa90e None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:05.132484 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4ed70-5b83-46b8-bff4-724be47aa90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:05.160563 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-44b4ed70-5b83-46b8-bff4-724be47aa90e None None] MFA Rules not processed for user `53213307fabe49b4b5c6f0cbec2562d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:05.161773 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-44b4ed70-5b83-46b8-bff4-724be47aa90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:05.236515 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1047/2118] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:35:05.247968 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af5144-29e4-40f3-b36f-cd8f998265b5 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:05.249738 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-40af5144-29e4-40f3-b36f-cd8f998265b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:05.310182 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af5144-29e4-40f3-b36f-cd8f998265b5 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:05.314317 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77a6c1-2915-45ae-9da7-bbe38ad0f4f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:05.315241 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77a6c1-2915-45ae-9da7-bbe38ad0f4f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:05.315591 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77a6c1-2915-45ae-9da7-bbe38ad0f4f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:05.315868 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77a6c1-2915-45ae-9da7-bbe38ad0f4f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:05.324769 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb77a6c1-2915-45ae-9da7-bbe38ad0f4f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:05.326196 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb77a6c1-2915-45ae-9da7-bbe38ad0f4f7 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:05.335085 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1072/2119] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:35:05 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:35:05.555520 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:06.186102 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:06.577992 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:07.423506 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:07.492134 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:07.814793 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:07.874838 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:08.337716 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:08.446214 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:08.642969 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4ed70-5b83-46b8-bff4-724be47aa90e None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:08.644422 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-44b4ed70-5b83-46b8-bff4-724be47aa90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:08.727486 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4ed70-5b83-46b8-bff4-724be47aa90e None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:08.732375 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c5bf2-312a-4cc4-9558-1a8a8d99f69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:08.733256 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c5bf2-312a-4cc4-9558-1a8a8d99f69b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:08.733540 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c5bf2-312a-4cc4-9558-1a8a8d99f69b admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:08.733803 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c5bf2-312a-4cc4-9558-1a8a8d99f69b admin admin] PATH_INFO: `/v3/users/2cac3fb50c45464c885a348bf1db97d6` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:08.735142 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534c5bf2-312a-4cc4-9558-1a8a8d99f69b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cac3fb50c45464c885a348bf1db97d6)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:08.737188 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534c5bf2-312a-4cc4-9558-1a8a8d99f69b admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:08.927077 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-534c5bf2-312a-4cc4-9558-1a8a8d99f69b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cac3fb50c45464c885a348bf1db97d6'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:08.992018 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-534c5bf2-312a-4cc4-9558-1a8a8d99f69b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cac3fb50c45464c885a348bf1db97d6'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:09.008034 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-534c5bf2-312a-4cc4-9558-1a8a8d99f69b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cac3fb50c45464c885a348bf1db97d6'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:09.008871 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-534c5bf2-312a-4cc4-9558-1a8a8d99f69b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cac3fb50c45464c885a348bf1db97d6'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:09.022605 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-534c5bf2-312a-4cc4-9558-1a8a8d99f69b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cac3fb50c45464c885a348bf1db97d6'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:09.025066 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1048/2120] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:35:08 2022] DELETE /identity/v3/users/2cac3fb50c45464c885a348bf1db97d6 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:09.031356 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45318090-3b61-42ae-828b-418e4c121581 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:09.031356 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45318090-3b61-42ae-828b-418e4c121581 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:09.032123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45318090-3b61-42ae-828b-418e4c121581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:09.056050 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-45318090-3b61-42ae-828b-418e4c121581 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:09.056731 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-45318090-3b61-42ae-828b-418e4c121581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:09.130515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1073/2121] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:35:09.141772 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c5bf2-312a-4cc4-9558-1a8a8d99f69b admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:09.143355 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-534c5bf2-312a-4cc4-9558-1a8a8d99f69b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:09.204276 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c5bf2-312a-4cc4-9558-1a8a8d99f69b admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:09.208039 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5d8f9-1a67-47a7-b937-660223c9d55f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:09.208695 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5d8f9-1a67-47a7-b937-660223c9d55f service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:09.208978 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5d8f9-1a67-47a7-b937-660223c9d55f service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:09.209253 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5d8f9-1a67-47a7-b937-660223c9d55f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:09.219154 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e5d8f9-1a67-47a7-b937-660223c9d55f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:09.220608 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e5d8f9-1a67-47a7-b937-660223c9d55f service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:09.230676 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1049/2122] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:35:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:35:09.387668 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:09.483172 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:09.735715 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45318090-3b61-42ae-828b-418e4c121581 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:09.737522 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-45318090-3b61-42ae-828b-418e4c121581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:09.753302 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45318090-3b61-42ae-828b-418e4c121581 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:09.759101 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89423f18-f784-48b9-928f-3a2aa279d30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:09.760458 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89423f18-f784-48b9-928f-3a2aa279d30d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:09.760458 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89423f18-f784-48b9-928f-3a2aa279d30d admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:09.760732 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89423f18-f784-48b9-928f-3a2aa279d30d admin admin] PATH_INFO: `/v3/projects/5cab8cd564834150b728ebb8450fec63` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:09.764411 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89423f18-f784-48b9-928f-3a2aa279d30d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cab8cd564834150b728ebb8450fec63)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:09.766590 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89423f18-f784-48b9-928f-3a2aa279d30d admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:09.788997 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:09.931257 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-89423f18-f784-48b9-928f-3a2aa279d30d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cab8cd564834150b728ebb8450fec63', 'request_id': 'req-89423f18-f784-48b9-928f-3a2aa279d30d'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:09.937768 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-89423f18-f784-48b9-928f-3a2aa279d30d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cab8cd564834150b728ebb8450fec63', 'request_id': 'req-89423f18-f784-48b9-928f-3a2aa279d30d'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:10.051904 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-89423f18-f784-48b9-928f-3a2aa279d30d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cab8cd564834150b728ebb8450fec63', 'request_id': 'req-89423f18-f784-48b9-928f-3a2aa279d30d'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:10.063725 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-89423f18-f784-48b9-928f-3a2aa279d30d admin admin] The token cache is being invalidate because project 5cab8cd564834150b728ebb8450fec63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:35:10.064016 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-89423f18-f784-48b9-928f-3a2aa279d30d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:10.064676 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-89423f18-f784-48b9-928f-3a2aa279d30d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:10.066747 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1074/2123] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:35:09 2022] DELETE /identity/v3/projects/5cab8cd564834150b728ebb8450fec63 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:10.070600 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5d8f9-1a67-47a7-b937-660223c9d55f service neutron] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:10.081313 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5d8f9-1a67-47a7-b937-660223c9d55f service neutron] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:10.159957 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93574855-d87e-4f91-9e07-3079ae0e6819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:10.166988 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93574855-d87e-4f91-9e07-3079ae0e6819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:10.167654 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93574855-d87e-4f91-9e07-3079ae0e6819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:10.168236 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93574855-d87e-4f91-9e07-3079ae0e6819 admin admin] PATH_INFO: `/v3/users/f8b278ad787046dc8eb8b28f339469d2` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:10.173264 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93574855-d87e-4f91-9e07-3079ae0e6819 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8b278ad787046dc8eb8b28f339469d2)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:10.179782 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93574855-d87e-4f91-9e07-3079ae0e6819 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:10.201656 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:10.382266 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-93574855-d87e-4f91-9e07-3079ae0e6819 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8b278ad787046dc8eb8b28f339469d2'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:10.459230 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-93574855-d87e-4f91-9e07-3079ae0e6819 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8b278ad787046dc8eb8b28f339469d2'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:10.473228 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-93574855-d87e-4f91-9e07-3079ae0e6819 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8b278ad787046dc8eb8b28f339469d2'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:10.474101 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-93574855-d87e-4f91-9e07-3079ae0e6819 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8b278ad787046dc8eb8b28f339469d2'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:10.482845 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-93574855-d87e-4f91-9e07-3079ae0e6819 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8b278ad787046dc8eb8b28f339469d2'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:10.489403 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1050/2124] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:35:10 2022] DELETE /identity/v3/users/f8b278ad787046dc8eb8b28f339469d2 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:10.569348 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:10.737627 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:10.821225 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89423f18-f784-48b9-928f-3a2aa279d30d admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:10.823261 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-89423f18-f784-48b9-928f-3a2aa279d30d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:10.836491 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89423f18-f784-48b9-928f-3a2aa279d30d admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:10.899673 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d141a3-98ae-41ff-9f19-e9e452bf6964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:10.900604 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d141a3-98ae-41ff-9f19-e9e452bf6964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:10.900894 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d141a3-98ae-41ff-9f19-e9e452bf6964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:10.901235 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d141a3-98ae-41ff-9f19-e9e452bf6964 admin admin] PATH_INFO: `/v3/users/ff4fee13431b458aa8656473b792495a` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:10.902594 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d141a3-98ae-41ff-9f19-e9e452bf6964 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff4fee13431b458aa8656473b792495a)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:10.904798 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d141a3-98ae-41ff-9f19-e9e452bf6964 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:11.045641 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93574855-d87e-4f91-9e07-3079ae0e6819 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:11.047810 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-93574855-d87e-4f91-9e07-3079ae0e6819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:11.065923 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93574855-d87e-4f91-9e07-3079ae0e6819 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:11.075757 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc99c15-df54-43d4-a5f3-d0d6bcea944d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:11.075757 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc99c15-df54-43d4-a5f3-d0d6bcea944d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:11.075757 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc99c15-df54-43d4-a5f3-d0d6bcea944d admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:11.075757 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc99c15-df54-43d4-a5f3-d0d6bcea944d admin admin] PATH_INFO: `/v3/projects/187ff3f130b745809e488cf8d464d5a9` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:11.076042 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc99c15-df54-43d4-a5f3-d0d6bcea944d admin admin] RBAC: Authorizing `identity:delete_project(project_id=187ff3f130b745809e488cf8d464d5a9)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:11.078056 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc99c15-df54-43d4-a5f3-d0d6bcea944d admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:11.136927 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-a2d141a3-98ae-41ff-9f19-e9e452bf6964 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff4fee13431b458aa8656473b792495a'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:11.192073 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-a2d141a3-98ae-41ff-9f19-e9e452bf6964 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff4fee13431b458aa8656473b792495a'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:11.201157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-a2d141a3-98ae-41ff-9f19-e9e452bf6964 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff4fee13431b458aa8656473b792495a'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:11.209263 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-a2d141a3-98ae-41ff-9f19-e9e452bf6964 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff4fee13431b458aa8656473b792495a'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:11.212820 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-9fc99c15-df54-43d4-a5f3-d0d6bcea944d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '187ff3f130b745809e488cf8d464d5a9', 'request_id': 'req-9fc99c15-df54-43d4-a5f3-d0d6bcea944d'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:11.222245 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-a2d141a3-98ae-41ff-9f19-e9e452bf6964 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff4fee13431b458aa8656473b792495a'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:11.228466 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1075/2125] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:35:10 2022] DELETE /identity/v3/users/ff4fee13431b458aa8656473b792495a => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:11.233292 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3c78e-fad3-441c-ac4b-47bdca374fc2 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:11.233581 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3c78e-fad3-441c-ac4b-47bdca374fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:11.233858 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3c78e-fad3-441c-ac4b-47bdca374fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:11.251218 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-f6f3c78e-fad3-441c-ac4b-47bdca374fc2 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:11.252508 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f6f3c78e-fad3-441c-ac4b-47bdca374fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:11.283284 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-9fc99c15-df54-43d4-a5f3-d0d6bcea944d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '187ff3f130b745809e488cf8d464d5a9', 'request_id': 'req-9fc99c15-df54-43d4-a5f3-d0d6bcea944d'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:11.289422 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-9fc99c15-df54-43d4-a5f3-d0d6bcea944d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '187ff3f130b745809e488cf8d464d5a9', 'request_id': 'req-9fc99c15-df54-43d4-a5f3-d0d6bcea944d'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:11.301522 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-9fc99c15-df54-43d4-a5f3-d0d6bcea944d admin admin] The token cache is being invalidate because project 187ff3f130b745809e488cf8d464d5a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:35:11.301811 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-9fc99c15-df54-43d4-a5f3-d0d6bcea944d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:11.302022 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:11.302459 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-9fc99c15-df54-43d4-a5f3-d0d6bcea944d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:11.304576 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1051/2126] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:35:11 2022] DELETE /identity/v3/projects/187ff3f130b745809e488cf8d464d5a9 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:35:11.309557 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afc01b-b1a1-411a-a882-08bf381afe24 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:11.309840 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afc01b-b1a1-411a-a882-08bf381afe24 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:11.310122 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afc01b-b1a1-411a-a882-08bf381afe24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:11.317414 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1076/2127] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:35:11.334581 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3c78e-fad3-441c-ac4b-47bdca374fc2 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:11.334581 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f6f3c78e-fad3-441c-ac4b-47bdca374fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:11.334807 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-22afc01b-b1a1-411a-a882-08bf381afe24 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:11.334807 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-22afc01b-b1a1-411a-a882-08bf381afe24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:11.338757 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1052/2128] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:35:11.347426 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2211edf-6a40-4ea8-92e6-1ebbd725837d None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:11.347757 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2211edf-6a40-4ea8-92e6-1ebbd725837d None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:11.348035 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2211edf-6a40-4ea8-92e6-1ebbd725837d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:11.366771 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-a2211edf-6a40-4ea8-92e6-1ebbd725837d None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:11.368498 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-a2211edf-6a40-4ea8-92e6-1ebbd725837d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:11.376289 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1053/2129] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:35:11.380489 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2211edf-6a40-4ea8-92e6-1ebbd725837d None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:11.387168 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3c78e-fad3-441c-ac4b-47bdca374fc2 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:11.387593 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:11.391581 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca38897-738e-49f5-9e53-7e5e46746266 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:11.392252 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca38897-738e-49f5-9e53-7e5e46746266 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:11.392533 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca38897-738e-49f5-9e53-7e5e46746266 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:11.392809 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca38897-738e-49f5-9e53-7e5e46746266 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:11.393447 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2211edf-6a40-4ea8-92e6-1ebbd725837d None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:11.398287 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb9a6a-641e-4912-9db9-d4c0171f004f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:11.398956 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb9a6a-641e-4912-9db9-d4c0171f004f admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:11.399244 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb9a6a-641e-4912-9db9-d4c0171f004f admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:11.399548 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb9a6a-641e-4912-9db9-d4c0171f004f admin admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:11.400286 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb9a6a-641e-4912-9db9-d4c0171f004f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:35:11.400594 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb9a6a-641e-4912-9db9-d4c0171f004f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:11.402940 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb9a6a-641e-4912-9db9-d4c0171f004f admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:11.403273 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca38897-738e-49f5-9e53-7e5e46746266 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:11.404785 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca38897-738e-49f5-9e53-7e5e46746266 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:11.414663 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1054/2130] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:35:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:35:11.415613 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1077/2131] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:35:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 19:35:11.420279 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb9a6a-641e-4912-9db9-d4c0171f004f admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:11.436389 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb9a6a-641e-4912-9db9-d4c0171f004f admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:11.441374 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1593ac1-5dc1-4662-b999-166a8949bf5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:11.442173 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1593ac1-5dc1-4662-b999-166a8949bf5f admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:11.442496 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1593ac1-5dc1-4662-b999-166a8949bf5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:11.442827 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1593ac1-5dc1-4662-b999-166a8949bf5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:11.443556 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1593ac1-5dc1-4662-b999-166a8949bf5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:11.445478 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1593ac1-5dc1-4662-b999-166a8949bf5f admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:11.547793 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1055/2132] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:35:11 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:35:11.552012 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca38897-738e-49f5-9e53-7e5e46746266 service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:11.562823 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca38897-738e-49f5-9e53-7e5e46746266 service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:11.634751 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:11.637039 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af30a86f-61e6-426c-a3c1-1278671bb1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:11.637996 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30a86f-61e6-426c-a3c1-1278671bb1a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:11.638130 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30a86f-61e6-426c-a3c1-1278671bb1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:11.638371 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30a86f-61e6-426c-a3c1-1278671bb1a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:11.639472 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af30a86f-61e6-426c-a3c1-1278671bb1a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:11.640960 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af30a86f-61e6-426c-a3c1-1278671bb1a8 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:11.692214 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:11.732166 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1078/2133] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:35:11 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:35:11.733050 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1593ac1-5dc1-4662-b999-166a8949bf5f admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:11.751151 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1593ac1-5dc1-4662-b999-166a8949bf5f admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:11.766544 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d602a-8b82-4366-86fc-f10680e00bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:11.767558 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d602a-8b82-4366-86fc-f10680e00bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:11.768182 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d602a-8b82-4366-86fc-f10680e00bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:11.768620 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d602a-8b82-4366-86fc-f10680e00bb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:11.769517 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d602a-8b82-4366-86fc-f10680e00bb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:11.771392 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d602a-8b82-4366-86fc-f10680e00bb8 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:11.788395 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1056/2134] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:35:11.797864 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af30a86f-61e6-426c-a3c1-1278671bb1a8 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:11.812548 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af30a86f-61e6-426c-a3c1-1278671bb1a8 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:11.815847 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a107e-d6b2-49d1-a395-f08bbd1afa6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:11.816666 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a107e-d6b2-49d1-a395-f08bbd1afa6c admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:11.816964 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a107e-d6b2-49d1-a395-f08bbd1afa6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:11.817269 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a107e-d6b2-49d1-a395-f08bbd1afa6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:11.818129 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a107e-d6b2-49d1-a395-f08bbd1afa6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:11.820236 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a107e-d6b2-49d1-a395-f08bbd1afa6c admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:11.852626 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1079/2135] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:35:11.853285 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d602a-8b82-4366-86fc-f10680e00bb8 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:11.860551 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a107e-d6b2-49d1-a395-f08bbd1afa6c admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:11.862776 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-d55a107e-d6b2-49d1-a395-f08bbd1afa6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:11.866820 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d602a-8b82-4366-86fc-f10680e00bb8 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:11.889232 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d7f86-82c1-4102-a304-2edd4ceec42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:11.894689 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d7f86-82c1-4102-a304-2edd4ceec42c admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:11.894689 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d7f86-82c1-4102-a304-2edd4ceec42c admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:11.894909 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a107e-d6b2-49d1-a395-f08bbd1afa6c admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:11.894991 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d7f86-82c1-4102-a304-2edd4ceec42c admin admin] PATH_INFO: `/v3/projects/537a5935312e499cbd153f0d66253df5/users/2a73e6a0858a479cb0e8ab589ba2e4ad/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:11.900314 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1efaa-f70b-4736-9e49-dfe5e69ece2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:11.903060 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1efaa-f70b-4736-9e49-dfe5e69ece2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:11.903691 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1efaa-f70b-4736-9e49-dfe5e69ece2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:11.904578 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1efaa-f70b-4736-9e49-dfe5e69ece2d admin admin] PATH_INFO: `/v3/projects/c7f3a6507d6a4016b25e0de19c1e7989` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:11.906456 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1efaa-f70b-4736-9e49-dfe5e69ece2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7f3a6507d6a4016b25e0de19c1e7989)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:11.931550 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1efaa-f70b-4736-9e49-dfe5e69ece2d admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:11.931810 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d7f86-82c1-4102-a304-2edd4ceec42c admin admin] RBAC: Authorizing `identity:create_grant(project_id=537a5935312e499cbd153f0d66253df5, user_id=2a73e6a0858a479cb0e8ab589ba2e4ad, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:11.931810 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d7f86-82c1-4102-a304-2edd4ceec42c admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:11.977626 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:12.014430 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1057/2136] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:35:11 2022] PUT /identity/v3/projects/537a5935312e499cbd153f0d66253df5/users/2a73e6a0858a479cb0e8ab589ba2e4ad/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:12.026947 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b26df-8ba1-4d12-9b8e-5c2bae1e6901 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:12.027241 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b26df-8ba1-4d12-9b8e-5c2bae1e6901 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:12.027664 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b26df-8ba1-4d12-9b8e-5c2bae1e6901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:12.040700 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:12.060695 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-f30b26df-8ba1-4d12-9b8e-5c2bae1e6901 None None] MFA Rules not processed for user `2a73e6a0858a479cb0e8ab589ba2e4ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:12.061793 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-f30b26df-8ba1-4d12-9b8e-5c2bae1e6901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:12.062081 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c4c1efaa-f70b-4736-9e49-dfe5e69ece2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7f3a6507d6a4016b25e0de19c1e7989', 'request_id': 'req-c4c1efaa-f70b-4736-9e49-dfe5e69ece2d'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:12.069863 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c4c1efaa-f70b-4736-9e49-dfe5e69ece2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7f3a6507d6a4016b25e0de19c1e7989', 'request_id': 'req-c4c1efaa-f70b-4736-9e49-dfe5e69ece2d'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:12.121350 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:12.141361 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1058/2137] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:35:12.145944 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b26df-8ba1-4d12-9b8e-5c2bae1e6901 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:12.196296 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c4c1efaa-f70b-4736-9e49-dfe5e69ece2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7f3a6507d6a4016b25e0de19c1e7989', 'request_id': 'req-c4c1efaa-f70b-4736-9e49-dfe5e69ece2d'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:12.209410 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c4c1efaa-f70b-4736-9e49-dfe5e69ece2d admin admin] The token cache is being invalidate because project c7f3a6507d6a4016b25e0de19c1e7989 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:35:12.209807 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c4c1efaa-f70b-4736-9e49-dfe5e69ece2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:12.210660 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c4c1efaa-f70b-4736-9e49-dfe5e69ece2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:12.212732 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1080/2138] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:35:11 2022] DELETE /identity/v3/projects/c7f3a6507d6a4016b25e0de19c1e7989 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:35:12.215869 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b26df-8ba1-4d12-9b8e-5c2bae1e6901 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:12.218432 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5cdd33-fbb9-4496-8812-9bfa879d1050 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:12.219146 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5cdd33-fbb9-4496-8812-9bfa879d1050 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:12.219935 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5cdd33-fbb9-4496-8812-9bfa879d1050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:12.227559 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241b75b-77fb-4e74-bc44-17abb3e4be5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:12.228461 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241b75b-77fb-4e74-bc44-17abb3e4be5b admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:12.229018 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241b75b-77fb-4e74-bc44-17abb3e4be5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:12.229224 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241b75b-77fb-4e74-bc44-17abb3e4be5b admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:12.230601 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241b75b-77fb-4e74-bc44-17abb3e4be5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:12.233350 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241b75b-77fb-4e74-bc44-17abb3e4be5b admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:12.241398 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-7e5cdd33-fbb9-4496-8812-9bfa879d1050 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:12.242662 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-7e5cdd33-fbb9-4496-8812-9bfa879d1050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:12.252057 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1081/2139] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:35:12.264767 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb1c1c-0420-42fd-943e-f3ce97a520d6 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:12.265059 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb1c1c-0420-42fd-943e-f3ce97a520d6 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:12.265340 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb1c1c-0420-42fd-943e-f3ce97a520d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:12.283274 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-edeb1c1c-0420-42fd-943e-f3ce97a520d6 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:12.284505 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-edeb1c1c-0420-42fd-943e-f3ce97a520d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:12.293180 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1082/2140] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:35:12.297223 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb1c1c-0420-42fd-943e-f3ce97a520d6 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:12.306497 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb1c1c-0420-42fd-943e-f3ce97a520d6 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:12.323289 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4b7a1-1ce5-4d71-bc16-9f46b6dbc250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:12.323289 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4b7a1-1ce5-4d71-bc16-9f46b6dbc250 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:12.323289 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4b7a1-1ce5-4d71-bc16-9f46b6dbc250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:12.323289 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4b7a1-1ce5-4d71-bc16-9f46b6dbc250 admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:12.323688 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc4b7a1-1ce5-4d71-bc16-9f46b6dbc250 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:35:12.323688 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc4b7a1-1ce5-4d71-bc16-9f46b6dbc250 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:12.324614 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc4b7a1-1ce5-4d71-bc16-9f46b6dbc250 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:12.339938 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:12.347371 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1083/2141] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:35:12.350704 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4b7a1-1ce5-4d71-bc16-9f46b6dbc250 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:12.353751 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1059/2142] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:35:12 2022] POST /identity/v3/projects => generated 385 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 19:35:12.358239 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241b75b-77fb-4e74-bc44-17abb3e4be5b admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:12.361110 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-d241b75b-77fb-4e74-bc44-17abb3e4be5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:12.366809 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4b7a1-1ce5-4d71-bc16-9f46b6dbc250 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:12.415394 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:12.456774 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f9341-4cf5-432b-bbe3-76e9dd424640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:12.458321 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f9341-4cf5-432b-bbe3-76e9dd424640 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:12.459681 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f9341-4cf5-432b-bbe3-76e9dd424640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:12.460406 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f9341-4cf5-432b-bbe3-76e9dd424640 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:12.461666 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f9341-4cf5-432b-bbe3-76e9dd424640 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:12.462566 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241b75b-77fb-4e74-bc44-17abb3e4be5b admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:12.466383 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f9341-4cf5-432b-bbe3-76e9dd424640 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:12.477689 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523b44f-17cb-4582-8457-c2a58bd9c60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:12.478400 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523b44f-17cb-4582-8457-c2a58bd9c60b admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:12.478692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523b44f-17cb-4582-8457-c2a58bd9c60b admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:12.478964 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523b44f-17cb-4582-8457-c2a58bd9c60b admin admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:12.479722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523b44f-17cb-4582-8457-c2a58bd9c60b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:12.481921 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523b44f-17cb-4582-8457-c2a58bd9c60b admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:12.609303 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1060/2143] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:35:12 2022] POST /identity/v3/users => generated 299 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 19:35:12.613348 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523b44f-17cb-4582-8457-c2a58bd9c60b admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:12.623642 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523b44f-17cb-4582-8457-c2a58bd9c60b admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:12.628902 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b7333-f387-48cc-b73f-e590778dacf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:12.629530 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:12.629649 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b7333-f387-48cc-b73f-e590778dacf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:12.629867 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b7333-f387-48cc-b73f-e590778dacf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:12.630149 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b7333-f387-48cc-b73f-e590778dacf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:12.630875 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b7333-f387-48cc-b73f-e590778dacf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:12.632510 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b7333-f387-48cc-b73f-e590778dacf5 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:12.646265 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1084/2144] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:35:12 2022] POST /identity/v3/projects => generated 375 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:35:12.649894 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f9341-4cf5-432b-bbe3-76e9dd424640 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:12.650588 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1061/2145] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 19:35:12.655840 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b7333-f387-48cc-b73f-e590778dacf5 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:12.666995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b7333-f387-48cc-b73f-e590778dacf5 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:12.718554 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f9341-4cf5-432b-bbe3-76e9dd424640 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:12.723742 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7484fd87-140c-40f0-b94d-999d3e4877fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:12.724451 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484fd87-140c-40f0-b94d-999d3e4877fe admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:12.724714 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484fd87-140c-40f0-b94d-999d3e4877fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:12.725010 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484fd87-140c-40f0-b94d-999d3e4877fe admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:12.725797 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7484fd87-140c-40f0-b94d-999d3e4877fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:12.727399 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f2e283-0378-41a5-8783-39f447588aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:12.727855 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7484fd87-140c-40f0-b94d-999d3e4877fe admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:12.728561 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2e283-0378-41a5-8783-39f447588aad admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:12.728856 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2e283-0378-41a5-8783-39f447588aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:12.729140 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2e283-0378-41a5-8783-39f447588aad admin admin] PATH_INFO: `/v3/projects/67b16839d52646aaa5d874fdbe3e16d0/users/ba206f7124a84e73ba7a25320f864722/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:12.745779 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f2e283-0378-41a5-8783-39f447588aad admin admin] RBAC: Authorizing `identity:create_grant(project_id=67b16839d52646aaa5d874fdbe3e16d0, user_id=ba206f7124a84e73ba7a25320f864722, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:12.748535 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f2e283-0378-41a5-8783-39f447588aad admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:12.822869 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:12.860079 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1062/2146] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:35:12 2022] PUT /identity/v3/projects/67b16839d52646aaa5d874fdbe3e16d0/users/ba206f7124a84e73ba7a25320f864722/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:35:12.860306 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1085/2147] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:35:12 2022] POST /identity/v3/users => generated 288 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 19:35:12.861080 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f2e283-0378-41a5-8783-39f447588aad admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:12.861200 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7484fd87-140c-40f0-b94d-999d3e4877fe admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:12.871846 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7484fd87-140c-40f0-b94d-999d3e4877fe admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:12.926847 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:12.927630 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce1e70-e505-45a3-af30-19fe144f9241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:12.928482 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce1e70-e505-45a3-af30-19fe144f9241 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:12.928775 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce1e70-e505-45a3-af30-19fe144f9241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:12.929057 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce1e70-e505-45a3-af30-19fe144f9241 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:12.929805 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce1e70-e505-45a3-af30-19fe144f9241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:12.930034 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f2e283-0378-41a5-8783-39f447588aad admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:12.931615 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce1e70-e505-45a3-af30-19fe144f9241 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:12.937079 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090657b-ccf3-42a7-8d27-924cfe529486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:12.937985 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090657b-ccf3-42a7-8d27-924cfe529486 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:12.938170 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090657b-ccf3-42a7-8d27-924cfe529486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:12.938458 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090657b-ccf3-42a7-8d27-924cfe529486 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:12.939223 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8090657b-ccf3-42a7-8d27-924cfe529486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:12.941111 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8090657b-ccf3-42a7-8d27-924cfe529486 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:12.946398 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1086/2148] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 19:35:12.947361 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce1e70-e505-45a3-af30-19fe144f9241 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:12.955506 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1063/2149] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 19:35:12.958949 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce1e70-e505-45a3-af30-19fe144f9241 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:12.959846 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090657b-ccf3-42a7-8d27-924cfe529486 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:12.963795 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296fcd0-ea3c-44fb-b7bd-3f75ca3017ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:12.964825 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296fcd0-ea3c-44fb-b7bd-3f75ca3017ff admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:12.965305 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296fcd0-ea3c-44fb-b7bd-3f75ca3017ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:12.965597 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296fcd0-ea3c-44fb-b7bd-3f75ca3017ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:12.966925 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6296fcd0-ea3c-44fb-b7bd-3f75ca3017ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:12.968596 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6296fcd0-ea3c-44fb-b7bd-3f75ca3017ff admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:12.970397 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090657b-ccf3-42a7-8d27-924cfe529486 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:12.975131 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6a798-7ee8-4a5e-9201-a66981b80b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:12.976054 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6a798-7ee8-4a5e-9201-a66981b80b8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:12.976338 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6a798-7ee8-4a5e-9201-a66981b80b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:12.976810 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6a798-7ee8-4a5e-9201-a66981b80b8a admin admin] PATH_INFO: `/v3/projects/67b16839d52646aaa5d874fdbe3e16d0/users/ba206f7124a84e73ba7a25320f864722/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:12.979757 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a6a798-7ee8-4a5e-9201-a66981b80b8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=67b16839d52646aaa5d874fdbe3e16d0, user_id=ba206f7124a84e73ba7a25320f864722, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:12.984519 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1087/2150] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 19:35:12.984665 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a6a798-7ee8-4a5e-9201-a66981b80b8a admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:12.986993 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296fcd0-ea3c-44fb-b7bd-3f75ca3017ff admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:12.997787 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296fcd0-ea3c-44fb-b7bd-3f75ca3017ff admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:13.000672 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1064/2151] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:35:12 2022] PUT /identity/v3/projects/67b16839d52646aaa5d874fdbe3e16d0/users/ba206f7124a84e73ba7a25320f864722/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:35:13.016241 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fad4a0-14c6-41ca-932d-8bbf749d37b7 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:13.016817 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fad4a0-14c6-41ca-932d-8bbf749d37b7 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:13.017296 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fad4a0-14c6-41ca-932d-8bbf749d37b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:13.049807 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-57fad4a0-14c6-41ca-932d-8bbf749d37b7 None None] MFA Rules not processed for user `ba206f7124a84e73ba7a25320f864722`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:13.051081 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-57fad4a0-14c6-41ca-932d-8bbf749d37b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:13.062953 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475f547-a309-4a2b-968f-163c916e958b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:13.063909 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475f547-a309-4a2b-968f-163c916e958b admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:13.064197 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475f547-a309-4a2b-968f-163c916e958b admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:13.064508 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475f547-a309-4a2b-968f-163c916e958b admin admin] PATH_INFO: `/v3/projects/fa2f3a31244b4c57b27af5366913450d/users/7912e83ad33545edb2b117955b47dc1f/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:13.082083 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475f547-a309-4a2b-968f-163c916e958b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa2f3a31244b4c57b27af5366913450d, user_id=7912e83ad33545edb2b117955b47dc1f, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:13.085048 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475f547-a309-4a2b-968f-163c916e958b admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:13.139792 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1065/2152] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:35:13.150705 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fad4a0-14c6-41ca-932d-8bbf749d37b7 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:13.152177 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-57fad4a0-14c6-41ca-932d-8bbf749d37b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:13.197811 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1088/2153] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:35:12 2022] PUT /identity/v3/projects/fa2f3a31244b4c57b27af5366913450d/users/7912e83ad33545edb2b117955b47dc1f/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:13.209464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9771f1-e235-40b0-9182-55a622b5e5a2 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:13.209751 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9771f1-e235-40b0-9182-55a622b5e5a2 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:13.210058 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9771f1-e235-40b0-9182-55a622b5e5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:13.216955 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fad4a0-14c6-41ca-932d-8bbf749d37b7 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:13.236027 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-aa9771f1-e235-40b0-9182-55a622b5e5a2 None None] MFA Rules not processed for user `7912e83ad33545edb2b117955b47dc1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:13.237339 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-aa9771f1-e235-40b0-9182-55a622b5e5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:13.267779 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752a70e-816b-4c2a-887f-7d21d1274756 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:13.268530 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752a70e-816b-4c2a-887f-7d21d1274756 service cinder] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:13.268813 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752a70e-816b-4c2a-887f-7d21d1274756 service cinder] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:13.269175 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752a70e-816b-4c2a-887f-7d21d1274756 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:13.308723 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1089/2154] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:35:13.313767 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9771f1-e235-40b0-9182-55a622b5e5a2 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:13.316212 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:13.352091 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3752a70e-816b-4c2a-887f-7d21d1274756 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:13.353934 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3752a70e-816b-4c2a-887f-7d21d1274756 service cinder] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:13.364753 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1066/2155] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:35:13 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 19:35:13.391564 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9771f1-e235-40b0-9182-55a622b5e5a2 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:13.395778 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752a70e-816b-4c2a-887f-7d21d1274756 service cinder] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:13.397683 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79504fa-27ec-4d6b-8185-031524fdced0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:13.398352 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79504fa-27ec-4d6b-8185-031524fdced0 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:13.398637 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79504fa-27ec-4d6b-8185-031524fdced0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:13.398914 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79504fa-27ec-4d6b-8185-031524fdced0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:13.399638 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79504fa-27ec-4d6b-8185-031524fdced0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:13.402653 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79504fa-27ec-4d6b-8185-031524fdced0 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:13.404586 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:13.409390 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752a70e-816b-4c2a-887f-7d21d1274756 service cinder] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:13.418214 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d7a80-600e-4f60-8cf7-0c6623ace437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:13.418214 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d7a80-600e-4f60-8cf7-0c6623ace437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:13.418556 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d7a80-600e-4f60-8cf7-0c6623ace437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:13.418842 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d7a80-600e-4f60-8cf7-0c6623ace437 admin admin] PATH_INFO: `/v3/users/2a73e6a0858a479cb0e8ab589ba2e4ad` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:13.425900 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d7a80-600e-4f60-8cf7-0c6623ace437 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a73e6a0858a479cb0e8ab589ba2e4ad)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:13.425900 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d7a80-600e-4f60-8cf7-0c6623ace437 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:13.491781 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1090/2156] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:35:13 2022] POST /identity/v3/projects => generated 375 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:35:13.496680 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79504fa-27ec-4d6b-8185-031524fdced0 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:13.563372 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79504fa-27ec-4d6b-8185-031524fdced0 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:13.568261 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250d7f4-18dc-423e-b4a0-49e6715ce338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:13.568938 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250d7f4-18dc-423e-b4a0-49e6715ce338 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:13.569221 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250d7f4-18dc-423e-b4a0-49e6715ce338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:13.569518 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250d7f4-18dc-423e-b4a0-49e6715ce338 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:13.570185 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8250d7f4-18dc-423e-b4a0-49e6715ce338 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:13.572169 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8250d7f4-18dc-423e-b4a0-49e6715ce338 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:13.625642 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-cd0d7a80-600e-4f60-8cf7-0c6623ace437 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a73e6a0858a479cb0e8ab589ba2e4ad'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:13.674389 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1091/2157] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:35:13 2022] POST /identity/v3/users => generated 294 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:35:13.679175 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250d7f4-18dc-423e-b4a0-49e6715ce338 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:13.690545 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250d7f4-18dc-423e-b4a0-49e6715ce338 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:13.695372 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fb724-29ab-45d9-afb3-b4b89cf0f809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:13.696510 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fb724-29ab-45d9-afb3-b4b89cf0f809 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:13.697220 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fb724-29ab-45d9-afb3-b4b89cf0f809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:13.697657 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-cd0d7a80-600e-4f60-8cf7-0c6623ace437 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a73e6a0858a479cb0e8ab589ba2e4ad'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:13.698234 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fb724-29ab-45d9-afb3-b4b89cf0f809 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:13.699134 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151fb724-29ab-45d9-afb3-b4b89cf0f809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:13.703168 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151fb724-29ab-45d9-afb3-b4b89cf0f809 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:13.711586 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-cd0d7a80-600e-4f60-8cf7-0c6623ace437 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a73e6a0858a479cb0e8ab589ba2e4ad'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:13.712370 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-cd0d7a80-600e-4f60-8cf7-0c6623ace437 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a73e6a0858a479cb0e8ab589ba2e4ad'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:13.714725 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1092/2158] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 19:35:13.719207 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fb724-29ab-45d9-afb3-b4b89cf0f809 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:13.723329 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-151fb724-29ab-45d9-afb3-b4b89cf0f809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:13.726814 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-cd0d7a80-600e-4f60-8cf7-0c6623ace437 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a73e6a0858a479cb0e8ab589ba2e4ad'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:13.737059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1067/2159] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:35:13 2022] DELETE /identity/v3/users/2a73e6a0858a479cb0e8ab589ba2e4ad => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:35:13.737635 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fb724-29ab-45d9-afb3-b4b89cf0f809 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:13.738703 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e943c6-f8c9-4a67-a89e-efe7af56a137 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:13.739085 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e943c6-f8c9-4a67-a89e-efe7af56a137 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:13.739465 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e943c6-f8c9-4a67-a89e-efe7af56a137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:13.757189 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-20e943c6-f8c9-4a67-a89e-efe7af56a137 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:13.758461 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-20e943c6-f8c9-4a67-a89e-efe7af56a137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:13.797449 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:13.801001 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c562a-c777-4859-8d19-18f9d1c2090e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:13.802149 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c562a-c777-4859-8d19-18f9d1c2090e admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:13.802416 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c562a-c777-4859-8d19-18f9d1c2090e admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:13.802696 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c562a-c777-4859-8d19-18f9d1c2090e admin admin] PATH_INFO: `/v3/projects/165bd52fde0e4ca997a10273f990a1d6/users/da636eb70c2c4110a67d844df89291c7/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:13.817919 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c562a-c777-4859-8d19-18f9d1c2090e admin admin] RBAC: Authorizing `identity:create_grant(project_id=165bd52fde0e4ca997a10273f990a1d6, user_id=da636eb70c2c4110a67d844df89291c7, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:13.820664 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c562a-c777-4859-8d19-18f9d1c2090e admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:13.825223 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1068/2160] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:35:13.837076 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e943c6-f8c9-4a67-a89e-efe7af56a137 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:13.838886 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-20e943c6-f8c9-4a67-a89e-efe7af56a137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:13.898035 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1093/2161] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:35:13 2022] PUT /identity/v3/projects/165bd52fde0e4ca997a10273f990a1d6/users/da636eb70c2c4110a67d844df89291c7/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:35:13.902291 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c562a-c777-4859-8d19-18f9d1c2090e admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:13.908251 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e943c6-f8c9-4a67-a89e-efe7af56a137 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:13.962592 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286a13d-c3ab-4b5a-aebd-cea1ce20a454 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:13.963227 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286a13d-c3ab-4b5a-aebd-cea1ce20a454 service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:13.963564 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286a13d-c3ab-4b5a-aebd-cea1ce20a454 service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:13.963888 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286a13d-c3ab-4b5a-aebd-cea1ce20a454 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:13.970470 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:13.974846 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0286a13d-c3ab-4b5a-aebd-cea1ce20a454 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:13.975270 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c562a-c777-4859-8d19-18f9d1c2090e admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:13.976323 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0286a13d-c3ab-4b5a-aebd-cea1ce20a454 service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:13.980039 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dfff58-9c81-4d05-9a61-9e35090c4471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:13.980713 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dfff58-9c81-4d05-9a61-9e35090c4471 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:13.981001 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dfff58-9c81-4d05-9a61-9e35090c4471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:13.981279 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dfff58-9c81-4d05-9a61-9e35090c4471 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:13.982167 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dfff58-9c81-4d05-9a61-9e35090c4471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:13.983795 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dfff58-9c81-4d05-9a61-9e35090c4471 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:13.986764 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1069/2162] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:35:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 19:35:13.997362 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1094/2163] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 19:35:13.998492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286a13d-c3ab-4b5a-aebd-cea1ce20a454 service neutron] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:14.008031 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286a13d-c3ab-4b5a-aebd-cea1ce20a454 service neutron] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:14.013614 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da795a2-7c6d-4317-9b76-84d3eace0b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:14.014496 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da795a2-7c6d-4317-9b76-84d3eace0b9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:14.014779 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da795a2-7c6d-4317-9b76-84d3eace0b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:14.015970 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da795a2-7c6d-4317-9b76-84d3eace0b9f admin admin] PATH_INFO: `/v3/projects/165bd52fde0e4ca997a10273f990a1d6/users/da636eb70c2c4110a67d844df89291c7/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:14.017130 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da795a2-7c6d-4317-9b76-84d3eace0b9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=165bd52fde0e4ca997a10273f990a1d6, user_id=da636eb70c2c4110a67d844df89291c7, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:14.019797 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da795a2-7c6d-4317-9b76-84d3eace0b9f admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:14.031504 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1070/2164] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:35:13 2022] PUT /identity/v3/projects/165bd52fde0e4ca997a10273f990a1d6/users/da636eb70c2c4110a67d844df89291c7/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:14.048644 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e13a1-401a-4ea3-a003-787aef5911bc None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:14.049086 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e13a1-401a-4ea3-a003-787aef5911bc None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:14.049392 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e13a1-401a-4ea3-a003-787aef5911bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:14.078666 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-387e13a1-401a-4ea3-a003-787aef5911bc None None] MFA Rules not processed for user `da636eb70c2c4110a67d844df89291c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:14.080332 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-387e13a1-401a-4ea3-a003-787aef5911bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:14.152502 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1095/2165] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:14 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:35:14.166216 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da795a2-7c6d-4317-9b76-84d3eace0b9f admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:14.168887 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-4da795a2-7c6d-4317-9b76-84d3eace0b9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:14.258515 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da795a2-7c6d-4317-9b76-84d3eace0b9f admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:14.265141 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51652d-21aa-40d1-b35c-8ad7f535a2cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:14.265978 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51652d-21aa-40d1-b35c-8ad7f535a2cd service cinder] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:14.266331 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51652d-21aa-40d1-b35c-8ad7f535a2cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:14.267166 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51652d-21aa-40d1-b35c-8ad7f535a2cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:14.269277 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-ae51652d-21aa-40d1-b35c-8ad7f535a2cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:14.312178 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:14.350737 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae51652d-21aa-40d1-b35c-8ad7f535a2cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:14.352302 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae51652d-21aa-40d1-b35c-8ad7f535a2cd service cinder] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:14.364383 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1071/2166] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:35:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 19:35:14.453102 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e13a1-401a-4ea3-a003-787aef5911bc None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:14.455638 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-387e13a1-401a-4ea3-a003-787aef5911bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:14.545717 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e13a1-401a-4ea3-a003-787aef5911bc None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:14.550370 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11653a97-ecbf-4801-b162-838a68bc6642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:14.551261 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11653a97-ecbf-4801-b162-838a68bc6642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:14.551579 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11653a97-ecbf-4801-b162-838a68bc6642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:14.551859 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11653a97-ecbf-4801-b162-838a68bc6642 admin admin] PATH_INFO: `/v3/projects/537a5935312e499cbd153f0d66253df5` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:14.553054 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11653a97-ecbf-4801-b162-838a68bc6642 admin admin] RBAC: Authorizing `identity:delete_project(project_id=537a5935312e499cbd153f0d66253df5)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:14.554991 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11653a97-ecbf-4801-b162-838a68bc6642 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:14.687106 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:14.688218 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-11653a97-ecbf-4801-b162-838a68bc6642 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '537a5935312e499cbd153f0d66253df5', 'request_id': 'req-11653a97-ecbf-4801-b162-838a68bc6642'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:14.695455 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-11653a97-ecbf-4801-b162-838a68bc6642 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '537a5935312e499cbd153f0d66253df5', 'request_id': 'req-11653a97-ecbf-4801-b162-838a68bc6642'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:14.771864 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-11653a97-ecbf-4801-b162-838a68bc6642 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '537a5935312e499cbd153f0d66253df5', 'request_id': 'req-11653a97-ecbf-4801-b162-838a68bc6642'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:14.783612 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-11653a97-ecbf-4801-b162-838a68bc6642 admin admin] The token cache is being invalidate because project 537a5935312e499cbd153f0d66253df5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:35:14.783909 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-11653a97-ecbf-4801-b162-838a68bc6642 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:14.784543 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-11653a97-ecbf-4801-b162-838a68bc6642 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:14.786076 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1096/2167] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:35:14 2022] DELETE /identity/v3/projects/537a5935312e499cbd153f0d66253df5 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:14.790266 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51652d-21aa-40d1-b35c-8ad7f535a2cd service cinder] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:14.801384 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51652d-21aa-40d1-b35c-8ad7f535a2cd service cinder] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:14.859935 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ac977-77c6-4789-b860-28d23a45c898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:14.860836 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ac977-77c6-4789-b860-28d23a45c898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:14.861195 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ac977-77c6-4789-b860-28d23a45c898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:14.861465 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ac977-77c6-4789-b860-28d23a45c898 admin admin] PATH_INFO: `/v3/users/ba206f7124a84e73ba7a25320f864722` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:14.862653 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ac977-77c6-4789-b860-28d23a45c898 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba206f7124a84e73ba7a25320f864722)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:14.864644 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ac977-77c6-4789-b860-28d23a45c898 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:15.118746 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-098ac977-77c6-4789-b860-28d23a45c898 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba206f7124a84e73ba7a25320f864722'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:15.124505 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:15.228698 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-098ac977-77c6-4789-b860-28d23a45c898 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba206f7124a84e73ba7a25320f864722'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:15.241777 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-098ac977-77c6-4789-b860-28d23a45c898 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba206f7124a84e73ba7a25320f864722'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:15.242546 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-098ac977-77c6-4789-b860-28d23a45c898 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba206f7124a84e73ba7a25320f864722'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:15.250472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-098ac977-77c6-4789-b860-28d23a45c898 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba206f7124a84e73ba7a25320f864722'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:15.256709 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1072/2168] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:35:14 2022] DELETE /identity/v3/users/ba206f7124a84e73ba7a25320f864722 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:15.712153 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:15.776189 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11653a97-ecbf-4801-b162-838a68bc6642 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:15.778442 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-11653a97-ecbf-4801-b162-838a68bc6642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:15.792567 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11653a97-ecbf-4801-b162-838a68bc6642 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:15.865242 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4667634-d3bd-4b92-aea3-fe2ff32d18d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:15.866140 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4667634-d3bd-4b92-aea3-fe2ff32d18d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:15.866430 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4667634-d3bd-4b92-aea3-fe2ff32d18d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:15.871879 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4667634-d3bd-4b92-aea3-fe2ff32d18d6 admin admin] PATH_INFO: `/v3/projects/67b16839d52646aaa5d874fdbe3e16d0` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:15.871879 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4667634-d3bd-4b92-aea3-fe2ff32d18d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67b16839d52646aaa5d874fdbe3e16d0)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:15.871879 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4667634-d3bd-4b92-aea3-fe2ff32d18d6 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:16.007508 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c4667634-d3bd-4b92-aea3-fe2ff32d18d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67b16839d52646aaa5d874fdbe3e16d0', 'request_id': 'req-c4667634-d3bd-4b92-aea3-fe2ff32d18d6'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:16.015038 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c4667634-d3bd-4b92-aea3-fe2ff32d18d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67b16839d52646aaa5d874fdbe3e16d0', 'request_id': 'req-c4667634-d3bd-4b92-aea3-fe2ff32d18d6'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:16.105576 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c4667634-d3bd-4b92-aea3-fe2ff32d18d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67b16839d52646aaa5d874fdbe3e16d0', 'request_id': 'req-c4667634-d3bd-4b92-aea3-fe2ff32d18d6'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:16.116761 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c4667634-d3bd-4b92-aea3-fe2ff32d18d6 admin admin] The token cache is being invalidate because project 67b16839d52646aaa5d874fdbe3e16d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:35:16.117082 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c4667634-d3bd-4b92-aea3-fe2ff32d18d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:16.117715 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c4667634-d3bd-4b92-aea3-fe2ff32d18d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:16.119262 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1097/2169] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:35:15 2022] DELETE /identity/v3/projects/67b16839d52646aaa5d874fdbe3e16d0 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:16.124347 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240b7a8-3a7b-424b-9480-6eaf82941fa2 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:16.124642 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240b7a8-3a7b-424b-9480-6eaf82941fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:16.124922 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240b7a8-3a7b-424b-9480-6eaf82941fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:16.144013 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-c240b7a8-3a7b-424b-9480-6eaf82941fa2 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:16.145221 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-c240b7a8-3a7b-424b-9480-6eaf82941fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:16.205945 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1073/2170] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:35:16.214378 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2b332-9725-451b-a511-934f4b862a3a None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:16.214875 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2b332-9725-451b-a511-934f4b862a3a None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:16.215167 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2b332-9725-451b-a511-934f4b862a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:16.234353 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-5fa2b332-9725-451b-a511-934f4b862a3a None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:16.237355 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-5fa2b332-9725-451b-a511-934f4b862a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:16.246263 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1098/2171] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:35:16.250897 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240b7a8-3a7b-424b-9480-6eaf82941fa2 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:16.261567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240b7a8-3a7b-424b-9480-6eaf82941fa2 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:16.266707 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbe0e6-eb33-41ca-814c-b5c068ae2ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:16.267540 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbe0e6-eb33-41ca-814c-b5c068ae2ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:16.267831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbe0e6-eb33-41ca-814c-b5c068ae2ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:16.268109 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbe0e6-eb33-41ca-814c-b5c068ae2ca3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:16.268849 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbe0e6-eb33-41ca-814c-b5c068ae2ca3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:35:16.269159 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbe0e6-eb33-41ca-814c-b5c068ae2ca3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:16.270774 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbe0e6-eb33-41ca-814c-b5c068ae2ca3 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:16.283568 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1074/2172] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:35:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:35:16.288184 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2b332-9725-451b-a511-934f4b862a3a None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:16.294615 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:16.297828 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2b332-9725-451b-a511-934f4b862a3a None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:16.306335 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39afcf-8c10-422d-a6ab-b3f1a948c649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:16.307009 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39afcf-8c10-422d-a6ab-b3f1a948c649 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:16.307309 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39afcf-8c10-422d-a6ab-b3f1a948c649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:16.307618 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39afcf-8c10-422d-a6ab-b3f1a948c649 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:16.308323 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39afcf-8c10-422d-a6ab-b3f1a948c649 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:16.310317 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39afcf-8c10-422d-a6ab-b3f1a948c649 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:16.406937 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1099/2173] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:35:16 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:35:16.408129 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbe0e6-eb33-41ca-814c-b5c068ae2ca3 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:16.418622 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbe0e6-eb33-41ca-814c-b5c068ae2ca3 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:16.482453 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2d93b-0c94-4472-8b0b-820dcb90e30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:16.483234 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2d93b-0c94-4472-8b0b-820dcb90e30d admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:16.483651 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2d93b-0c94-4472-8b0b-820dcb90e30d admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:16.484068 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2d93b-0c94-4472-8b0b-820dcb90e30d admin admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:16.484792 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd2d93b-0c94-4472-8b0b-820dcb90e30d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:16.486702 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd2d93b-0c94-4472-8b0b-820dcb90e30d admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:16.571904 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1075/2174] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:35:16 2022] POST /identity/v3/users => generated 294 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:35:16.576949 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39afcf-8c10-422d-a6ab-b3f1a948c649 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:16.588123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39afcf-8c10-422d-a6ab-b3f1a948c649 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:16.593700 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5617e-a1ca-458d-819c-8b3be0f862dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:16.594484 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5617e-a1ca-458d-819c-8b3be0f862dc admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:16.594785 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5617e-a1ca-458d-819c-8b3be0f862dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:16.595123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5617e-a1ca-458d-819c-8b3be0f862dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:16.595980 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf5617e-a1ca-458d-819c-8b3be0f862dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:16.597589 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf5617e-a1ca-458d-819c-8b3be0f862dc admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:16.610364 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1100/2175] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:35:16.614386 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2d93b-0c94-4472-8b0b-820dcb90e30d admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:16.628319 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2d93b-0c94-4472-8b0b-820dcb90e30d admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:16.629157 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:16.632399 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88797659-d5f3-44f0-b8f7-c9811aee30d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:16.633073 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88797659-d5f3-44f0-b8f7-c9811aee30d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:16.633361 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88797659-d5f3-44f0-b8f7-c9811aee30d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:16.633640 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88797659-d5f3-44f0-b8f7-c9811aee30d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:16.634368 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88797659-d5f3-44f0-b8f7-c9811aee30d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:16.636682 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88797659-d5f3-44f0-b8f7-c9811aee30d6 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:16.647293 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1076/2176] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:35:16.651809 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5617e-a1ca-458d-819c-8b3be0f862dc admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:16.662629 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5617e-a1ca-458d-819c-8b3be0f862dc admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:16.667816 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f4475-59f2-4bf1-ae2b-ea03d7538a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:16.668709 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f4475-59f2-4bf1-ae2b-ea03d7538a02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:16.669056 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f4475-59f2-4bf1-ae2b-ea03d7538a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:16.669334 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f4475-59f2-4bf1-ae2b-ea03d7538a02 admin admin] PATH_INFO: `/v3/projects/53141730547147f08ba35c05f0336e86/users/f683c0c3fa5c4b7ca30dce392e305ef0/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:16.685834 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f4475-59f2-4bf1-ae2b-ea03d7538a02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53141730547147f08ba35c05f0336e86, user_id=f683c0c3fa5c4b7ca30dce392e305ef0, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:16.688643 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f4475-59f2-4bf1-ae2b-ea03d7538a02 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:16.779714 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1101/2177] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:35:16 2022] PUT /identity/v3/projects/53141730547147f08ba35c05f0336e86/users/f683c0c3fa5c4b7ca30dce392e305ef0/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:16.790386 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf09f27-b76c-4d32-85d2-c211ffc114a4 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:16.790677 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf09f27-b76c-4d32-85d2-c211ffc114a4 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:16.790955 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf09f27-b76c-4d32-85d2-c211ffc114a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:16.818199 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-ebf09f27-b76c-4d32-85d2-c211ffc114a4 None None] MFA Rules not processed for user `f683c0c3fa5c4b7ca30dce392e305ef0`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:16.819468 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-ebf09f27-b76c-4d32-85d2-c211ffc114a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:16.860384 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:16.886138 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1077/2178] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:35:16.890654 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f4475-59f2-4bf1-ae2b-ea03d7538a02 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:16.955366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f4475-59f2-4bf1-ae2b-ea03d7538a02 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:16.960185 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62529a66-60f7-4247-a4fd-264493f2f83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:16.960850 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62529a66-60f7-4247-a4fd-264493f2f83a admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:16.961136 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62529a66-60f7-4247-a4fd-264493f2f83a admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:16.961416 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62529a66-60f7-4247-a4fd-264493f2f83a admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:16.962116 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62529a66-60f7-4247-a4fd-264493f2f83a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:16.964161 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62529a66-60f7-4247-a4fd-264493f2f83a admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:17.074358 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1102/2179] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:35:16 2022] POST /identity/v3/projects => generated 387 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:35:17.075594 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf09f27-b76c-4d32-85d2-c211ffc114a4 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:17.088264 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf09f27-b76c-4d32-85d2-c211ffc114a4 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:17.146261 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d413a1-dcb2-419a-bc36-ab29a36905c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:17.151746 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d413a1-dcb2-419a-bc36-ab29a36905c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:17.151746 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d413a1-dcb2-419a-bc36-ab29a36905c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:17.151746 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d413a1-dcb2-419a-bc36-ab29a36905c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:17.151746 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d413a1-dcb2-419a-bc36-ab29a36905c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:17.151746 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d413a1-dcb2-419a-bc36-ab29a36905c5 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:17.243220 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1078/2180] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:35:17 2022] POST /identity/v3/users => generated 294 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:35:17.247489 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62529a66-60f7-4247-a4fd-264493f2f83a admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:17.257775 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62529a66-60f7-4247-a4fd-264493f2f83a admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:17.262663 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee88ed3-65f8-4992-afd7-89ed8a14a6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:17.263346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee88ed3-65f8-4992-afd7-89ed8a14a6b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:17.263667 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee88ed3-65f8-4992-afd7-89ed8a14a6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:17.263950 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee88ed3-65f8-4992-afd7-89ed8a14a6b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:17.264677 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee88ed3-65f8-4992-afd7-89ed8a14a6b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:17.267848 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee88ed3-65f8-4992-afd7-89ed8a14a6b2 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:17.277588 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1103/2181] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:35:17.281463 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d413a1-dcb2-419a-bc36-ab29a36905c5 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:17.291532 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d413a1-dcb2-419a-bc36-ab29a36905c5 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:17.298970 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e551798-e442-433f-8634-22e6bcb8e578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:17.299681 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e551798-e442-433f-8634-22e6bcb8e578 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:17.299987 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e551798-e442-433f-8634-22e6bcb8e578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:17.300236 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e551798-e442-433f-8634-22e6bcb8e578 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:17.300998 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e551798-e442-433f-8634-22e6bcb8e578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:17.302593 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e551798-e442-433f-8634-22e6bcb8e578 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:17.317237 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:17.317237 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1079/2182] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:35:17.318702 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee88ed3-65f8-4992-afd7-89ed8a14a6b2 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:17.329085 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee88ed3-65f8-4992-afd7-89ed8a14a6b2 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:17.335777 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6004620-2110-4410-967f-466f8995c2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:17.336646 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6004620-2110-4410-967f-466f8995c2a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:17.336934 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6004620-2110-4410-967f-466f8995c2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:17.337211 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6004620-2110-4410-967f-466f8995c2a5 admin admin] PATH_INFO: `/v3/projects/5ad685dcfb474197a6e566c9e17aab52/users/270c7b66ac844f5db692d960cdf5d1cb/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:17.353179 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6004620-2110-4410-967f-466f8995c2a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ad685dcfb474197a6e566c9e17aab52, user_id=270c7b66ac844f5db692d960cdf5d1cb, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:17.356705 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6004620-2110-4410-967f-466f8995c2a5 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:17.445696 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:17.451542 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1104/2183] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:35:17 2022] PUT /identity/v3/projects/5ad685dcfb474197a6e566c9e17aab52/users/270c7b66ac844f5db692d960cdf5d1cb/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:17.455062 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e551798-e442-433f-8634-22e6bcb8e578 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:17.456979 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-6e551798-e442-433f-8634-22e6bcb8e578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:17.465399 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee5e43-91f5-4d94-a15f-5c4e7b1e9e5b None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:17.465738 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee5e43-91f5-4d94-a15f-5c4e7b1e9e5b None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:17.465962 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee5e43-91f5-4d94-a15f-5c4e7b1e9e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:17.470949 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e551798-e442-433f-8634-22e6bcb8e578 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:17.492323 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-4bee5e43-91f5-4d94-a15f-5c4e7b1e9e5b None None] MFA Rules not processed for user `270c7b66ac844f5db692d960cdf5d1cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:17.493582 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-4bee5e43-91f5-4d94-a15f-5c4e7b1e9e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:17.539465 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221a962-f242-45f0-84fd-26dacb61950a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:17.539465 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221a962-f242-45f0-84fd-26dacb61950a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:17.539465 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221a962-f242-45f0-84fd-26dacb61950a admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:17.539465 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221a962-f242-45f0-84fd-26dacb61950a admin admin] PATH_INFO: `/v3/users/53213307fabe49b4b5c6f0cbec2562d6` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:17.540870 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9221a962-f242-45f0-84fd-26dacb61950a admin admin] RBAC: Authorizing `identity:delete_user(user_id=53213307fabe49b4b5c6f0cbec2562d6)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:17.544379 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9221a962-f242-45f0-84fd-26dacb61950a admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:17.582131 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1105/2184] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:35:17.583131 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee5e43-91f5-4d94-a15f-5c4e7b1e9e5b None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:17.584719 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-4bee5e43-91f5-4d94-a15f-5c4e7b1e9e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:17.601747 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee5e43-91f5-4d94-a15f-5c4e7b1e9e5b None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:17.606903 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96889123-29b2-4635-b494-f4310b13f97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:17.607805 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96889123-29b2-4635-b494-f4310b13f97f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:17.608093 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96889123-29b2-4635-b494-f4310b13f97f admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:17.608370 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96889123-29b2-4635-b494-f4310b13f97f admin admin] PATH_INFO: `/v3/users/7912e83ad33545edb2b117955b47dc1f` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:17.609701 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96889123-29b2-4635-b494-f4310b13f97f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7912e83ad33545edb2b117955b47dc1f)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:17.611738 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96889123-29b2-4635-b494-f4310b13f97f admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:17.780548 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-9221a962-f242-45f0-84fd-26dacb61950a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53213307fabe49b4b5c6f0cbec2562d6'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:17.839824 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-96889123-29b2-4635-b494-f4310b13f97f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7912e83ad33545edb2b117955b47dc1f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:17.880902 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:17.882333 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-9221a962-f242-45f0-84fd-26dacb61950a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53213307fabe49b4b5c6f0cbec2562d6'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:17.896673 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-9221a962-f242-45f0-84fd-26dacb61950a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53213307fabe49b4b5c6f0cbec2562d6'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:17.897469 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-9221a962-f242-45f0-84fd-26dacb61950a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53213307fabe49b4b5c6f0cbec2562d6'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:17.905634 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-9221a962-f242-45f0-84fd-26dacb61950a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53213307fabe49b4b5c6f0cbec2562d6'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:17.911884 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1080/2185] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:35:17 2022] DELETE /identity/v3/users/53213307fabe49b4b5c6f0cbec2562d6 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:17.913050 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221a962-f242-45f0-84fd-26dacb61950a admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:17.914416 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-9221a962-f242-45f0-84fd-26dacb61950a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:17.983047 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221a962-f242-45f0-84fd-26dacb61950a admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:17.987713 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f1653e-135f-4f2a-9a1e-e4d3132641e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:17.988438 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1653e-135f-4f2a-9a1e-e4d3132641e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:17.988740 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1653e-135f-4f2a-9a1e-e4d3132641e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:17.988996 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1653e-135f-4f2a-9a1e-e4d3132641e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:17.989685 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f1653e-135f-4f2a-9a1e-e4d3132641e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:17.991640 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f1653e-135f-4f2a-9a1e-e4d3132641e0 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:17.997468 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-96889123-29b2-4635-b494-f4310b13f97f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7912e83ad33545edb2b117955b47dc1f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:17.999147 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-96889123-29b2-4635-b494-f4310b13f97f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7912e83ad33545edb2b117955b47dc1f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:18.022176 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-96889123-29b2-4635-b494-f4310b13f97f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7912e83ad33545edb2b117955b47dc1f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:18.035878 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-96889123-29b2-4635-b494-f4310b13f97f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7912e83ad33545edb2b117955b47dc1f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:18.042789 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1106/2186] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:35:17 2022] DELETE /identity/v3/users/7912e83ad33545edb2b117955b47dc1f => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:18.045891 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac645b-2ab2-45f7-a239-766c8980eb15 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:18.045891 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac645b-2ab2-45f7-a239-766c8980eb15 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:18.045891 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac645b-2ab2-45f7-a239-766c8980eb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:18.054784 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:18.064890 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-d5ac645b-2ab2-45f7-a239-766c8980eb15 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:18.066432 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-d5ac645b-2ab2-45f7-a239-766c8980eb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:18.079890 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1081/2187] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:35:17 2022] POST /identity/v3/projects => generated 387 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:35:18.081256 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a23c5a-0d44-46fb-b5a9-d0e74d3517cd None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:18.081553 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a23c5a-0d44-46fb-b5a9-d0e74d3517cd None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:18.081833 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a23c5a-0d44-46fb-b5a9-d0e74d3517cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:18.100322 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-41a23c5a-0d44-46fb-b5a9-d0e74d3517cd None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:18.101546 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-41a23c5a-0d44-46fb-b5a9-d0e74d3517cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:18.129531 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1107/2188] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:35:18.130255 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac645b-2ab2-45f7-a239-766c8980eb15 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:18.131569 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-d5ac645b-2ab2-45f7-a239-766c8980eb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:18.144871 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac645b-2ab2-45f7-a239-766c8980eb15 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:18.165750 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1082/2189] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:35:18.166594 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a23c5a-0d44-46fb-b5a9-d0e74d3517cd None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:18.168713 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-41a23c5a-0d44-46fb-b5a9-d0e74d3517cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:18.209893 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f5671-d9fd-4cc2-9091-c551137d4efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:18.210600 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f5671-d9fd-4cc2-9091-c551137d4efc admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:18.210888 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f5671-d9fd-4cc2-9091-c551137d4efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:18.211164 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f5671-d9fd-4cc2-9091-c551137d4efc admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:18.211908 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f5671-d9fd-4cc2-9091-c551137d4efc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:18.214360 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f5671-d9fd-4cc2-9091-c551137d4efc admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:18.224888 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a23c5a-0d44-46fb-b5a9-d0e74d3517cd None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:18.228550 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f412e39-78ec-47b0-889e-3a73c9904ba4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:18.229198 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f412e39-78ec-47b0-889e-3a73c9904ba4 service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:18.231914 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f412e39-78ec-47b0-889e-3a73c9904ba4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:18.231914 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f412e39-78ec-47b0-889e-3a73c9904ba4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:18.239511 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f412e39-78ec-47b0-889e-3a73c9904ba4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:18.240890 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f412e39-78ec-47b0-889e-3a73c9904ba4 service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:18.250309 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1083/2190] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:35:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:35:18.251168 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f412e39-78ec-47b0-889e-3a73c9904ba4 service neutron] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:18.252484 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-2f412e39-78ec-47b0-889e-3a73c9904ba4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:18.264724 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f412e39-78ec-47b0-889e-3a73c9904ba4 service neutron] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:18.268680 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcfda97-1e1a-464a-9d94-b49d8a67ebd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:18.269373 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfda97-1e1a-464a-9d94-b49d8a67ebd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:18.269662 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfda97-1e1a-464a-9d94-b49d8a67ebd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:18.269941 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfda97-1e1a-464a-9d94-b49d8a67ebd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:18.280692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcfda97-1e1a-464a-9d94-b49d8a67ebd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:18.282324 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcfda97-1e1a-464a-9d94-b49d8a67ebd5 service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:18.292289 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1084/2191] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:35:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:35:18.304702 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1108/2192] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:35:18 2022] POST /identity/v3/users => generated 300 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:35:18.308677 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcfda97-1e1a-464a-9d94-b49d8a67ebd5 service neutron] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:18.318869 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcfda97-1e1a-464a-9d94-b49d8a67ebd5 service neutron] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:18.324477 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf733ca1-e9a1-4b3f-96fc-f27e6d4b926d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:18.325139 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf733ca1-e9a1-4b3f-96fc-f27e6d4b926d admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:18.325423 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf733ca1-e9a1-4b3f-96fc-f27e6d4b926d admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:18.325697 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf733ca1-e9a1-4b3f-96fc-f27e6d4b926d admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:18.326424 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf733ca1-e9a1-4b3f-96fc-f27e6d4b926d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:18.328063 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf733ca1-e9a1-4b3f-96fc-f27e6d4b926d admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:18.340249 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1085/2193] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:35:18.345322 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f5671-d9fd-4cc2-9091-c551137d4efc admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:18.359700 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f5671-d9fd-4cc2-9091-c551137d4efc admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:18.364770 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a2a60-78be-4615-901e-b26e0cc78d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:18.365674 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a2a60-78be-4615-901e-b26e0cc78d18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:18.365959 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a2a60-78be-4615-901e-b26e0cc78d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:18.366239 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a2a60-78be-4615-901e-b26e0cc78d18 admin admin] PATH_INFO: `/v3/projects/0afc44f4c21e450e9f4f3e4d3f4feb10/users/7f6b72d7c266415a84f2fc1018cefd45/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:18.384523 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5a2a60-78be-4615-901e-b26e0cc78d18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0afc44f4c21e450e9f4f3e4d3f4feb10, user_id=7f6b72d7c266415a84f2fc1018cefd45, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:18.388337 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5a2a60-78be-4615-901e-b26e0cc78d18 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:18.474141 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1109/2194] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:35:18 2022] PUT /identity/v3/projects/0afc44f4c21e450e9f4f3e4d3f4feb10/users/7f6b72d7c266415a84f2fc1018cefd45/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:18.478111 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf733ca1-e9a1-4b3f-96fc-f27e6d4b926d admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:18.489784 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf733ca1-e9a1-4b3f-96fc-f27e6d4b926d admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:18.527227 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:18.596916 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7bb8ba-5798-417f-92bc-3a078fc27022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:18.597857 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bb8ba-5798-417f-92bc-3a078fc27022 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:18.598261 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bb8ba-5798-417f-92bc-3a078fc27022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:18.598612 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bb8ba-5798-417f-92bc-3a078fc27022 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:18.599767 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7bb8ba-5798-417f-92bc-3a078fc27022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:18.602024 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7bb8ba-5798-417f-92bc-3a078fc27022 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:18.614682 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1086/2195] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:35:18.620943 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a2a60-78be-4615-901e-b26e0cc78d18 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:18.640151 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a2a60-78be-4615-901e-b26e0cc78d18 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:18.645372 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd40492-5681-4f15-b2fb-04bf512874e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:18.649138 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd40492-5681-4f15-b2fb-04bf512874e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:18.649138 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd40492-5681-4f15-b2fb-04bf512874e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:18.649138 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd40492-5681-4f15-b2fb-04bf512874e6 admin admin] PATH_INFO: `/v3/projects/0afc44f4c21e450e9f4f3e4d3f4feb10/users/7f6b72d7c266415a84f2fc1018cefd45/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:18.649138 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd40492-5681-4f15-b2fb-04bf512874e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0afc44f4c21e450e9f4f3e4d3f4feb10, user_id=7f6b72d7c266415a84f2fc1018cefd45, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:18.653206 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd40492-5681-4f15-b2fb-04bf512874e6 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:18.664391 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1110/2196] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:35:18 2022] PUT /identity/v3/projects/0afc44f4c21e450e9f4f3e4d3f4feb10/users/7f6b72d7c266415a84f2fc1018cefd45/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:18.676969 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b543ae7-108d-4732-b873-06185c958f4c None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:18.676969 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b543ae7-108d-4732-b873-06185c958f4c None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:18.676969 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b543ae7-108d-4732-b873-06185c958f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:18.708087 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-1b543ae7-108d-4732-b873-06185c958f4c None None] MFA Rules not processed for user `7f6b72d7c266415a84f2fc1018cefd45`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:18.709300 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-1b543ae7-108d-4732-b873-06185c958f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:18.724550 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd40492-5681-4f15-b2fb-04bf512874e6 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:18.726459 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-0fd40492-5681-4f15-b2fb-04bf512874e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:18.814419 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1087/2197] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:35:18.818301 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:18.818538 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b543ae7-108d-4732-b873-06185c958f4c None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:18.819798 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-1b543ae7-108d-4732-b873-06185c958f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:18.827895 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd40492-5681-4f15-b2fb-04bf512874e6 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:18.832782 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2015acd4-117f-4208-9ce0-f8a8adbed29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:18.833777 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015acd4-117f-4208-9ce0-f8a8adbed29c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:18.834064 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015acd4-117f-4208-9ce0-f8a8adbed29c admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:18.834338 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015acd4-117f-4208-9ce0-f8a8adbed29c admin admin] PATH_INFO: `/v3/projects/fa2f3a31244b4c57b27af5366913450d` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:18.835622 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2015acd4-117f-4208-9ce0-f8a8adbed29c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa2f3a31244b4c57b27af5366913450d)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:18.837510 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2015acd4-117f-4208-9ce0-f8a8adbed29c admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:18.838526 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b543ae7-108d-4732-b873-06185c958f4c None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:18.845534 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c4296-01e8-42dc-97aa-25ca5b3ebec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:18.846407 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c4296-01e8-42dc-97aa-25ca5b3ebec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:18.846695 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c4296-01e8-42dc-97aa-25ca5b3ebec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:18.847311 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c4296-01e8-42dc-97aa-25ca5b3ebec1 admin admin] PATH_INFO: `/v3/projects/42e1555bbf8e413ba629ace51de5488a` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:18.848618 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c4296-01e8-42dc-97aa-25ca5b3ebec1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42e1555bbf8e413ba629ace51de5488a)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:18.850679 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c4296-01e8-42dc-97aa-25ca5b3ebec1 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:18.960591 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-2015acd4-117f-4208-9ce0-f8a8adbed29c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa2f3a31244b4c57b27af5366913450d', 'request_id': 'req-2015acd4-117f-4208-9ce0-f8a8adbed29c'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:18.968297 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-2015acd4-117f-4208-9ce0-f8a8adbed29c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa2f3a31244b4c57b27af5366913450d', 'request_id': 'req-2015acd4-117f-4208-9ce0-f8a8adbed29c'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:18.991172 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-241c4296-01e8-42dc-97aa-25ca5b3ebec1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42e1555bbf8e413ba629ace51de5488a', 'request_id': 'req-241c4296-01e8-42dc-97aa-25ca5b3ebec1'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:19.110104 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-2015acd4-117f-4208-9ce0-f8a8adbed29c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa2f3a31244b4c57b27af5366913450d', 'request_id': 'req-2015acd4-117f-4208-9ce0-f8a8adbed29c'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:19.130876 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-2015acd4-117f-4208-9ce0-f8a8adbed29c admin admin] The token cache is being invalidate because project fa2f3a31244b4c57b27af5366913450d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:35:19.131270 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-2015acd4-117f-4208-9ce0-f8a8adbed29c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:19.132335 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-2015acd4-117f-4208-9ce0-f8a8adbed29c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:19.140594 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1111/2198] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:35:18 2022] DELETE /identity/v3/projects/fa2f3a31244b4c57b27af5366913450d => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:35:19.141199 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2015acd4-117f-4208-9ce0-f8a8adbed29c admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:19.144283 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-2015acd4-117f-4208-9ce0-f8a8adbed29c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:19.169415 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-241c4296-01e8-42dc-97aa-25ca5b3ebec1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42e1555bbf8e413ba629ace51de5488a', 'request_id': 'req-241c4296-01e8-42dc-97aa-25ca5b3ebec1'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:19.178120 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-241c4296-01e8-42dc-97aa-25ca5b3ebec1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42e1555bbf8e413ba629ace51de5488a', 'request_id': 'req-241c4296-01e8-42dc-97aa-25ca5b3ebec1'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:19.204785 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-241c4296-01e8-42dc-97aa-25ca5b3ebec1 admin admin] The token cache is being invalidate because project 42e1555bbf8e413ba629ace51de5488a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:35:19.209474 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-241c4296-01e8-42dc-97aa-25ca5b3ebec1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:19.210254 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-241c4296-01e8-42dc-97aa-25ca5b3ebec1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:19.212284 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1088/2199] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:35:18 2022] DELETE /identity/v3/projects/42e1555bbf8e413ba629ace51de5488a => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:19.217283 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c4296-01e8-42dc-97aa-25ca5b3ebec1 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:19.217283 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-241c4296-01e8-42dc-97aa-25ca5b3ebec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:19.263245 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2015acd4-117f-4208-9ce0-f8a8adbed29c admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:19.320423 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c4296-01e8-42dc-97aa-25ca5b3ebec1 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:19.326870 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf3682-8aac-4ab3-a8fd-d4b4fecc3674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:19.328112 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf3682-8aac-4ab3-a8fd-d4b4fecc3674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:19.328400 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf3682-8aac-4ab3-a8fd-d4b4fecc3674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:19.328679 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf3682-8aac-4ab3-a8fd-d4b4fecc3674 admin admin] PATH_INFO: `/v3/users/da636eb70c2c4110a67d844df89291c7` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:19.330191 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf3682-8aac-4ab3-a8fd-d4b4fecc3674 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da636eb70c2c4110a67d844df89291c7)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:19.333269 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf3682-8aac-4ab3-a8fd-d4b4fecc3674 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:19.359551 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499ccda-7557-4371-9de5-562b273914c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:19.359999 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499ccda-7557-4371-9de5-562b273914c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:19.361665 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499ccda-7557-4371-9de5-562b273914c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:19.362587 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499ccda-7557-4371-9de5-562b273914c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:19.364935 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-2499ccda-7557-4371-9de5-562b273914c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:19.442252 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499ccda-7557-4371-9de5-562b273914c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:19.443811 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499ccda-7557-4371-9de5-562b273914c4 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:19.454014 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1112/2200] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:35:19 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:35:19.537698 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-74bf3682-8aac-4ab3-a8fd-d4b4fecc3674 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da636eb70c2c4110a67d844df89291c7'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:19.622281 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-74bf3682-8aac-4ab3-a8fd-d4b4fecc3674 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da636eb70c2c4110a67d844df89291c7'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:19.634612 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-74bf3682-8aac-4ab3-a8fd-d4b4fecc3674 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da636eb70c2c4110a67d844df89291c7'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:19.635307 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-74bf3682-8aac-4ab3-a8fd-d4b4fecc3674 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da636eb70c2c4110a67d844df89291c7'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:19.642188 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-74bf3682-8aac-4ab3-a8fd-d4b4fecc3674 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da636eb70c2c4110a67d844df89291c7'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:19.648062 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1089/2201] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:35:19 2022] DELETE /identity/v3/users/da636eb70c2c4110a67d844df89291c7 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:20.114222 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499ccda-7557-4371-9de5-562b273914c4 service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:20.129767 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499ccda-7557-4371-9de5-562b273914c4 service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:20.188578 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765bfb0-c9ea-457d-ac4c-4843f315df1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:20.189442 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765bfb0-c9ea-457d-ac4c-4843f315df1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:20.189720 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765bfb0-c9ea-457d-ac4c-4843f315df1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:20.189992 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765bfb0-c9ea-457d-ac4c-4843f315df1e admin admin] PATH_INFO: `/v3/projects/165bd52fde0e4ca997a10273f990a1d6` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:20.191458 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c765bfb0-c9ea-457d-ac4c-4843f315df1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=165bd52fde0e4ca997a10273f990a1d6)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:20.193338 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c765bfb0-c9ea-457d-ac4c-4843f315df1e admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:20.234974 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:20.295832 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c765bfb0-c9ea-457d-ac4c-4843f315df1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '165bd52fde0e4ca997a10273f990a1d6', 'request_id': 'req-c765bfb0-c9ea-457d-ac4c-4843f315df1e'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:20.303280 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c765bfb0-c9ea-457d-ac4c-4843f315df1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '165bd52fde0e4ca997a10273f990a1d6', 'request_id': 'req-c765bfb0-c9ea-457d-ac4c-4843f315df1e'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:20.380176 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c765bfb0-c9ea-457d-ac4c-4843f315df1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '165bd52fde0e4ca997a10273f990a1d6', 'request_id': 'req-c765bfb0-c9ea-457d-ac4c-4843f315df1e'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:20.392924 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c765bfb0-c9ea-457d-ac4c-4843f315df1e admin admin] The token cache is being invalidate because project 165bd52fde0e4ca997a10273f990a1d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:35:20.393216 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c765bfb0-c9ea-457d-ac4c-4843f315df1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:20.393866 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c765bfb0-c9ea-457d-ac4c-4843f315df1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:20.396038 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1113/2202] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:35:20 2022] DELETE /identity/v3/projects/165bd52fde0e4ca997a10273f990a1d6 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:20.401053 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70a264-1f66-4a7d-ba9c-afaf779f90be None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:20.401568 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70a264-1f66-4a7d-ba9c-afaf779f90be None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:20.401685 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70a264-1f66-4a7d-ba9c-afaf779f90be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:20.422324 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-ee70a264-1f66-4a7d-ba9c-afaf779f90be None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:20.424128 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-ee70a264-1f66-4a7d-ba9c-afaf779f90be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:20.495751 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1090/2203] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:35:20.503853 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c96095-985b-450d-8735-5bb4516ec5e5 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:20.504145 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c96095-985b-450d-8735-5bb4516ec5e5 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:20.504421 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c96095-985b-450d-8735-5bb4516ec5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:20.523007 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-c0c96095-985b-450d-8735-5bb4516ec5e5 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:20.524241 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-c0c96095-985b-450d-8735-5bb4516ec5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:20.532086 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1114/2204] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:35:20.534467 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:20.536153 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70a264-1f66-4a7d-ba9c-afaf779f90be None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:20.545985 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70a264-1f66-4a7d-ba9c-afaf779f90be None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:20.550475 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30827cc8-a445-4746-b909-278aae019789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:20.551122 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30827cc8-a445-4746-b909-278aae019789 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:20.551404 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30827cc8-a445-4746-b909-278aae019789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:20.551713 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30827cc8-a445-4746-b909-278aae019789 admin admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:20.552449 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30827cc8-a445-4746-b909-278aae019789 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:35:20.552750 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30827cc8-a445-4746-b909-278aae019789 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:20.554327 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30827cc8-a445-4746-b909-278aae019789 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:20.567793 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1091/2205] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:35:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:35:20.571773 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c96095-985b-450d-8735-5bb4516ec5e5 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:20.581443 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c96095-985b-450d-8735-5bb4516ec5e5 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:20.586448 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d227f-9e86-4fd4-ad8a-26ad2ce51acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:20.587111 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d227f-9e86-4fd4-ad8a-26ad2ce51acf admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:20.587398 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d227f-9e86-4fd4-ad8a-26ad2ce51acf admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:20.587710 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d227f-9e86-4fd4-ad8a-26ad2ce51acf admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:20.588415 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664d227f-9e86-4fd4-ad8a-26ad2ce51acf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:20.590538 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664d227f-9e86-4fd4-ad8a-26ad2ce51acf admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:20.691909 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1115/2206] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:35:20 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:35:20.692793 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30827cc8-a445-4746-b909-278aae019789 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:20.708178 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30827cc8-a445-4746-b909-278aae019789 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:20.758850 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d227f-9e86-4fd4-ad8a-26ad2ce51acf admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:20.760664 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-664d227f-9e86-4fd4-ad8a-26ad2ce51acf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:20.770672 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd068ed7-414d-4a3a-b7aa-e733956198f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:20.771351 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd068ed7-414d-4a3a-b7aa-e733956198f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:20.771673 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd068ed7-414d-4a3a-b7aa-e733956198f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:20.771956 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd068ed7-414d-4a3a-b7aa-e733956198f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:20.772737 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd068ed7-414d-4a3a-b7aa-e733956198f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:20.774607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd068ed7-414d-4a3a-b7aa-e733956198f6 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:20.820147 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d227f-9e86-4fd4-ad8a-26ad2ce51acf admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:20.823969 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd4fc83-592d-4140-ab4c-345ee0845034 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:20.824658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4fc83-592d-4140-ab4c-345ee0845034 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:20.824940 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4fc83-592d-4140-ab4c-345ee0845034 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:20.825216 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4fc83-592d-4140-ab4c-345ee0845034 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:20.827001 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3fd4fc83-592d-4140-ab4c-345ee0845034 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:20.875358 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1092/2207] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:35:20 2022] POST /identity/v3/users => generated 292 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:35:20.876721 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd068ed7-414d-4a3a-b7aa-e733956198f6 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:20.887079 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd068ed7-414d-4a3a-b7aa-e733956198f6 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:20.887606 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd4fc83-592d-4140-ab4c-345ee0845034 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:20.889144 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd4fc83-592d-4140-ab4c-345ee0845034 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:20.891986 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113781ab-14b1-4377-861a-01b978e1794f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:20.900271 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113781ab-14b1-4377-861a-01b978e1794f admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:20.900570 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113781ab-14b1-4377-861a-01b978e1794f admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:20.900855 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113781ab-14b1-4377-861a-01b978e1794f admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:20.902121 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113781ab-14b1-4377-861a-01b978e1794f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:20.902447 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1116/2208] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:35:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:35:20.903906 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113781ab-14b1-4377-861a-01b978e1794f admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:20.918967 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1093/2209] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 19:35:20.919931 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd4fc83-592d-4140-ab4c-345ee0845034 service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:20.930905 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd4fc83-592d-4140-ab4c-345ee0845034 service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:20.936041 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5c0bd-e411-4285-8109-c3bdb0d2e5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:20.936708 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5c0bd-e411-4285-8109-c3bdb0d2e5dd admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:20.936992 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5c0bd-e411-4285-8109-c3bdb0d2e5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:20.937272 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5c0bd-e411-4285-8109-c3bdb0d2e5dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:20.938004 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b5c0bd-e411-4285-8109-c3bdb0d2e5dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:20.940706 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b5c0bd-e411-4285-8109-c3bdb0d2e5dd admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:20.954158 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1117/2210] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:35:20.956492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113781ab-14b1-4377-861a-01b978e1794f admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:20.967465 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113781ab-14b1-4377-861a-01b978e1794f admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:20.973780 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbddfb9c-bc64-4b06-80bb-fa581c786909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:20.974687 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddfb9c-bc64-4b06-80bb-fa581c786909 admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:20.974961 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddfb9c-bc64-4b06-80bb-fa581c786909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:20.975240 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddfb9c-bc64-4b06-80bb-fa581c786909 admin admin] PATH_INFO: `/v3/projects/14910a85e07841658d4b48a0a1639cba/users/ca8f862ad8d94cb9a4de44e410ac1589/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:20.991326 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbddfb9c-bc64-4b06-80bb-fa581c786909 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14910a85e07841658d4b48a0a1639cba, user_id=ca8f862ad8d94cb9a4de44e410ac1589, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:20.993972 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbddfb9c-bc64-4b06-80bb-fa581c786909 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:21.090274 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1094/2211] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:35:20 2022] PUT /identity/v3/projects/14910a85e07841658d4b48a0a1639cba/users/ca8f862ad8d94cb9a4de44e410ac1589/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:21.103241 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a048ad-cb01-4ff0-8bb4-481ba3b84d24 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:21.103907 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a048ad-cb01-4ff0-8bb4-481ba3b84d24 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:21.104202 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a048ad-cb01-4ff0-8bb4-481ba3b84d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:21.131133 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-00a048ad-cb01-4ff0-8bb4-481ba3b84d24 None None] MFA Rules not processed for user `ca8f862ad8d94cb9a4de44e410ac1589`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:21.132371 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-00a048ad-cb01-4ff0-8bb4-481ba3b84d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:21.197213 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1118/2212] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:35:21.201740 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbddfb9c-bc64-4b06-80bb-fa581c786909 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:21.263549 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbddfb9c-bc64-4b06-80bb-fa581c786909 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:21.268444 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f05db4-1cd4-4bff-b569-08fcc51845bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:21.269104 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f05db4-1cd4-4bff-b569-08fcc51845bd admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:21.269399 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f05db4-1cd4-4bff-b569-08fcc51845bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:21.269682 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f05db4-1cd4-4bff-b569-08fcc51845bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:21.270443 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f05db4-1cd4-4bff-b569-08fcc51845bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:21.280078 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f05db4-1cd4-4bff-b569-08fcc51845bd admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:21.367272 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1095/2213] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:35:21 2022] POST /identity/v3/projects => generated 385 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:35:21.371397 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a048ad-cb01-4ff0-8bb4-481ba3b84d24 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:21.382345 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a048ad-cb01-4ff0-8bb4-481ba3b84d24 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:21.444802 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70fac9-73d6-4fa8-85f1-64e5593c39b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:21.445667 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70fac9-73d6-4fa8-85f1-64e5593c39b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:21.445813 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70fac9-73d6-4fa8-85f1-64e5593c39b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:21.446057 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70fac9-73d6-4fa8-85f1-64e5593c39b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:21.446755 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa70fac9-73d6-4fa8-85f1-64e5593c39b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:21.452392 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa70fac9-73d6-4fa8-85f1-64e5593c39b2 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:21.562439 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1119/2214] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:35:21 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 19:35:21.566525 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f05db4-1cd4-4bff-b569-08fcc51845bd admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:21.577883 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f05db4-1cd4-4bff-b569-08fcc51845bd admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:21.583332 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b92efb-7634-4438-97a5-9cce23c60f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:21.584359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b92efb-7634-4438-97a5-9cce23c60f2a admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:21.584809 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b92efb-7634-4438-97a5-9cce23c60f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:21.585245 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b92efb-7634-4438-97a5-9cce23c60f2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:21.586486 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b92efb-7634-4438-97a5-9cce23c60f2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:21.590279 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b92efb-7634-4438-97a5-9cce23c60f2a admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:21.601539 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1096/2215] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:35:21.606118 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70fac9-73d6-4fa8-85f1-64e5593c39b2 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:21.616651 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70fac9-73d6-4fa8-85f1-64e5593c39b2 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:21.621640 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc9344-003e-4ff6-9f22-c545b4e75f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:21.622312 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc9344-003e-4ff6-9f22-c545b4e75f91 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:21.622603 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc9344-003e-4ff6-9f22-c545b4e75f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:21.622885 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc9344-003e-4ff6-9f22-c545b4e75f91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:21.623657 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc9344-003e-4ff6-9f22-c545b4e75f91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:21.625252 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc9344-003e-4ff6-9f22-c545b4e75f91 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:21.636476 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1120/2216] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:35:21.640900 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b92efb-7634-4438-97a5-9cce23c60f2a admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:21.652242 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b92efb-7634-4438-97a5-9cce23c60f2a admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:21.657210 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c9e97-a540-4e34-a421-fd48133205d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:21.658263 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c9e97-a540-4e34-a421-fd48133205d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:21.658550 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c9e97-a540-4e34-a421-fd48133205d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:21.658829 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c9e97-a540-4e34-a421-fd48133205d3 admin admin] PATH_INFO: `/v3/projects/51c77c5d190f4f8fbf72fc22c7cbb088/users/c57d44bdde3f45b2ad14839e75926bf3/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:21.675863 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c9e97-a540-4e34-a421-fd48133205d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51c77c5d190f4f8fbf72fc22c7cbb088, user_id=c57d44bdde3f45b2ad14839e75926bf3, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:21.678736 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c9e97-a540-4e34-a421-fd48133205d3 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:21.818280 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:21.847952 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1097/2217] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:35:21 2022] PUT /identity/v3/projects/51c77c5d190f4f8fbf72fc22c7cbb088/users/c57d44bdde3f45b2ad14839e75926bf3/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:21.858444 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39bb474-a28a-42f4-ac9c-411a8d8600d2 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:21.858737 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39bb474-a28a-42f4-ac9c-411a8d8600d2 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:21.859003 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39bb474-a28a-42f4-ac9c-411a8d8600d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:21.888119 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-e39bb474-a28a-42f4-ac9c-411a8d8600d2 None None] MFA Rules not processed for user `c57d44bdde3f45b2ad14839e75926bf3`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:21.889340 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-e39bb474-a28a-42f4-ac9c-411a8d8600d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:21.960658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1121/2218] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:35:21.965159 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c9e97-a540-4e34-a421-fd48133205d3 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:22.029917 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c9e97-a540-4e34-a421-fd48133205d3 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:22.034594 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd49a404-0d48-499a-bd0a-56d3f1c49659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:22.035303 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49a404-0d48-499a-bd0a-56d3f1c49659 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:22.035649 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49a404-0d48-499a-bd0a-56d3f1c49659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:22.035941 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49a404-0d48-499a-bd0a-56d3f1c49659 admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:22.036629 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd49a404-0d48-499a-bd0a-56d3f1c49659 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:22.038531 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd49a404-0d48-499a-bd0a-56d3f1c49659 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:22.164315 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1098/2219] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:35:21 2022] POST /identity/v3/projects => generated 385 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 19:35:22.169035 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39bb474-a28a-42f4-ac9c-411a8d8600d2 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:22.179862 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39bb474-a28a-42f4-ac9c-411a8d8600d2 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:22.238809 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb734b-467b-47a0-bc84-bd41bd3c486a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:22.239405 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb734b-467b-47a0-bc84-bd41bd3c486a admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:22.239717 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb734b-467b-47a0-bc84-bd41bd3c486a admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:22.239991 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb734b-467b-47a0-bc84-bd41bd3c486a admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:22.240709 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb734b-467b-47a0-bc84-bd41bd3c486a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:22.242659 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb734b-467b-47a0-bc84-bd41bd3c486a admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:22.354819 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1122/2220] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:35:22 2022] POST /identity/v3/users => generated 299 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:35:22.358910 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd49a404-0d48-499a-bd0a-56d3f1c49659 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:22.368983 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd49a404-0d48-499a-bd0a-56d3f1c49659 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:22.374205 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062d83e-d1f1-44d9-8743-d1047df2deac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:22.374873 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062d83e-d1f1-44d9-8743-d1047df2deac admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:22.375141 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062d83e-d1f1-44d9-8743-d1047df2deac admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:22.375419 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062d83e-d1f1-44d9-8743-d1047df2deac admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:22.376167 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d062d83e-d1f1-44d9-8743-d1047df2deac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:22.377746 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d062d83e-d1f1-44d9-8743-d1047df2deac admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:22.388379 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1099/2221] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:35:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 19:35:22.392663 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb734b-467b-47a0-bc84-bd41bd3c486a admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:22.403602 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb734b-467b-47a0-bc84-bd41bd3c486a admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:22.408207 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81bf14f-1911-484e-9037-8ffd64eae7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:22.409085 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81bf14f-1911-484e-9037-8ffd64eae7b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:22.409398 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81bf14f-1911-484e-9037-8ffd64eae7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:22.409678 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81bf14f-1911-484e-9037-8ffd64eae7b5 admin admin] PATH_INFO: `/v3/projects/99c68b2a6ee24cc899eff8696ee63519/users/542c610cf67b48bea0aa576345699403/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:22.431702 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81bf14f-1911-484e-9037-8ffd64eae7b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99c68b2a6ee24cc899eff8696ee63519, user_id=542c610cf67b48bea0aa576345699403, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:22.434671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81bf14f-1911-484e-9037-8ffd64eae7b5 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:22.551165 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1123/2222] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:35:22 2022] PUT /identity/v3/projects/99c68b2a6ee24cc899eff8696ee63519/users/542c610cf67b48bea0aa576345699403/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:35:22.555052 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062d83e-d1f1-44d9-8743-d1047df2deac admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:22.566011 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062d83e-d1f1-44d9-8743-d1047df2deac admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:22.630047 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866693f3-c778-4e65-a93f-28219fd82093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:22.636266 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866693f3-c778-4e65-a93f-28219fd82093 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:22.636266 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866693f3-c778-4e65-a93f-28219fd82093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:22.636266 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866693f3-c778-4e65-a93f-28219fd82093 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:22.636266 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866693f3-c778-4e65-a93f-28219fd82093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:22.636266 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866693f3-c778-4e65-a93f-28219fd82093 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:22.644196 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1100/2223] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:35:22 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:35:22.648304 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81bf14f-1911-484e-9037-8ffd64eae7b5 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:22.659649 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81bf14f-1911-484e-9037-8ffd64eae7b5 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:22.664402 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cec229-2a78-4245-bb15-52638824229d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:22.665310 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cec229-2a78-4245-bb15-52638824229d admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:22.665607 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cec229-2a78-4245-bb15-52638824229d admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:22.665890 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cec229-2a78-4245-bb15-52638824229d admin admin] PATH_INFO: `/v3/projects/99c68b2a6ee24cc899eff8696ee63519/users/542c610cf67b48bea0aa576345699403/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:22.669165 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cec229-2a78-4245-bb15-52638824229d admin admin] RBAC: Authorizing `identity:create_grant(project_id=99c68b2a6ee24cc899eff8696ee63519, user_id=542c610cf67b48bea0aa576345699403, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:22.671950 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cec229-2a78-4245-bb15-52638824229d admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:22.684701 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1124/2224] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:35:22 2022] PUT /identity/v3/projects/99c68b2a6ee24cc899eff8696ee63519/users/542c610cf67b48bea0aa576345699403/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:22.696178 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe19485-6d7e-4976-b11a-43311e735c83 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:22.696474 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe19485-6d7e-4976-b11a-43311e735c83 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:22.696755 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe19485-6d7e-4976-b11a-43311e735c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:22.723548 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-bbe19485-6d7e-4976-b11a-43311e735c83 None None] MFA Rules not processed for user `542c610cf67b48bea0aa576345699403`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:22.724777 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-bbe19485-6d7e-4976-b11a-43311e735c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:22.800335 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1101/2225] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:22 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:35:22.811603 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cec229-2a78-4245-bb15-52638824229d admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:22.868583 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cec229-2a78-4245-bb15-52638824229d admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:22.872539 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4f44a-9d89-4807-910e-6abf04ac9c1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:22.873179 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4f44a-9d89-4807-910e-6abf04ac9c1d service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:22.873466 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4f44a-9d89-4807-910e-6abf04ac9c1d service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:22.873748 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4f44a-9d89-4807-910e-6abf04ac9c1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:22.908946 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:22.931313 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b4f44a-9d89-4807-910e-6abf04ac9c1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:22.932871 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b4f44a-9d89-4807-910e-6abf04ac9c1d service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:22.942402 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1125/2226] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:35:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:35:23.037648 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:23.792390 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:24.411273 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:25.106253 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:25.214529 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe19485-6d7e-4976-b11a-43311e735c83 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:25.216411 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-bbe19485-6d7e-4976-b11a-43311e735c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:25.229549 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe19485-6d7e-4976-b11a-43311e735c83 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:25.234005 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e0b1a-bb78-4ce6-9f48-341978c5ce1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:25.234682 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e0b1a-bb78-4ce6-9f48-341978c5ce1d service cinder] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:25.234962 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e0b1a-bb78-4ce6-9f48-341978c5ce1d service cinder] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:25.235368 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e0b1a-bb78-4ce6-9f48-341978c5ce1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:25.296839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e0b1a-bb78-4ce6-9f48-341978c5ce1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:25.298408 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e0b1a-bb78-4ce6-9f48-341978c5ce1d service cinder] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:25.308088 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1102/2227] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:35:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:35:25.656056 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4f44a-9d89-4807-910e-6abf04ac9c1d service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:25.658817 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-18b4f44a-9d89-4807-910e-6abf04ac9c1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:25.727150 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4f44a-9d89-4807-910e-6abf04ac9c1d service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:25.731670 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a1596-c6e1-464e-b26c-2342b767eb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:25.732536 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a1596-c6e1-464e-b26c-2342b767eb43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:25.732938 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a1596-c6e1-464e-b26c-2342b767eb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:25.733215 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a1596-c6e1-464e-b26c-2342b767eb43 admin admin] PATH_INFO: `/v3/users/6b8326fa655a490f99241739bc985c54` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:25.734392 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a1596-c6e1-464e-b26c-2342b767eb43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b8326fa655a490f99241739bc985c54)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:25.736339 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a1596-c6e1-464e-b26c-2342b767eb43 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:25.993380 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-839a1596-c6e1-464e-b26c-2342b767eb43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b8326fa655a490f99241739bc985c54'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:26.107982 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-839a1596-c6e1-464e-b26c-2342b767eb43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b8326fa655a490f99241739bc985c54'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:26.108753 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-839a1596-c6e1-464e-b26c-2342b767eb43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b8326fa655a490f99241739bc985c54'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:26.116339 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-839a1596-c6e1-464e-b26c-2342b767eb43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b8326fa655a490f99241739bc985c54'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:26.129176 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-839a1596-c6e1-464e-b26c-2342b767eb43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b8326fa655a490f99241739bc985c54'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:26.135573 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1126/2228] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:35:25 2022] DELETE /identity/v3/users/6b8326fa655a490f99241739bc985c54 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:35:26.140796 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:DELETE=9,keystone:SELECT=86,keystone:INSERT=5 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:26.141059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235069bd-fb29-421c-8c8b-c04d894a40fc None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:26.145415 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235069bd-fb29-421c-8c8b-c04d894a40fc None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:26.145415 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235069bd-fb29-421c-8c8b-c04d894a40fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:26.158769 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-235069bd-fb29-421c-8c8b-c04d894a40fc None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:26.159996 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-235069bd-fb29-421c-8c8b-c04d894a40fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:26.223555 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1103/2229] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:35:26.233973 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a1596-c6e1-464e-b26c-2342b767eb43 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:26.235465 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-839a1596-c6e1-464e-b26c-2342b767eb43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:26.292941 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a1596-c6e1-464e-b26c-2342b767eb43 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:26.296667 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f3c84-8d25-4bfb-93f7-b8b230820429 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:26.297323 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f3c84-8d25-4bfb-93f7-b8b230820429 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:26.297612 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f3c84-8d25-4bfb-93f7-b8b230820429 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:26.297895 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f3c84-8d25-4bfb-93f7-b8b230820429 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:26.306880 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f3c84-8d25-4bfb-93f7-b8b230820429 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:26.318635 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f3c84-8d25-4bfb-93f7-b8b230820429 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:26.319066 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1127/2230] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:35:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:35:26.494867 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:26.758238 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235069bd-fb29-421c-8c8b-c04d894a40fc None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:26.759854 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-235069bd-fb29-421c-8c8b-c04d894a40fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:26.785497 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235069bd-fb29-421c-8c8b-c04d894a40fc None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:26.792396 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f68ab-be87-4bcb-b6ee-01a641d28af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:26.793465 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f68ab-be87-4bcb-b6ee-01a641d28af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:26.793803 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f68ab-be87-4bcb-b6ee-01a641d28af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:26.794036 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f68ab-be87-4bcb-b6ee-01a641d28af8 admin admin] PATH_INFO: `/v3/projects/4fe00d6408bd4d2283e05bb77043d2a8` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:26.796419 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5f68ab-be87-4bcb-b6ee-01a641d28af8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fe00d6408bd4d2283e05bb77043d2a8)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:26.798707 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5f68ab-be87-4bcb-b6ee-01a641d28af8 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:26.922081 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-dd5f68ab-be87-4bcb-b6ee-01a641d28af8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fe00d6408bd4d2283e05bb77043d2a8', 'request_id': 'req-dd5f68ab-be87-4bcb-b6ee-01a641d28af8'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:27.004883 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f3c84-8d25-4bfb-93f7-b8b230820429 service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:27.006321 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-e73f3c84-8d25-4bfb-93f7-b8b230820429 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:27.020038 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-dd5f68ab-be87-4bcb-b6ee-01a641d28af8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fe00d6408bd4d2283e05bb77043d2a8', 'request_id': 'req-dd5f68ab-be87-4bcb-b6ee-01a641d28af8'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:27.027142 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-dd5f68ab-be87-4bcb-b6ee-01a641d28af8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fe00d6408bd4d2283e05bb77043d2a8', 'request_id': 'req-dd5f68ab-be87-4bcb-b6ee-01a641d28af8'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:27.039952 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-dd5f68ab-be87-4bcb-b6ee-01a641d28af8 admin admin] The token cache is being invalidate because project 4fe00d6408bd4d2283e05bb77043d2a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:35:27.040320 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-dd5f68ab-be87-4bcb-b6ee-01a641d28af8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:27.041033 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-dd5f68ab-be87-4bcb-b6ee-01a641d28af8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:27.042649 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1104/2231] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:35:26 2022] DELETE /identity/v3/projects/4fe00d6408bd4d2283e05bb77043d2a8 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:27.049730 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b085a5e-104a-42b3-9665-d34b534072e9 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:27.050023 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b085a5e-104a-42b3-9665-d34b534072e9 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:27.050305 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b085a5e-104a-42b3-9665-d34b534072e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:27.068367 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f3c84-8d25-4bfb-93f7-b8b230820429 service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:27.069800 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-2b085a5e-104a-42b3-9665-d34b534072e9 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:27.071020 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-2b085a5e-104a-42b3-9665-d34b534072e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:27.121321 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb96c70-ff1c-40a5-bacd-35a44e85a6ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:27.121975 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb96c70-ff1c-40a5-bacd-35a44e85a6ca service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:27.122290 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb96c70-ff1c-40a5-bacd-35a44e85a6ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:27.122569 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb96c70-ff1c-40a5-bacd-35a44e85a6ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:27.124644 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-1bb96c70-ff1c-40a5-bacd-35a44e85a6ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:27.132115 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1105/2232] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:35:27.145917 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271d860-6533-48ef-bc27-b15abeb949ad None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:27.146505 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271d860-6533-48ef-bc27-b15abeb949ad None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:27.146505 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271d860-6533-48ef-bc27-b15abeb949ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:27.170017 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-f271d860-6533-48ef-bc27-b15abeb949ad None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:27.171354 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-f271d860-6533-48ef-bc27-b15abeb949ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:27.182649 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1106/2233] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:35:27.186894 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271d860-6533-48ef-bc27-b15abeb949ad None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:27.199195 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb96c70-ff1c-40a5-bacd-35a44e85a6ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:27.199303 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271d860-6533-48ef-bc27-b15abeb949ad None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:27.199397 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb96c70-ff1c-40a5-bacd-35a44e85a6ca service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:27.202106 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97022d-0aa5-4a3c-aeba-9f42af8ab25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:27.202837 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97022d-0aa5-4a3c-aeba-9f42af8ab25e admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:27.203153 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97022d-0aa5-4a3c-aeba-9f42af8ab25e admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:27.203428 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97022d-0aa5-4a3c-aeba-9f42af8ab25e admin admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:27.204204 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d97022d-0aa5-4a3c-aeba-9f42af8ab25e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:35:27.204492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d97022d-0aa5-4a3c-aeba-9f42af8ab25e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:27.206074 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d97022d-0aa5-4a3c-aeba-9f42af8ab25e admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:27.208091 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1128/2234] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:35:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:35:27.223046 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1107/2235] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:35:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:35:27.228570 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:27.228790 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb96c70-ff1c-40a5-bacd-35a44e85a6ca service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:27.235805 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb96c70-ff1c-40a5-bacd-35a44e85a6ca service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:27.240488 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805bb5c-a7ae-45a8-8a12-072ac7d11197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:27.241153 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805bb5c-a7ae-45a8-8a12-072ac7d11197 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:27.241441 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805bb5c-a7ae-45a8-8a12-072ac7d11197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:27.241746 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805bb5c-a7ae-45a8-8a12-072ac7d11197 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:27.242915 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7805bb5c-a7ae-45a8-8a12-072ac7d11197 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:27.244389 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7805bb5c-a7ae-45a8-8a12-072ac7d11197 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:27.252280 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:27.268465 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97022d-0aa5-4a3c-aeba-9f42af8ab25e admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:27.268465 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-2d97022d-0aa5-4a3c-aeba-9f42af8ab25e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:27.279249 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97022d-0aa5-4a3c-aeba-9f42af8ab25e admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:27.283256 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2480f-a202-4f3c-9448-e560a95eb36b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:27.283966 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2480f-a202-4f3c-9448-e560a95eb36b service cinder] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:27.284251 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2480f-a202-4f3c-9448-e560a95eb36b service cinder] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:27.284527 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2480f-a202-4f3c-9448-e560a95eb36b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:27.286312 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-d8a2480f-a202-4f3c-9448-e560a95eb36b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:27.350718 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a2480f-a202-4f3c-9448-e560a95eb36b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:27.352245 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a2480f-a202-4f3c-9448-e560a95eb36b service cinder] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:27.355688 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1129/2236] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:35:27 2022] POST /identity/v3/projects => generated 375 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:35:27.360107 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805bb5c-a7ae-45a8-8a12-072ac7d11197 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:27.363859 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1108/2237] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:35:27 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 19:35:27.423748 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805bb5c-a7ae-45a8-8a12-072ac7d11197 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:27.432148 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47093a2-4be8-48f6-9ec5-0675658bac0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:27.432849 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47093a2-4be8-48f6-9ec5-0675658bac0c admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:27.433132 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47093a2-4be8-48f6-9ec5-0675658bac0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:27.433407 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47093a2-4be8-48f6-9ec5-0675658bac0c admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:27.434089 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47093a2-4be8-48f6-9ec5-0675658bac0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:27.436261 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47093a2-4be8-48f6-9ec5-0675658bac0c admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:27.556972 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1130/2238] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:35:27 2022] POST /identity/v3/users => generated 288 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 19:35:27.561348 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2480f-a202-4f3c-9448-e560a95eb36b service cinder] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:27.572023 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2480f-a202-4f3c-9448-e560a95eb36b service cinder] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:27.577306 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def6dd3a-e1f4-4cd0-a456-9f599bfea806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:27.577966 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6dd3a-e1f4-4cd0-a456-9f599bfea806 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:27.578251 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6dd3a-e1f4-4cd0-a456-9f599bfea806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:27.578532 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6dd3a-e1f4-4cd0-a456-9f599bfea806 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:27.579286 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def6dd3a-e1f4-4cd0-a456-9f599bfea806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:27.581002 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def6dd3a-e1f4-4cd0-a456-9f599bfea806 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:27.590916 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1109/2239] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 19:35:27.595592 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47093a2-4be8-48f6-9ec5-0675658bac0c admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:27.613603 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47093a2-4be8-48f6-9ec5-0675658bac0c admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:27.618834 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8942200-4233-428d-9e1a-1519b46e7013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:27.619750 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8942200-4233-428d-9e1a-1519b46e7013 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:27.620166 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8942200-4233-428d-9e1a-1519b46e7013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:27.620508 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8942200-4233-428d-9e1a-1519b46e7013 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:27.624814 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8942200-4233-428d-9e1a-1519b46e7013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:27.624814 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8942200-4233-428d-9e1a-1519b46e7013 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:27.637220 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1131/2240] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 19:35:27.641629 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def6dd3a-e1f4-4cd0-a456-9f599bfea806 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:27.651858 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def6dd3a-e1f4-4cd0-a456-9f599bfea806 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:27.657355 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e18e3d-4b31-4011-8759-4760ec1d0dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:27.658801 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e18e3d-4b31-4011-8759-4760ec1d0dc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:27.659189 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e18e3d-4b31-4011-8759-4760ec1d0dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:27.660148 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e18e3d-4b31-4011-8759-4760ec1d0dc3 admin admin] PATH_INFO: `/v3/projects/59d8e77fd87341048bfcc88cd2094661/users/3bbc3fa8a50e45479a5af903fd1382d5/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:27.676240 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e18e3d-4b31-4011-8759-4760ec1d0dc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59d8e77fd87341048bfcc88cd2094661, user_id=3bbc3fa8a50e45479a5af903fd1382d5, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:27.679616 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e18e3d-4b31-4011-8759-4760ec1d0dc3 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:27.767466 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1110/2241] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:35:27 2022] PUT /identity/v3/projects/59d8e77fd87341048bfcc88cd2094661/users/3bbc3fa8a50e45479a5af903fd1382d5/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:35:27.777911 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ecb8d-5cb2-40da-9d3a-7f749af441a7 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:27.778225 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ecb8d-5cb2-40da-9d3a-7f749af441a7 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:27.778485 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ecb8d-5cb2-40da-9d3a-7f749af441a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:27.812493 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-dc3ecb8d-5cb2-40da-9d3a-7f749af441a7 None None] MFA Rules not processed for user `3bbc3fa8a50e45479a5af903fd1382d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:27.813710 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-dc3ecb8d-5cb2-40da-9d3a-7f749af441a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:27.883391 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1132/2242] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:35:27.894900 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e18e3d-4b31-4011-8759-4760ec1d0dc3 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:27.948670 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e18e3d-4b31-4011-8759-4760ec1d0dc3 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:27.952729 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55649242-7f26-4187-9947-27810f11357f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:27.953354 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55649242-7f26-4187-9947-27810f11357f service cinder] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:27.953687 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55649242-7f26-4187-9947-27810f11357f service cinder] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:27.953969 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55649242-7f26-4187-9947-27810f11357f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:27.962344 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55649242-7f26-4187-9947-27810f11357f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:27.963802 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55649242-7f26-4187-9947-27810f11357f service cinder] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:27.972576 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1111/2243] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:35:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:35:28.427810 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:28.500603 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:29.166907 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ecb8d-5cb2-40da-9d3a-7f749af441a7 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:29.168421 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-dc3ecb8d-5cb2-40da-9d3a-7f749af441a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:29.245729 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ecb8d-5cb2-40da-9d3a-7f749af441a7 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:29.248868 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3397d-7a1d-4155-84b9-e38580a0c2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:29.250254 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3397d-7a1d-4155-84b9-e38580a0c2de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:29.250611 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3397d-7a1d-4155-84b9-e38580a0c2de admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:29.250958 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3397d-7a1d-4155-84b9-e38580a0c2de admin admin] PATH_INFO: `/v3/users/9ad072f4c2ed41ac8ffafd8fc2034b39` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:29.252830 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3397d-7a1d-4155-84b9-e38580a0c2de admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ad072f4c2ed41ac8ffafd8fc2034b39)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:29.254994 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3397d-7a1d-4155-84b9-e38580a0c2de admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:29.429310 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ddb3397d-7a1d-4155-84b9-e38580a0c2de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ad072f4c2ed41ac8ffafd8fc2034b39'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:29.497054 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:29.522368 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ddb3397d-7a1d-4155-84b9-e38580a0c2de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ad072f4c2ed41ac8ffafd8fc2034b39'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:29.523138 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ddb3397d-7a1d-4155-84b9-e38580a0c2de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ad072f4c2ed41ac8ffafd8fc2034b39'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:29.531348 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ddb3397d-7a1d-4155-84b9-e38580a0c2de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ad072f4c2ed41ac8ffafd8fc2034b39'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:29.543284 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ddb3397d-7a1d-4155-84b9-e38580a0c2de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ad072f4c2ed41ac8ffafd8fc2034b39'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:29.550066 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1133/2244] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:35:29 2022] DELETE /identity/v3/users/9ad072f4c2ed41ac8ffafd8fc2034b39 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:29.775776 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55649242-7f26-4187-9947-27810f11357f service cinder] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:29.785736 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:29.791924 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55649242-7f26-4187-9947-27810f11357f service cinder] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:29.851153 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae8066-ba92-4ee9-939b-717e91f3dadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:29.852066 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae8066-ba92-4ee9-939b-717e91f3dadd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:29.852354 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae8066-ba92-4ee9-939b-717e91f3dadd admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:29.852634 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae8066-ba92-4ee9-939b-717e91f3dadd admin admin] PATH_INFO: `/v3/projects/91c83794dce84876b1f56fbd8719f43c` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:29.853827 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae8066-ba92-4ee9-939b-717e91f3dadd admin admin] RBAC: Authorizing `identity:delete_project(project_id=91c83794dce84876b1f56fbd8719f43c)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:29.855865 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae8066-ba92-4ee9-939b-717e91f3dadd admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:29.957619 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-87ae8066-ba92-4ee9-939b-717e91f3dadd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91c83794dce84876b1f56fbd8719f43c', 'request_id': 'req-87ae8066-ba92-4ee9-939b-717e91f3dadd'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:30.025297 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-87ae8066-ba92-4ee9-939b-717e91f3dadd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91c83794dce84876b1f56fbd8719f43c', 'request_id': 'req-87ae8066-ba92-4ee9-939b-717e91f3dadd'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:30.032062 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-87ae8066-ba92-4ee9-939b-717e91f3dadd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91c83794dce84876b1f56fbd8719f43c', 'request_id': 'req-87ae8066-ba92-4ee9-939b-717e91f3dadd'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:30.044237 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-87ae8066-ba92-4ee9-939b-717e91f3dadd admin admin] The token cache is being invalidate because project 91c83794dce84876b1f56fbd8719f43c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:35:30.046850 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-87ae8066-ba92-4ee9-939b-717e91f3dadd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:30.046850 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-87ae8066-ba92-4ee9-939b-717e91f3dadd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:30.047523 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1112/2245] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:35:29 2022] DELETE /identity/v3/projects/91c83794dce84876b1f56fbd8719f43c => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:30.051669 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3397d-7a1d-4155-84b9-e38580a0c2de admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:30.053263 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ddb3397d-7a1d-4155-84b9-e38580a0c2de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:30.067750 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3397d-7a1d-4155-84b9-e38580a0c2de admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:30.126313 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bac7cd-1589-431b-a5f5-fc9bdcd5ec6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:30.127193 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bac7cd-1589-431b-a5f5-fc9bdcd5ec6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:30.127886 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bac7cd-1589-431b-a5f5-fc9bdcd5ec6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:30.127886 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bac7cd-1589-431b-a5f5-fc9bdcd5ec6a admin admin] PATH_INFO: `/v3/users/1768cc77c26840dbafd527d47d2bdebf` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:30.129147 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bac7cd-1589-431b-a5f5-fc9bdcd5ec6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1768cc77c26840dbafd527d47d2bdebf)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:30.131063 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bac7cd-1589-431b-a5f5-fc9bdcd5ec6a admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:30.364221 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-49bac7cd-1589-431b-a5f5-fc9bdcd5ec6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1768cc77c26840dbafd527d47d2bdebf'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:30.428799 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-49bac7cd-1589-431b-a5f5-fc9bdcd5ec6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1768cc77c26840dbafd527d47d2bdebf'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:30.430015 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-49bac7cd-1589-431b-a5f5-fc9bdcd5ec6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1768cc77c26840dbafd527d47d2bdebf'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:30.438339 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-49bac7cd-1589-431b-a5f5-fc9bdcd5ec6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1768cc77c26840dbafd527d47d2bdebf'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:30.450799 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-49bac7cd-1589-431b-a5f5-fc9bdcd5ec6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1768cc77c26840dbafd527d47d2bdebf'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:30.457678 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1134/2246] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:35:30 2022] DELETE /identity/v3/users/1768cc77c26840dbafd527d47d2bdebf => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:30.571655 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:30.617278 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:30.721733 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae8066-ba92-4ee9-939b-717e91f3dadd admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:30.723152 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-87ae8066-ba92-4ee9-939b-717e91f3dadd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:30.738225 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae8066-ba92-4ee9-939b-717e91f3dadd admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:30.795079 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea12b6-30c5-4c58-b8bd-49678dea95ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:30.796600 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea12b6-30c5-4c58-b8bd-49678dea95ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:30.796891 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea12b6-30c5-4c58-b8bd-49678dea95ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:30.797179 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea12b6-30c5-4c58-b8bd-49678dea95ea admin admin] PATH_INFO: `/v3/projects/288b678a02c64942be83319f5f9946d0` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:30.798396 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ea12b6-30c5-4c58-b8bd-49678dea95ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=288b678a02c64942be83319f5f9946d0)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:30.800348 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ea12b6-30c5-4c58-b8bd-49678dea95ea admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:31.000887 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-39ea12b6-30c5-4c58-b8bd-49678dea95ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '288b678a02c64942be83319f5f9946d0', 'request_id': 'req-39ea12b6-30c5-4c58-b8bd-49678dea95ea'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:31.071135 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-39ea12b6-30c5-4c58-b8bd-49678dea95ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '288b678a02c64942be83319f5f9946d0', 'request_id': 'req-39ea12b6-30c5-4c58-b8bd-49678dea95ea'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:31.078404 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-39ea12b6-30c5-4c58-b8bd-49678dea95ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '288b678a02c64942be83319f5f9946d0', 'request_id': 'req-39ea12b6-30c5-4c58-b8bd-49678dea95ea'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:31.090230 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-39ea12b6-30c5-4c58-b8bd-49678dea95ea admin admin] The token cache is being invalidate because project 288b678a02c64942be83319f5f9946d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:35:31.090520 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-39ea12b6-30c5-4c58-b8bd-49678dea95ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:31.091178 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-39ea12b6-30c5-4c58-b8bd-49678dea95ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:31.093549 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1113/2247] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:35:30 2022] DELETE /identity/v3/projects/288b678a02c64942be83319f5f9946d0 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:31.098354 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41384e8-2bb1-497a-b9d6-269c759b0bdc None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:31.098613 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41384e8-2bb1-497a-b9d6-269c759b0bdc None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:31.098893 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41384e8-2bb1-497a-b9d6-269c759b0bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:31.118118 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-a41384e8-2bb1-497a-b9d6-269c759b0bdc None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:31.119676 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-a41384e8-2bb1-497a-b9d6-269c759b0bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:31.184955 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1135/2248] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:35:31.193087 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7887dd8-1959-491e-94b0-504fca7e0f90 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:31.193543 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7887dd8-1959-491e-94b0-504fca7e0f90 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:31.193885 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7887dd8-1959-491e-94b0-504fca7e0f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:31.214047 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-d7887dd8-1959-491e-94b0-504fca7e0f90 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:31.215301 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-d7887dd8-1959-491e-94b0-504fca7e0f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:31.223967 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1114/2249] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:35:31.228270 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41384e8-2bb1-497a-b9d6-269c759b0bdc None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:31.238977 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41384e8-2bb1-497a-b9d6-269c759b0bdc None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:31.243648 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1071f5-ebf6-4c6b-b2cc-2d104f1ea6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:31.244302 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1071f5-ebf6-4c6b-b2cc-2d104f1ea6cf admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:31.244588 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1071f5-ebf6-4c6b-b2cc-2d104f1ea6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:31.244868 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1071f5-ebf6-4c6b-b2cc-2d104f1ea6cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:31.245609 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1071f5-ebf6-4c6b-b2cc-2d104f1ea6cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:35:31.245918 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1071f5-ebf6-4c6b-b2cc-2d104f1ea6cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:31.247546 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1071f5-ebf6-4c6b-b2cc-2d104f1ea6cf admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:31.260008 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1136/2250] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:35:31.264709 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7887dd8-1959-491e-94b0-504fca7e0f90 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:31.275311 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7887dd8-1959-491e-94b0-504fca7e0f90 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:31.284174 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b91226-a640-4d06-bba2-9002081c40a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:31.284916 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b91226-a640-4d06-bba2-9002081c40a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:31.285202 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b91226-a640-4d06-bba2-9002081c40a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:31.285500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b91226-a640-4d06-bba2-9002081c40a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:31.286195 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b91226-a640-4d06-bba2-9002081c40a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:31.288185 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b91226-a640-4d06-bba2-9002081c40a8 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:31.358775 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:31.366452 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1115/2251] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:35:31 2022] POST /identity/v3/projects => generated 399 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:35:31.370457 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1071f5-ebf6-4c6b-b2cc-2d104f1ea6cf admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:31.380893 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1071f5-ebf6-4c6b-b2cc-2d104f1ea6cf admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:31.438528 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:31.439427 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d59d22-74e3-4147-9255-88d76c6f4375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:31.440432 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d59d22-74e3-4147-9255-88d76c6f4375 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:31.440724 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d59d22-74e3-4147-9255-88d76c6f4375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:31.441009 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d59d22-74e3-4147-9255-88d76c6f4375 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:31.441735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d59d22-74e3-4147-9255-88d76c6f4375 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:31.443722 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d59d22-74e3-4147-9255-88d76c6f4375 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:31.527218 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1137/2252] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:35:31 2022] POST /identity/v3/users => generated 300 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:35:31.528680 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b91226-a640-4d06-bba2-9002081c40a8 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:31.539946 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b91226-a640-4d06-bba2-9002081c40a8 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:31.545060 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9fb85-9d2f-44e9-be27-60c1d4a90223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:31.545783 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9fb85-9d2f-44e9-be27-60c1d4a90223 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:31.546202 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9fb85-9d2f-44e9-be27-60c1d4a90223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:31.546485 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9fb85-9d2f-44e9-be27-60c1d4a90223 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:31.547207 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9fb85-9d2f-44e9-be27-60c1d4a90223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:31.549631 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9fb85-9d2f-44e9-be27-60c1d4a90223 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:31.560608 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1116/2253] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:35:31.564465 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d59d22-74e3-4147-9255-88d76c6f4375 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:31.581048 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d59d22-74e3-4147-9255-88d76c6f4375 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:31.582464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee05113-514b-4fbc-a6be-55640ed3943b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:31.583131 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee05113-514b-4fbc-a6be-55640ed3943b admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:31.583413 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee05113-514b-4fbc-a6be-55640ed3943b admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:31.583827 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee05113-514b-4fbc-a6be-55640ed3943b admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:31.584559 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee05113-514b-4fbc-a6be-55640ed3943b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:31.586159 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee05113-514b-4fbc-a6be-55640ed3943b admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:31.599701 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1138/2254] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:35:31.605062 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9fb85-9d2f-44e9-be27-60c1d4a90223 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:31.609695 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee05113-514b-4fbc-a6be-55640ed3943b admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:31.611415 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3ee05113-514b-4fbc-a6be-55640ed3943b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:31.616960 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9fb85-9d2f-44e9-be27-60c1d4a90223 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:31.621583 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f933ed-ff94-4a76-9067-128bffd144a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:31.622499 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f933ed-ff94-4a76-9067-128bffd144a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:31.622781 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f933ed-ff94-4a76-9067-128bffd144a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:31.623056 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f933ed-ff94-4a76-9067-128bffd144a3 admin admin] PATH_INFO: `/v3/projects/118cce46f1db4d189ae97a546e4a9569/users/de80b5de81d24effa15ebcbe85ba42fd/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:31.625408 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee05113-514b-4fbc-a6be-55640ed3943b admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:31.630641 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44e8cd-f08b-4287-99de-c512ba01bfde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:31.631542 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44e8cd-f08b-4287-99de-c512ba01bfde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:31.631840 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44e8cd-f08b-4287-99de-c512ba01bfde admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:31.632120 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44e8cd-f08b-4287-99de-c512ba01bfde admin admin] PATH_INFO: `/v3/users/f683c0c3fa5c4b7ca30dce392e305ef0` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:31.633455 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44e8cd-f08b-4287-99de-c512ba01bfde admin admin] RBAC: Authorizing `identity:delete_user(user_id=f683c0c3fa5c4b7ca30dce392e305ef0)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:31.635549 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44e8cd-f08b-4287-99de-c512ba01bfde admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:31.638154 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f933ed-ff94-4a76-9067-128bffd144a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=118cce46f1db4d189ae97a546e4a9569, user_id=de80b5de81d24effa15ebcbe85ba42fd, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:31.641531 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f933ed-ff94-4a76-9067-128bffd144a3 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:31.723535 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1117/2255] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:35:31 2022] PUT /identity/v3/projects/118cce46f1db4d189ae97a546e4a9569/users/de80b5de81d24effa15ebcbe85ba42fd/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:31.734268 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4647c-18e1-4ee4-b943-9af073245a79 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:31.734565 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4647c-18e1-4ee4-b943-9af073245a79 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:31.734852 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4647c-18e1-4ee4-b943-9af073245a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:31.761125 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-edd4647c-18e1-4ee4-b943-9af073245a79 None None] MFA Rules not processed for user `de80b5de81d24effa15ebcbe85ba42fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:31.762333 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-edd4647c-18e1-4ee4-b943-9af073245a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:31.820127 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-2d44e8cd-f08b-4287-99de-c512ba01bfde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f683c0c3fa5c4b7ca30dce392e305ef0'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:31.828759 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1118/2256] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:31 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:35:31.840014 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4647c-18e1-4ee4-b943-9af073245a79 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:31.843683 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-edd4647c-18e1-4ee4-b943-9af073245a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:31.898298 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4647c-18e1-4ee4-b943-9af073245a79 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:31.902013 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217c49b-d82e-45ab-b37a-63bb858fb6d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:31.906807 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217c49b-d82e-45ab-b37a-63bb858fb6d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:31.906807 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217c49b-d82e-45ab-b37a-63bb858fb6d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:31.906807 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217c49b-d82e-45ab-b37a-63bb858fb6d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:31.912097 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217c49b-d82e-45ab-b37a-63bb858fb6d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:31.913538 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217c49b-d82e-45ab-b37a-63bb858fb6d9 service cinder] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:31.923981 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1119/2257] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:35:31 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 19:35:31.925974 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-2d44e8cd-f08b-4287-99de-c512ba01bfde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f683c0c3fa5c4b7ca30dce392e305ef0'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:31.926822 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-2d44e8cd-f08b-4287-99de-c512ba01bfde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f683c0c3fa5c4b7ca30dce392e305ef0'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:31.936989 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-2d44e8cd-f08b-4287-99de-c512ba01bfde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f683c0c3fa5c4b7ca30dce392e305ef0'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:31.952123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-2d44e8cd-f08b-4287-99de-c512ba01bfde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f683c0c3fa5c4b7ca30dce392e305ef0'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:31.959238 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1139/2258] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:35:31 2022] DELETE /identity/v3/users/f683c0c3fa5c4b7ca30dce392e305ef0 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:35:31.972764 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63117f09-4b2b-4932-bdb8-c30ab5360a2a None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:31.972764 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63117f09-4b2b-4932-bdb8-c30ab5360a2a None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:31.972764 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63117f09-4b2b-4932-bdb8-c30ab5360a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:31.991620 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-63117f09-4b2b-4932-bdb8-c30ab5360a2a None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:31.992890 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-63117f09-4b2b-4932-bdb8-c30ab5360a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:32.068762 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1120/2259] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:35:32.079687 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44e8cd-f08b-4287-99de-c512ba01bfde admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:32.081509 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-2d44e8cd-f08b-4287-99de-c512ba01bfde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:32.149966 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44e8cd-f08b-4287-99de-c512ba01bfde admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:32.155549 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72910472-3d3c-4822-a88b-a34f2df5c169 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:32.156207 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72910472-3d3c-4822-a88b-a34f2df5c169 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:32.156533 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72910472-3d3c-4822-a88b-a34f2df5c169 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:32.156816 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72910472-3d3c-4822-a88b-a34f2df5c169 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:32.167781 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72910472-3d3c-4822-a88b-a34f2df5c169 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:32.169679 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72910472-3d3c-4822-a88b-a34f2df5c169 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:32.180343 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1140/2260] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:35:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:35:32.394496 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:32.483208 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:32.667467 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63117f09-4b2b-4932-bdb8-c30ab5360a2a None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:32.668861 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-63117f09-4b2b-4932-bdb8-c30ab5360a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:32.681144 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63117f09-4b2b-4932-bdb8-c30ab5360a2a None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:32.686305 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812aeec0-689f-4d8a-94e5-8a55239a7c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:32.687273 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812aeec0-689f-4d8a-94e5-8a55239a7c90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:32.687588 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812aeec0-689f-4d8a-94e5-8a55239a7c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:32.687865 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812aeec0-689f-4d8a-94e5-8a55239a7c90 admin admin] PATH_INFO: `/v3/users/ca8f862ad8d94cb9a4de44e410ac1589` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:32.689050 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812aeec0-689f-4d8a-94e5-8a55239a7c90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca8f862ad8d94cb9a4de44e410ac1589)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:32.691223 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812aeec0-689f-4d8a-94e5-8a55239a7c90 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:32.745024 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72910472-3d3c-4822-a88b-a34f2df5c169 service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:32.746978 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-72910472-3d3c-4822-a88b-a34f2df5c169 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:32.762366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72910472-3d3c-4822-a88b-a34f2df5c169 service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:32.768302 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef1c56-aacc-40f0-b293-d4ec340ca161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:32.769213 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef1c56-aacc-40f0-b293-d4ec340ca161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:32.769501 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef1c56-aacc-40f0-b293-d4ec340ca161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:32.769776 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef1c56-aacc-40f0-b293-d4ec340ca161 admin admin] PATH_INFO: `/v3/projects/53141730547147f08ba35c05f0336e86` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:32.771176 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef1c56-aacc-40f0-b293-d4ec340ca161 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53141730547147f08ba35c05f0336e86)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:32.773141 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef1c56-aacc-40f0-b293-d4ec340ca161 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:33.001400 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-812aeec0-689f-4d8a-94e5-8a55239a7c90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca8f862ad8d94cb9a4de44e410ac1589'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:33.002046 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-60ef1c56-aacc-40f0-b293-d4ec340ca161 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53141730547147f08ba35c05f0336e86', 'request_id': 'req-60ef1c56-aacc-40f0-b293-d4ec340ca161'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:33.009005 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-60ef1c56-aacc-40f0-b293-d4ec340ca161 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53141730547147f08ba35c05f0336e86', 'request_id': 'req-60ef1c56-aacc-40f0-b293-d4ec340ca161'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:33.110795 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-812aeec0-689f-4d8a-94e5-8a55239a7c90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca8f862ad8d94cb9a4de44e410ac1589'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:33.125351 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-812aeec0-689f-4d8a-94e5-8a55239a7c90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca8f862ad8d94cb9a4de44e410ac1589'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:33.126114 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-812aeec0-689f-4d8a-94e5-8a55239a7c90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca8f862ad8d94cb9a4de44e410ac1589'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:33.133121 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-812aeec0-689f-4d8a-94e5-8a55239a7c90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca8f862ad8d94cb9a4de44e410ac1589'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:33.139412 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1121/2261] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:35:32 2022] DELETE /identity/v3/users/ca8f862ad8d94cb9a4de44e410ac1589 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:33.143649 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f815a-1cbe-49d5-a8a3-71e2ba4811c6 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:33.143945 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f815a-1cbe-49d5-a8a3-71e2ba4811c6 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:33.144229 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f815a-1cbe-49d5-a8a3-71e2ba4811c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:33.162371 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-8b5f815a-1cbe-49d5-a8a3-71e2ba4811c6 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:33.163776 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-8b5f815a-1cbe-49d5-a8a3-71e2ba4811c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:33.182633 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-60ef1c56-aacc-40f0-b293-d4ec340ca161 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53141730547147f08ba35c05f0336e86', 'request_id': 'req-60ef1c56-aacc-40f0-b293-d4ec340ca161'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:33.194682 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-60ef1c56-aacc-40f0-b293-d4ec340ca161 admin admin] The token cache is being invalidate because project 53141730547147f08ba35c05f0336e86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:35:33.194978 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-60ef1c56-aacc-40f0-b293-d4ec340ca161 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:33.195660 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-60ef1c56-aacc-40f0-b293-d4ec340ca161 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:33.197215 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1141/2262] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:35:32 2022] DELETE /identity/v3/projects/53141730547147f08ba35c05f0336e86 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:35:33.201138 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef1c56-aacc-40f0-b293-d4ec340ca161 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:33.202793 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-60ef1c56-aacc-40f0-b293-d4ec340ca161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:33.227873 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1122/2263] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:35:33.235068 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f815a-1cbe-49d5-a8a3-71e2ba4811c6 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:33.236666 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-8b5f815a-1cbe-49d5-a8a3-71e2ba4811c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:33.268319 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef1c56-aacc-40f0-b293-d4ec340ca161 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:33.273217 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898608ec-d417-4ddd-980d-6892a89cef7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:33.274104 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898608ec-d417-4ddd-980d-6892a89cef7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:33.274490 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898608ec-d417-4ddd-980d-6892a89cef7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:33.274778 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898608ec-d417-4ddd-980d-6892a89cef7e admin admin] PATH_INFO: `/v3/users/270c7b66ac844f5db692d960cdf5d1cb` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:33.277074 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898608ec-d417-4ddd-980d-6892a89cef7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=270c7b66ac844f5db692d960cdf5d1cb)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:33.279130 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898608ec-d417-4ddd-980d-6892a89cef7e admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:33.302033 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f815a-1cbe-49d5-a8a3-71e2ba4811c6 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:33.306222 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef559b7-a2a5-44a7-906c-d7d2e135b89b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:33.307301 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef559b7-a2a5-44a7-906c-d7d2e135b89b service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:33.307301 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef559b7-a2a5-44a7-906c-d7d2e135b89b service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:33.307721 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef559b7-a2a5-44a7-906c-d7d2e135b89b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:33.318868 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef559b7-a2a5-44a7-906c-d7d2e135b89b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:33.320526 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef559b7-a2a5-44a7-906c-d7d2e135b89b service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:33.331215 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1123/2264] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:35:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 19:35:33.489360 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-898608ec-d417-4ddd-980d-6892a89cef7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '270c7b66ac844f5db692d960cdf5d1cb'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:33.562829 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-898608ec-d417-4ddd-980d-6892a89cef7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '270c7b66ac844f5db692d960cdf5d1cb'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:33.565883 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-898608ec-d417-4ddd-980d-6892a89cef7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '270c7b66ac844f5db692d960cdf5d1cb'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:33.577937 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-898608ec-d417-4ddd-980d-6892a89cef7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '270c7b66ac844f5db692d960cdf5d1cb'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:33.594714 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-898608ec-d417-4ddd-980d-6892a89cef7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '270c7b66ac844f5db692d960cdf5d1cb'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:33.601071 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1142/2265] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:35:33 2022] DELETE /identity/v3/users/270c7b66ac844f5db692d960cdf5d1cb => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:35:33.692276 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:33.926098 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef559b7-a2a5-44a7-906c-d7d2e135b89b service neutron] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:33.926098 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-2ef559b7-a2a5-44a7-906c-d7d2e135b89b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:33.933814 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef559b7-a2a5-44a7-906c-d7d2e135b89b service neutron] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:33.946054 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:34.004062 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c8b78-1544-49b3-8a8b-5cb56cd402ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:34.004936 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c8b78-1544-49b3-8a8b-5cb56cd402ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:34.005387 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c8b78-1544-49b3-8a8b-5cb56cd402ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:34.005676 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c8b78-1544-49b3-8a8b-5cb56cd402ea admin admin] PATH_INFO: `/v3/projects/14910a85e07841658d4b48a0a1639cba` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:34.006906 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c8b78-1544-49b3-8a8b-5cb56cd402ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=14910a85e07841658d4b48a0a1639cba)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:34.008929 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c8b78-1544-49b3-8a8b-5cb56cd402ea admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:34.113165 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898608ec-d417-4ddd-980d-6892a89cef7e admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:34.114632 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-898608ec-d417-4ddd-980d-6892a89cef7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:34.128494 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898608ec-d417-4ddd-980d-6892a89cef7e admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:34.133590 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c42e1-7add-4eeb-9bba-8e5c0c47613d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:34.134459 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c42e1-7add-4eeb-9bba-8e5c0c47613d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:34.134961 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c42e1-7add-4eeb-9bba-8e5c0c47613d admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:34.138271 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c42e1-7add-4eeb-9bba-8e5c0c47613d admin admin] PATH_INFO: `/v3/projects/5ad685dcfb474197a6e566c9e17aab52` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:34.138271 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512c42e1-7add-4eeb-9bba-8e5c0c47613d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ad685dcfb474197a6e566c9e17aab52)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:34.141885 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512c42e1-7add-4eeb-9bba-8e5c0c47613d admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:34.154205 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-d94c8b78-1544-49b3-8a8b-5cb56cd402ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14910a85e07841658d4b48a0a1639cba', 'request_id': 'req-d94c8b78-1544-49b3-8a8b-5cb56cd402ea'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:34.259943 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-d94c8b78-1544-49b3-8a8b-5cb56cd402ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14910a85e07841658d4b48a0a1639cba', 'request_id': 'req-d94c8b78-1544-49b3-8a8b-5cb56cd402ea'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:34.268921 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-d94c8b78-1544-49b3-8a8b-5cb56cd402ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14910a85e07841658d4b48a0a1639cba', 'request_id': 'req-d94c8b78-1544-49b3-8a8b-5cb56cd402ea'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:34.279105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-512c42e1-7add-4eeb-9bba-8e5c0c47613d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ad685dcfb474197a6e566c9e17aab52', 'request_id': 'req-512c42e1-7add-4eeb-9bba-8e5c0c47613d'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:34.280154 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-d94c8b78-1544-49b3-8a8b-5cb56cd402ea admin admin] The token cache is being invalidate because project 14910a85e07841658d4b48a0a1639cba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:35:34.280467 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-d94c8b78-1544-49b3-8a8b-5cb56cd402ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:34.281431 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-d94c8b78-1544-49b3-8a8b-5cb56cd402ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:34.283144 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1124/2266] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:35:33 2022] DELETE /identity/v3/projects/14910a85e07841658d4b48a0a1639cba => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:34.287030 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c8b78-1544-49b3-8a8b-5cb56cd402ea admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:34.288665 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-d94c8b78-1544-49b3-8a8b-5cb56cd402ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:34.289420 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-512c42e1-7add-4eeb-9bba-8e5c0c47613d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ad685dcfb474197a6e566c9e17aab52', 'request_id': 'req-512c42e1-7add-4eeb-9bba-8e5c0c47613d'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:34.355224 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c8b78-1544-49b3-8a8b-5cb56cd402ea admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:34.385261 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-512c42e1-7add-4eeb-9bba-8e5c0c47613d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ad685dcfb474197a6e566c9e17aab52', 'request_id': 'req-512c42e1-7add-4eeb-9bba-8e5c0c47613d'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:34.398698 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-512c42e1-7add-4eeb-9bba-8e5c0c47613d admin admin] The token cache is being invalidate because project 5ad685dcfb474197a6e566c9e17aab52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:35:34.398994 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-512c42e1-7add-4eeb-9bba-8e5c0c47613d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:34.399662 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-512c42e1-7add-4eeb-9bba-8e5c0c47613d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:34.401261 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1143/2267] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:35:34 2022] DELETE /identity/v3/projects/5ad685dcfb474197a6e566c9e17aab52 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:34.405896 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c42e1-7add-4eeb-9bba-8e5c0c47613d admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:34.407363 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-512c42e1-7add-4eeb-9bba-8e5c0c47613d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:34.418702 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c2785-1430-4dc6-8fe5-a1bbe3b5f114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:34.418702 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c2785-1430-4dc6-8fe5-a1bbe3b5f114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:34.418702 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c2785-1430-4dc6-8fe5-a1bbe3b5f114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:34.418702 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c2785-1430-4dc6-8fe5-a1bbe3b5f114 admin admin] PATH_INFO: `/v3/users/c57d44bdde3f45b2ad14839e75926bf3` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:34.421833 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c2785-1430-4dc6-8fe5-a1bbe3b5f114 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c57d44bdde3f45b2ad14839e75926bf3)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:34.424472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c2785-1430-4dc6-8fe5-a1bbe3b5f114 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:34.489993 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c42e1-7add-4eeb-9bba-8e5c0c47613d admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:34.494735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520fe565-fd08-4747-8196-113f95232be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:34.495641 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fe565-fd08-4747-8196-113f95232be4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:34.495927 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fe565-fd08-4747-8196-113f95232be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:34.496200 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fe565-fd08-4747-8196-113f95232be4 admin admin] PATH_INFO: `/v3/users/7f6b72d7c266415a84f2fc1018cefd45` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:34.497430 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520fe565-fd08-4747-8196-113f95232be4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f6b72d7c266415a84f2fc1018cefd45)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:34.499964 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520fe565-fd08-4747-8196-113f95232be4 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:34.680075 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-440c2785-1430-4dc6-8fe5-a1bbe3b5f114 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c57d44bdde3f45b2ad14839e75926bf3'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:34.702207 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-520fe565-fd08-4747-8196-113f95232be4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f6b72d7c266415a84f2fc1018cefd45'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:34.705904 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:34.780787 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-440c2785-1430-4dc6-8fe5-a1bbe3b5f114 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c57d44bdde3f45b2ad14839e75926bf3'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:34.794311 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-440c2785-1430-4dc6-8fe5-a1bbe3b5f114 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c57d44bdde3f45b2ad14839e75926bf3'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:34.795158 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-440c2785-1430-4dc6-8fe5-a1bbe3b5f114 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c57d44bdde3f45b2ad14839e75926bf3'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:34.802782 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-440c2785-1430-4dc6-8fe5-a1bbe3b5f114 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c57d44bdde3f45b2ad14839e75926bf3'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:34.808732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1125/2268] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:35:34 2022] DELETE /identity/v3/users/c57d44bdde3f45b2ad14839e75926bf3 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:35:34.863009 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-520fe565-fd08-4747-8196-113f95232be4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f6b72d7c266415a84f2fc1018cefd45'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:34.864223 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-520fe565-fd08-4747-8196-113f95232be4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f6b72d7c266415a84f2fc1018cefd45'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:34.875062 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-520fe565-fd08-4747-8196-113f95232be4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f6b72d7c266415a84f2fc1018cefd45'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:34.888335 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-520fe565-fd08-4747-8196-113f95232be4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f6b72d7c266415a84f2fc1018cefd45'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:34.895549 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1144/2269] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:35:34 2022] DELETE /identity/v3/users/7f6b72d7c266415a84f2fc1018cefd45 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:35.043049 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:35.391281 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c2785-1430-4dc6-8fe5-a1bbe3b5f114 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:35.392659 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520fe565-fd08-4747-8196-113f95232be4 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:35.393046 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-440c2785-1430-4dc6-8fe5-a1bbe3b5f114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:35.395376 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-520fe565-fd08-4747-8196-113f95232be4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:35.466047 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c2785-1430-4dc6-8fe5-a1bbe3b5f114 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:35.501942 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520fe565-fd08-4747-8196-113f95232be4 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:35.509330 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dbff8f-121d-4738-9b78-53aa36b4189c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:35.511363 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dbff8f-121d-4738-9b78-53aa36b4189c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:35.511363 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dbff8f-121d-4738-9b78-53aa36b4189c admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:35.511363 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dbff8f-121d-4738-9b78-53aa36b4189c admin admin] PATH_INFO: `/v3/projects/51c77c5d190f4f8fbf72fc22c7cbb088` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:35.512690 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dbff8f-121d-4738-9b78-53aa36b4189c admin admin] RBAC: Authorizing `identity:delete_project(project_id=51c77c5d190f4f8fbf72fc22c7cbb088)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:35.515509 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dbff8f-121d-4738-9b78-53aa36b4189c admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:35.537398 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c98a4-822f-4e25-b916-9d4bf9d08407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:35.538313 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c98a4-822f-4e25-b916-9d4bf9d08407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:35.538600 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c98a4-822f-4e25-b916-9d4bf9d08407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:35.538882 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c98a4-822f-4e25-b916-9d4bf9d08407 admin admin] PATH_INFO: `/v3/projects/0afc44f4c21e450e9f4f3e4d3f4feb10` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:35.540114 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c98a4-822f-4e25-b916-9d4bf9d08407 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0afc44f4c21e450e9f4f3e4d3f4feb10)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:35.542067 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c98a4-822f-4e25-b916-9d4bf9d08407 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:35.699592 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-b8dbff8f-121d-4738-9b78-53aa36b4189c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51c77c5d190f4f8fbf72fc22c7cbb088', 'request_id': 'req-b8dbff8f-121d-4738-9b78-53aa36b4189c'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:35.703881 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-0e4c98a4-822f-4e25-b916-9d4bf9d08407 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0afc44f4c21e450e9f4f3e4d3f4feb10', 'request_id': 'req-0e4c98a4-822f-4e25-b916-9d4bf9d08407'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:35.708133 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-b8dbff8f-121d-4738-9b78-53aa36b4189c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51c77c5d190f4f8fbf72fc22c7cbb088', 'request_id': 'req-b8dbff8f-121d-4738-9b78-53aa36b4189c'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:35.797167 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-0e4c98a4-822f-4e25-b916-9d4bf9d08407 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0afc44f4c21e450e9f4f3e4d3f4feb10', 'request_id': 'req-0e4c98a4-822f-4e25-b916-9d4bf9d08407'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:35.803597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-0e4c98a4-822f-4e25-b916-9d4bf9d08407 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0afc44f4c21e450e9f4f3e4d3f4feb10', 'request_id': 'req-0e4c98a4-822f-4e25-b916-9d4bf9d08407'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:35.817643 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-0e4c98a4-822f-4e25-b916-9d4bf9d08407 admin admin] The token cache is being invalidate because project 0afc44f4c21e450e9f4f3e4d3f4feb10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:35:35.818017 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-0e4c98a4-822f-4e25-b916-9d4bf9d08407 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:35.818831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-0e4c98a4-822f-4e25-b916-9d4bf9d08407 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:35.820709 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1126/2270] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:35:35 2022] DELETE /identity/v3/projects/0afc44f4c21e450e9f4f3e4d3f4feb10 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:35.834682 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6ac34-0c86-4c7a-8620-32e4a0d33830 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:35.834682 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6ac34-0c86-4c7a-8620-32e4a0d33830 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:35.834682 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6ac34-0c86-4c7a-8620-32e4a0d33830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:35.859907 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-18f6ac34-0c86-4c7a-8620-32e4a0d33830 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:35.861452 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-18f6ac34-0c86-4c7a-8620-32e4a0d33830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:35.891864 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-b8dbff8f-121d-4738-9b78-53aa36b4189c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51c77c5d190f4f8fbf72fc22c7cbb088', 'request_id': 'req-b8dbff8f-121d-4738-9b78-53aa36b4189c'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:35.909496 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-b8dbff8f-121d-4738-9b78-53aa36b4189c admin admin] The token cache is being invalidate because project 51c77c5d190f4f8fbf72fc22c7cbb088 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:35:35.910365 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-b8dbff8f-121d-4738-9b78-53aa36b4189c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:35.911860 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-b8dbff8f-121d-4738-9b78-53aa36b4189c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:35.913820 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1145/2271] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:35:35 2022] DELETE /identity/v3/projects/51c77c5d190f4f8fbf72fc22c7cbb088 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:35.918722 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dbff8f-121d-4738-9b78-53aa36b4189c admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:35.924202 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:35.925387 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-b8dbff8f-121d-4738-9b78-53aa36b4189c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:35.929133 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1127/2272] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:35:35.939036 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1110b9-a845-4960-8743-4cae16bab3ea None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:35.939493 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1110b9-a845-4960-8743-4cae16bab3ea None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:35.939875 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1110b9-a845-4960-8743-4cae16bab3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:35.962334 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-3c1110b9-a845-4960-8743-4cae16bab3ea None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:35.963669 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-3c1110b9-a845-4960-8743-4cae16bab3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:35.973487 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1128/2273] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:35:35.977530 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1110b9-a845-4960-8743-4cae16bab3ea None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:35.989287 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1110b9-a845-4960-8743-4cae16bab3ea None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:35.994621 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e123eda-9755-41c2-a7c7-10be611ab44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:35.995427 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e123eda-9755-41c2-a7c7-10be611ab44b admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:35.995809 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e123eda-9755-41c2-a7c7-10be611ab44b admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:35.996151 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e123eda-9755-41c2-a7c7-10be611ab44b admin admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:35.996963 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e123eda-9755-41c2-a7c7-10be611ab44b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:35:35.997355 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e123eda-9755-41c2-a7c7-10be611ab44b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:35.999217 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e123eda-9755-41c2-a7c7-10be611ab44b admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:36.018073 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1129/2274] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:35:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:35:36.019553 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e123eda-9755-41c2-a7c7-10be611ab44b admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:36.032063 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dbff8f-121d-4738-9b78-53aa36b4189c admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:36.033118 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e123eda-9755-41c2-a7c7-10be611ab44b admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:36.037414 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e915e9-b446-400f-a181-45417e5038f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:36.039027 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e915e9-b446-400f-a181-45417e5038f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:36.039542 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e915e9-b446-400f-a181-45417e5038f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:36.039873 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8de4df-65cc-44dd-b7a2-aed1c84a0ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:36.040182 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e915e9-b446-400f-a181-45417e5038f4 admin admin] PATH_INFO: `/v3/users/542c610cf67b48bea0aa576345699403` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:36.040683 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8de4df-65cc-44dd-b7a2-aed1c84a0ba5 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:36.040976 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8de4df-65cc-44dd-b7a2-aed1c84a0ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:36.041253 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8de4df-65cc-44dd-b7a2-aed1c84a0ba5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:36.042155 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8de4df-65cc-44dd-b7a2-aed1c84a0ba5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:36.042585 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e915e9-b446-400f-a181-45417e5038f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=542c610cf67b48bea0aa576345699403)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:36.044664 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8de4df-65cc-44dd-b7a2-aed1c84a0ba5 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:36.049798 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e915e9-b446-400f-a181-45417e5038f4 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:36.203918 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1130/2275] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:35:36 2022] POST /identity/v3/projects => generated 391 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:35:36.208234 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8de4df-65cc-44dd-b7a2-aed1c84a0ba5 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:36.280842 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c9e915e9-b446-400f-a181-45417e5038f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '542c610cf67b48bea0aa576345699403'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:36.289829 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8de4df-65cc-44dd-b7a2-aed1c84a0ba5 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:36.296440 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e05bf-55fd-4937-b9a1-9036441a9e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:36.297721 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e05bf-55fd-4937-b9a1-9036441a9e7d admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:36.298179 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e05bf-55fd-4937-b9a1-9036441a9e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:36.298565 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e05bf-55fd-4937-b9a1-9036441a9e7d admin admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:36.299395 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e05bf-55fd-4937-b9a1-9036441a9e7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:36.301334 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e05bf-55fd-4937-b9a1-9036441a9e7d admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:36.339685 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c9e915e9-b446-400f-a181-45417e5038f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '542c610cf67b48bea0aa576345699403'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:36.340508 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c9e915e9-b446-400f-a181-45417e5038f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '542c610cf67b48bea0aa576345699403'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:36.349094 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c9e915e9-b446-400f-a181-45417e5038f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '542c610cf67b48bea0aa576345699403'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:36.363322 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c9e915e9-b446-400f-a181-45417e5038f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '542c610cf67b48bea0aa576345699403'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:36.371955 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1146/2276] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:35:35 2022] DELETE /identity/v3/users/542c610cf67b48bea0aa576345699403 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:36.391255 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1131/2277] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:35:36 2022] POST /identity/v3/users => generated 296 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:35:36.392824 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e915e9-b446-400f-a181-45417e5038f4 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:36.394532 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-c9e915e9-b446-400f-a181-45417e5038f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:36.486716 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e915e9-b446-400f-a181-45417e5038f4 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:36.491541 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda5219-9cfd-4060-9335-4c8722b37c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:36.492292 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda5219-9cfd-4060-9335-4c8722b37c8e admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:36.492648 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda5219-9cfd-4060-9335-4c8722b37c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:36.492995 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda5219-9cfd-4060-9335-4c8722b37c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:36.493801 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda5219-9cfd-4060-9335-4c8722b37c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:36.495595 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda5219-9cfd-4060-9335-4c8722b37c8e admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:36.506349 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1147/2278] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:35:36.510474 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e05bf-55fd-4937-b9a1-9036441a9e7d admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:36.520995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e05bf-55fd-4937-b9a1-9036441a9e7d admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:36.525615 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a17c8-5fd5-413c-82a0-162bc6bc3d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:36.526270 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a17c8-5fd5-413c-82a0-162bc6bc3d3a admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:36.526555 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a17c8-5fd5-413c-82a0-162bc6bc3d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:36.526830 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a17c8-5fd5-413c-82a0-162bc6bc3d3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:36.527582 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a17c8-5fd5-413c-82a0-162bc6bc3d3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:36.529338 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a17c8-5fd5-413c-82a0-162bc6bc3d3a admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:36.540031 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1132/2279] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:35:36.545773 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda5219-9cfd-4060-9335-4c8722b37c8e admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:36.556339 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda5219-9cfd-4060-9335-4c8722b37c8e admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:36.561673 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de15c3e-db78-46a2-94b8-c7ada5e59210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:36.562571 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de15c3e-db78-46a2-94b8-c7ada5e59210 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:36.562921 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de15c3e-db78-46a2-94b8-c7ada5e59210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:36.563127 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de15c3e-db78-46a2-94b8-c7ada5e59210 admin admin] PATH_INFO: `/v3/projects/67184639982746cf89c3176048ada58b/users/54f877ffc1a34862b9f9e37cb3df55eb/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:36.579593 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de15c3e-db78-46a2-94b8-c7ada5e59210 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67184639982746cf89c3176048ada58b, user_id=54f877ffc1a34862b9f9e37cb3df55eb, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:36.582310 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de15c3e-db78-46a2-94b8-c7ada5e59210 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:36.725348 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1148/2280] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:35:36 2022] PUT /identity/v3/projects/67184639982746cf89c3176048ada58b/users/54f877ffc1a34862b9f9e37cb3df55eb/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:35:36.737304 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285df16-88fb-4eb2-b298-196f52b9db60 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:36.737529 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285df16-88fb-4eb2-b298-196f52b9db60 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:36.737815 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285df16-88fb-4eb2-b298-196f52b9db60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:36.783714 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-f285df16-88fb-4eb2-b298-196f52b9db60 None None] MFA Rules not processed for user `54f877ffc1a34862b9f9e37cb3df55eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:36.783714 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-f285df16-88fb-4eb2-b298-196f52b9db60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:36.846061 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1133/2281] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:35:36.851756 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de15c3e-db78-46a2-94b8-c7ada5e59210 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:36.888006 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285df16-88fb-4eb2-b298-196f52b9db60 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:36.889997 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-f285df16-88fb-4eb2-b298-196f52b9db60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:36.934495 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de15c3e-db78-46a2-94b8-c7ada5e59210 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:36.939956 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78259b8-2380-4b19-a7a3-479d1e63b923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:36.941432 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78259b8-2380-4b19-a7a3-479d1e63b923 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:36.941949 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78259b8-2380-4b19-a7a3-479d1e63b923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:36.942411 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78259b8-2380-4b19-a7a3-479d1e63b923 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:36.943281 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78259b8-2380-4b19-a7a3-479d1e63b923 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:36.949617 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78259b8-2380-4b19-a7a3-479d1e63b923 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:36.986376 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285df16-88fb-4eb2-b298-196f52b9db60 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:36.995486 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ece46-1fa6-4e63-97f9-99b32c9ab4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:36.995486 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ece46-1fa6-4e63-97f9-99b32c9ab4b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:36.995486 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ece46-1fa6-4e63-97f9-99b32c9ab4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:36.995486 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ece46-1fa6-4e63-97f9-99b32c9ab4b0 admin admin] PATH_INFO: `/v3/projects/99c68b2a6ee24cc899eff8696ee63519` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:36.995917 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ece46-1fa6-4e63-97f9-99b32c9ab4b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99c68b2a6ee24cc899eff8696ee63519)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:36.996321 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ece46-1fa6-4e63-97f9-99b32c9ab4b0 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:37.070032 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:37.077939 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1149/2282] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:35:36 2022] POST /identity/v3/projects => generated 393 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:35:37.081401 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78259b8-2380-4b19-a7a3-479d1e63b923 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:37.140318 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-883ece46-1fa6-4e63-97f9-99b32c9ab4b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99c68b2a6ee24cc899eff8696ee63519', 'request_id': 'req-883ece46-1fa6-4e63-97f9-99b32c9ab4b0'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:37.144103 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78259b8-2380-4b19-a7a3-479d1e63b923 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:37.204355 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e2d70-fdd4-4133-9767-8fd33c0afb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:37.205033 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e2d70-fdd4-4133-9767-8fd33c0afb3b admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:37.205320 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e2d70-fdd4-4133-9767-8fd33c0afb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:37.205599 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e2d70-fdd4-4133-9767-8fd33c0afb3b admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:37.206287 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e2d70-fdd4-4133-9767-8fd33c0afb3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:37.208260 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e2d70-fdd4-4133-9767-8fd33c0afb3b admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:37.214491 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-883ece46-1fa6-4e63-97f9-99b32c9ab4b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99c68b2a6ee24cc899eff8696ee63519', 'request_id': 'req-883ece46-1fa6-4e63-97f9-99b32c9ab4b0'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:37.221322 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-883ece46-1fa6-4e63-97f9-99b32c9ab4b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99c68b2a6ee24cc899eff8696ee63519', 'request_id': 'req-883ece46-1fa6-4e63-97f9-99b32c9ab4b0'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:37.232377 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-883ece46-1fa6-4e63-97f9-99b32c9ab4b0 admin admin] The token cache is being invalidate because project 99c68b2a6ee24cc899eff8696ee63519 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:35:37.233255 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-883ece46-1fa6-4e63-97f9-99b32c9ab4b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:37.233910 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-883ece46-1fa6-4e63-97f9-99b32c9ab4b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:37.235637 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1134/2283] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:35:36 2022] DELETE /identity/v3/projects/99c68b2a6ee24cc899eff8696ee63519 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:35:37.240222 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b6418-a441-4d4d-8aea-8e422f68e2fd None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:37.240511 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b6418-a441-4d4d-8aea-8e422f68e2fd None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:37.240784 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b6418-a441-4d4d-8aea-8e422f68e2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:37.259977 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-fc8b6418-a441-4d4d-8aea-8e422f68e2fd None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:37.261100 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-fc8b6418-a441-4d4d-8aea-8e422f68e2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:37.269627 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1135/2284] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:35:37.277119 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a9610-57d8-4b72-b6ef-2294c4df00fe None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:37.277411 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a9610-57d8-4b72-b6ef-2294c4df00fe None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:37.277691 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a9610-57d8-4b72-b6ef-2294c4df00fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:37.297290 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-da7a9610-57d8-4b72-b6ef-2294c4df00fe None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:37.298589 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-da7a9610-57d8-4b72-b6ef-2294c4df00fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:37.307606 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1136/2285] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:35:37.311797 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a9610-57d8-4b72-b6ef-2294c4df00fe None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:37.322857 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1150/2286] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:35:37 2022] POST /identity/v3/users => generated 303 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 19:35:37.323064 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a9610-57d8-4b72-b6ef-2294c4df00fe None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:37.326479 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e2d70-fdd4-4133-9767-8fd33c0afb3b admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:37.328072 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a3ffa-8d06-4ff1-97dc-b32568f6fb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:37.328767 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a3ffa-8d06-4ff1-97dc-b32568f6fb99 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:37.329109 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a3ffa-8d06-4ff1-97dc-b32568f6fb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:37.329523 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a3ffa-8d06-4ff1-97dc-b32568f6fb99 admin admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:37.330315 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-e26e2d70-fdd4-4133-9767-8fd33c0afb3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:37.330430 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a3ffa-8d06-4ff1-97dc-b32568f6fb99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:35:37.330680 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a3ffa-8d06-4ff1-97dc-b32568f6fb99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:37.332357 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a3ffa-8d06-4ff1-97dc-b32568f6fb99 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:37.345688 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1137/2287] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:35:37.346590 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e2d70-fdd4-4133-9767-8fd33c0afb3b admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:37.351350 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef67115-4357-429e-8102-be202bc16c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:37.352482 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef67115-4357-429e-8102-be202bc16c0a admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:37.352482 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef67115-4357-429e-8102-be202bc16c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:37.352696 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef67115-4357-429e-8102-be202bc16c0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:37.353402 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef67115-4357-429e-8102-be202bc16c0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:37.355328 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef67115-4357-429e-8102-be202bc16c0a admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:37.355918 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a3ffa-8d06-4ff1-97dc-b32568f6fb99 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:37.366778 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1151/2288] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 19:35:37.367507 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a3ffa-8d06-4ff1-97dc-b32568f6fb99 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:37.371166 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef67115-4357-429e-8102-be202bc16c0a admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:37.373737 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fec6d5-477f-434e-95c9-7a35d3cf5899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:37.374630 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fec6d5-477f-434e-95c9-7a35d3cf5899 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:37.375108 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fec6d5-477f-434e-95c9-7a35d3cf5899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:37.375640 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fec6d5-477f-434e-95c9-7a35d3cf5899 admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:37.376500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fec6d5-477f-434e-95c9-7a35d3cf5899 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:37.378443 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fec6d5-477f-434e-95c9-7a35d3cf5899 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:37.382118 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef67115-4357-429e-8102-be202bc16c0a admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:37.388512 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253326d2-6af1-477c-9d48-91fada275d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:37.389432 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253326d2-6af1-477c-9d48-91fada275d08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:37.389713 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253326d2-6af1-477c-9d48-91fada275d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:37.389990 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253326d2-6af1-477c-9d48-91fada275d08 admin admin] PATH_INFO: `/v3/projects/5b6e56b1781d4f2ba79094d15ae62202/users/a4b19a7a7d90430b9a08c482ab1acf71/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:37.405896 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253326d2-6af1-477c-9d48-91fada275d08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b6e56b1781d4f2ba79094d15ae62202, user_id=a4b19a7a7d90430b9a08c482ab1acf71, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:37.410437 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253326d2-6af1-477c-9d48-91fada275d08 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:37.475463 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1152/2289] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:35:37 2022] PUT /identity/v3/projects/5b6e56b1781d4f2ba79094d15ae62202/users/a4b19a7a7d90430b9a08c482ab1acf71/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:37.476224 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1138/2290] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:35:37 2022] POST /identity/v3/projects => generated 371 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:35:37.479540 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253326d2-6af1-477c-9d48-91fada275d08 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:37.480157 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fec6d5-477f-434e-95c9-7a35d3cf5899 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:37.541240 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fec6d5-477f-434e-95c9-7a35d3cf5899 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:37.542363 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253326d2-6af1-477c-9d48-91fada275d08 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:37.546370 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0054d4-c26c-4e8c-888f-4a207f3b78f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:37.547105 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0054d4-c26c-4e8c-888f-4a207f3b78f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:37.547391 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0054d4-c26c-4e8c-888f-4a207f3b78f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:37.547706 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0054d4-c26c-4e8c-888f-4a207f3b78f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:37.547842 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca8d64-5671-4648-a28f-8fe182bd805d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:37.548394 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0054d4-c26c-4e8c-888f-4a207f3b78f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:37.548497 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca8d64-5671-4648-a28f-8fe182bd805d admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:37.548767 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca8d64-5671-4648-a28f-8fe182bd805d admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:37.549047 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca8d64-5671-4648-a28f-8fe182bd805d admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:37.549773 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca8d64-5671-4648-a28f-8fe182bd805d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:37.550296 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0054d4-c26c-4e8c-888f-4a207f3b78f3 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:37.551397 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca8d64-5671-4648-a28f-8fe182bd805d admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:37.562032 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1153/2291] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 19:35:37.566750 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca8d64-5671-4648-a28f-8fe182bd805d admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:37.577122 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca8d64-5671-4648-a28f-8fe182bd805d admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:37.582086 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57631621-79bb-4077-828b-4234f9df559c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:37.582966 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57631621-79bb-4077-828b-4234f9df559c admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:37.583311 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57631621-79bb-4077-828b-4234f9df559c admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:37.583678 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57631621-79bb-4077-828b-4234f9df559c admin admin] PATH_INFO: `/v3/projects/5b6e56b1781d4f2ba79094d15ae62202/users/a4b19a7a7d90430b9a08c482ab1acf71/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:37.585688 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57631621-79bb-4077-828b-4234f9df559c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b6e56b1781d4f2ba79094d15ae62202, user_id=a4b19a7a7d90430b9a08c482ab1acf71, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:37.588609 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57631621-79bb-4077-828b-4234f9df559c admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:37.601661 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1154/2292] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:35:37 2022] PUT /identity/v3/projects/5b6e56b1781d4f2ba79094d15ae62202/users/a4b19a7a7d90430b9a08c482ab1acf71/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:35:37.612330 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edfcb2-25b3-41f0-940a-bc1dc1055082 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:37.612624 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edfcb2-25b3-41f0-940a-bc1dc1055082 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:37.612911 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edfcb2-25b3-41f0-940a-bc1dc1055082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:37.643380 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-01edfcb2-25b3-41f0-940a-bc1dc1055082 None None] MFA Rules not processed for user `a4b19a7a7d90430b9a08c482ab1acf71`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:37.644694 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-01edfcb2-25b3-41f0-940a-bc1dc1055082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:37.663370 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1139/2293] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:35:37 2022] POST /identity/v3/users => generated 286 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:35:37.667412 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0054d4-c26c-4e8c-888f-4a207f3b78f3 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:37.678784 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0054d4-c26c-4e8c-888f-4a207f3b78f3 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:37.726857 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1155/2294] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:37 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:35:37.734468 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01edfcb2-25b3-41f0-940a-bc1dc1055082 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:37.735873 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-01edfcb2-25b3-41f0-940a-bc1dc1055082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:37.742053 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385e061-3cad-497b-adeb-5315afd353dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:37.742736 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385e061-3cad-497b-adeb-5315afd353dc admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:37.743041 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385e061-3cad-497b-adeb-5315afd353dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:37.743321 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385e061-3cad-497b-adeb-5315afd353dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:37.745702 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9385e061-3cad-497b-adeb-5315afd353dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:37.747508 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9385e061-3cad-497b-adeb-5315afd353dc admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:37.757929 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1140/2295] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 19:35:37.761734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385e061-3cad-497b-adeb-5315afd353dc admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:37.772798 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385e061-3cad-497b-adeb-5315afd353dc admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:37.778055 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1394c1fc-2947-4bd1-92ae-5b2b97878bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:37.778741 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394c1fc-2947-4bd1-92ae-5b2b97878bcc admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:37.779117 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394c1fc-2947-4bd1-92ae-5b2b97878bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:37.779274 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394c1fc-2947-4bd1-92ae-5b2b97878bcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:37.780610 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1394c1fc-2947-4bd1-92ae-5b2b97878bcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:37.782369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1394c1fc-2947-4bd1-92ae-5b2b97878bcc admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:37.793739 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1141/2296] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 19:35:37.797702 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1394c1fc-2947-4bd1-92ae-5b2b97878bcc admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:37.801661 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01edfcb2-25b3-41f0-940a-bc1dc1055082 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:37.808990 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1394c1fc-2947-4bd1-92ae-5b2b97878bcc admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:37.810245 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1ea09-6664-4ccf-bccc-f0a563fca99a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:37.811220 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1ea09-6664-4ccf-bccc-f0a563fca99a service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:37.811570 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1ea09-6664-4ccf-bccc-f0a563fca99a service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:37.812757 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1ea09-6664-4ccf-bccc-f0a563fca99a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:37.814615 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f259f-8cf5-4205-a75d-c561908ebed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:37.816134 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f259f-8cf5-4205-a75d-c561908ebed7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:37.816622 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f259f-8cf5-4205-a75d-c561908ebed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:37.817094 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f259f-8cf5-4205-a75d-c561908ebed7 admin admin] PATH_INFO: `/v3/projects/6de5bd48bf9540eebd868e36f761befa/users/3b376f8de1ab44b98e8ca5ea6a5cae1d/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:37.823522 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c1ea09-6664-4ccf-bccc-f0a563fca99a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:37.825347 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c1ea09-6664-4ccf-bccc-f0a563fca99a service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:37.835621 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f259f-8cf5-4205-a75d-c561908ebed7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6de5bd48bf9540eebd868e36f761befa, user_id=3b376f8de1ab44b98e8ca5ea6a5cae1d, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:37.837348 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1156/2297] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:35:37 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 19:35:37.841319 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f259f-8cf5-4205-a75d-c561908ebed7 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:37.886366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1ea09-6664-4ccf-bccc-f0a563fca99a service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:37.895924 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1ea09-6664-4ccf-bccc-f0a563fca99a service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:37.899676 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771da5e-fd8d-4144-b8f9-3c06e86471c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:37.900322 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771da5e-fd8d-4144-b8f9-3c06e86471c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:37.900609 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771da5e-fd8d-4144-b8f9-3c06e86471c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:37.900885 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771da5e-fd8d-4144-b8f9-3c06e86471c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:37.902700 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-9771da5e-fd8d-4144-b8f9-3c06e86471c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:37.929271 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:37.946131 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1142/2298] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:35:37 2022] PUT /identity/v3/projects/6de5bd48bf9540eebd868e36f761befa/users/3b376f8de1ab44b98e8ca5ea6a5cae1d/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:37.947841 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84713594-e8fa-4bc4-8bff-ecf811fe3ab6 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:37.948237 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84713594-e8fa-4bc4-8bff-ecf811fe3ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:37.949008 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84713594-e8fa-4bc4-8bff-ecf811fe3ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:37.968305 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9771da5e-fd8d-4144-b8f9-3c06e86471c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:37.969750 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9771da5e-fd8d-4144-b8f9-3c06e86471c5 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:37.979533 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1157/2299] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:35:37 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 19:35:37.989917 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-84713594-e8fa-4bc4-8bff-ecf811fe3ab6 None None] MFA Rules not processed for user `3b376f8de1ab44b98e8ca5ea6a5cae1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:37.991104 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-84713594-e8fa-4bc4-8bff-ecf811fe3ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:38.057798 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1143/2300] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:35:38.076640 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771da5e-fd8d-4144-b8f9-3c06e86471c5 service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:38.078223 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-9771da5e-fd8d-4144-b8f9-3c06e86471c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:38.146695 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771da5e-fd8d-4144-b8f9-3c06e86471c5 service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:38.217780 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fdee6e-acd4-4899-b59b-bbbd2ab18163 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a23a8e608f94d5d8153dcf7e79250f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:38.217780 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fdee6e-acd4-4899-b59b-bbbd2ab18163 service glance] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:38.217780 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fdee6e-acd4-4899-b59b-bbbd2ab18163 service glance] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:38.217780 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fdee6e-acd4-4899-b59b-bbbd2ab18163 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:38.228739 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fdee6e-acd4-4899-b59b-bbbd2ab18163 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:38.230321 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fdee6e-acd4-4899-b59b-bbbd2ab18163 service glance] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:38.240769 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84713594-e8fa-4bc4-8bff-ecf811fe3ab6 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:38.244922 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-84713594-e8fa-4bc4-8bff-ecf811fe3ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:38.245221 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1158/2301] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:35:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:35:38.322733 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84713594-e8fa-4bc4-8bff-ecf811fe3ab6 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:38.327816 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef8381-6efa-4362-aab1-a5095cdb8944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:38.328697 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef8381-6efa-4362-aab1-a5095cdb8944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:38.330587 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef8381-6efa-4362-aab1-a5095cdb8944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:38.330587 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef8381-6efa-4362-aab1-a5095cdb8944 admin admin] PATH_INFO: `/v3/users/de80b5de81d24effa15ebcbe85ba42fd` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:38.330587 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ef8381-6efa-4362-aab1-a5095cdb8944 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de80b5de81d24effa15ebcbe85ba42fd)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:38.332627 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ef8381-6efa-4362-aab1-a5095cdb8944 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:38.548261 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-e8ef8381-6efa-4362-aab1-a5095cdb8944 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de80b5de81d24effa15ebcbe85ba42fd'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:38.642837 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-e8ef8381-6efa-4362-aab1-a5095cdb8944 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de80b5de81d24effa15ebcbe85ba42fd'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:38.655702 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-e8ef8381-6efa-4362-aab1-a5095cdb8944 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de80b5de81d24effa15ebcbe85ba42fd'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:38.656330 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-e8ef8381-6efa-4362-aab1-a5095cdb8944 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de80b5de81d24effa15ebcbe85ba42fd'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:38.662968 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-e8ef8381-6efa-4362-aab1-a5095cdb8944 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de80b5de81d24effa15ebcbe85ba42fd'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:38.672239 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1144/2302] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:35:38 2022] DELETE /identity/v3/users/de80b5de81d24effa15ebcbe85ba42fd => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:35:38.675068 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a762bcd-5fd7-4b3c-9149-1bbd937df667 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:38.675296 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a762bcd-5fd7-4b3c-9149-1bbd937df667 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:38.675703 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a762bcd-5fd7-4b3c-9149-1bbd937df667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:38.704027 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-0a762bcd-5fd7-4b3c-9149-1bbd937df667 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:38.705375 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-0a762bcd-5fd7-4b3c-9149-1bbd937df667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:38.751935 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:38.770971 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1159/2303] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:35:38.781401 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef8381-6efa-4362-aab1-a5095cdb8944 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:38.782847 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-e8ef8381-6efa-4362-aab1-a5095cdb8944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:38.858597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef8381-6efa-4362-aab1-a5095cdb8944 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:38.862805 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff081f-95a6-4b47-b752-354b0fcb9b5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:38.863501 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff081f-95a6-4b47-b752-354b0fcb9b5a service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:38.863919 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff081f-95a6-4b47-b752-354b0fcb9b5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:38.864207 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff081f-95a6-4b47-b752-354b0fcb9b5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:38.874981 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff081f-95a6-4b47-b752-354b0fcb9b5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:38.876453 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff081f-95a6-4b47-b752-354b0fcb9b5a service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:38.886974 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1145/2304] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:35:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:35:39.240597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:39.383169 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a762bcd-5fd7-4b3c-9149-1bbd937df667 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:39.388993 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-0a762bcd-5fd7-4b3c-9149-1bbd937df667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:39.409078 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a762bcd-5fd7-4b3c-9149-1bbd937df667 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:39.417127 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d291466-3447-40d5-b2df-abc469fe11a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:39.418114 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d291466-3447-40d5-b2df-abc469fe11a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:39.418745 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d291466-3447-40d5-b2df-abc469fe11a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:39.419178 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d291466-3447-40d5-b2df-abc469fe11a8 admin admin] PATH_INFO: `/v3/projects/118cce46f1db4d189ae97a546e4a9569` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:39.421094 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d291466-3447-40d5-b2df-abc469fe11a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=118cce46f1db4d189ae97a546e4a9569)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:39.423152 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d291466-3447-40d5-b2df-abc469fe11a8 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:39.537300 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-9d291466-3447-40d5-b2df-abc469fe11a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '118cce46f1db4d189ae97a546e4a9569', 'request_id': 'req-9d291466-3447-40d5-b2df-abc469fe11a8'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:39.544122 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-9d291466-3447-40d5-b2df-abc469fe11a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '118cce46f1db4d189ae97a546e4a9569', 'request_id': 'req-9d291466-3447-40d5-b2df-abc469fe11a8'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:39.645194 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-9d291466-3447-40d5-b2df-abc469fe11a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '118cce46f1db4d189ae97a546e4a9569', 'request_id': 'req-9d291466-3447-40d5-b2df-abc469fe11a8'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:39.656814 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-9d291466-3447-40d5-b2df-abc469fe11a8 admin admin] The token cache is being invalidate because project 118cce46f1db4d189ae97a546e4a9569 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:35:39.657105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-9d291466-3447-40d5-b2df-abc469fe11a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:39.657782 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-9d291466-3447-40d5-b2df-abc469fe11a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:39.659342 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1160/2305] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:35:39 2022] DELETE /identity/v3/projects/118cce46f1db4d189ae97a546e4a9569 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:40.154228 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:40.243209 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:40.524004 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff081f-95a6-4b47-b752-354b0fcb9b5a service neutron] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:40.525391 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-54ff081f-95a6-4b47-b752-354b0fcb9b5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:40.547131 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff081f-95a6-4b47-b752-354b0fcb9b5a service neutron] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:40.603289 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72580074-71f2-404a-895d-076c63603371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:40.604287 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72580074-71f2-404a-895d-076c63603371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:40.604583 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72580074-71f2-404a-895d-076c63603371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:40.604870 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72580074-71f2-404a-895d-076c63603371 admin admin] PATH_INFO: `/v3/users/3bbc3fa8a50e45479a5af903fd1382d5` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:40.606136 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72580074-71f2-404a-895d-076c63603371 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bbc3fa8a50e45479a5af903fd1382d5)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:40.608878 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72580074-71f2-404a-895d-076c63603371 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:40.637122 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:40.794602 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-72580074-71f2-404a-895d-076c63603371 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bbc3fa8a50e45479a5af903fd1382d5'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:40.805791 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:40.873334 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-72580074-71f2-404a-895d-076c63603371 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bbc3fa8a50e45479a5af903fd1382d5'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:40.891025 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-72580074-71f2-404a-895d-076c63603371 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bbc3fa8a50e45479a5af903fd1382d5'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:40.891829 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-72580074-71f2-404a-895d-076c63603371 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bbc3fa8a50e45479a5af903fd1382d5'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:40.899045 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-72580074-71f2-404a-895d-076c63603371 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bbc3fa8a50e45479a5af903fd1382d5'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:40.905989 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1146/2306] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:35:40 2022] DELETE /identity/v3/users/3bbc3fa8a50e45479a5af903fd1382d5 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:40.910916 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc89a4-9952-4592-95eb-c3678a0d90c2 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:40.911210 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc89a4-9952-4592-95eb-c3678a0d90c2 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:40.911519 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc89a4-9952-4592-95eb-c3678a0d90c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:40.929809 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-d6dc89a4-9952-4592-95eb-c3678a0d90c2 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:40.931599 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-d6dc89a4-9952-4592-95eb-c3678a0d90c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:40.995892 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1161/2307] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:35:41.005775 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72580074-71f2-404a-895d-076c63603371 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:41.007200 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-72580074-71f2-404a-895d-076c63603371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:41.064806 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72580074-71f2-404a-895d-076c63603371 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:41.068636 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea7e33-abbe-4263-882b-22ae32edd6f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:41.069288 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea7e33-abbe-4263-882b-22ae32edd6f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:41.069574 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea7e33-abbe-4263-882b-22ae32edd6f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:41.069854 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea7e33-abbe-4263-882b-22ae32edd6f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:41.079827 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea7e33-abbe-4263-882b-22ae32edd6f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:41.081486 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea7e33-abbe-4263-882b-22ae32edd6f8 service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:41.091338 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1147/2308] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:35:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:35:41.555113 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc89a4-9952-4592-95eb-c3678a0d90c2 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:41.556786 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-d6dc89a4-9952-4592-95eb-c3678a0d90c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:41.573616 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc89a4-9952-4592-95eb-c3678a0d90c2 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:41.580110 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8a8e0-c252-411e-a2f7-5d578174cfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:41.581633 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8a8e0-c252-411e-a2f7-5d578174cfc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:41.582154 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8a8e0-c252-411e-a2f7-5d578174cfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:41.582641 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8a8e0-c252-411e-a2f7-5d578174cfc3 admin admin] PATH_INFO: `/v3/projects/59d8e77fd87341048bfcc88cd2094661` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:41.584144 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e8a8e0-c252-411e-a2f7-5d578174cfc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59d8e77fd87341048bfcc88cd2094661)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:41.586648 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e8a8e0-c252-411e-a2f7-5d578174cfc3 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:41.668369 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:41.705762 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:41.715135 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-a0e8a8e0-c252-411e-a2f7-5d578174cfc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59d8e77fd87341048bfcc88cd2094661', 'request_id': 'req-a0e8a8e0-c252-411e-a2f7-5d578174cfc3'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:41.722160 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-a0e8a8e0-c252-411e-a2f7-5d578174cfc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59d8e77fd87341048bfcc88cd2094661', 'request_id': 'req-a0e8a8e0-c252-411e-a2f7-5d578174cfc3'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:41.791313 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-a0e8a8e0-c252-411e-a2f7-5d578174cfc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59d8e77fd87341048bfcc88cd2094661', 'request_id': 'req-a0e8a8e0-c252-411e-a2f7-5d578174cfc3'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:41.802537 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-a0e8a8e0-c252-411e-a2f7-5d578174cfc3 admin admin] The token cache is being invalidate because project 59d8e77fd87341048bfcc88cd2094661 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:35:41.802848 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-a0e8a8e0-c252-411e-a2f7-5d578174cfc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:41.803531 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-a0e8a8e0-c252-411e-a2f7-5d578174cfc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:41.805075 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1162/2309] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:35:41 2022] DELETE /identity/v3/projects/59d8e77fd87341048bfcc88cd2094661 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:42.061074 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:42.109186 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:42.288423 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:42.382665 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:42.411691 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:42.560073 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:42.934825 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:43.053808 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea7e33-abbe-4263-882b-22ae32edd6f8 service neutron] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:43.059165 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-1eea7e33-abbe-4263-882b-22ae32edd6f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:43.068298 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea7e33-abbe-4263-882b-22ae32edd6f8 service neutron] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:43.134751 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75675f01-6b0f-4cb3-9288-9656c0da5367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:43.136302 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75675f01-6b0f-4cb3-9288-9656c0da5367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:43.136607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75675f01-6b0f-4cb3-9288-9656c0da5367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:43.136871 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75675f01-6b0f-4cb3-9288-9656c0da5367 admin admin] PATH_INFO: `/v3/users/54f877ffc1a34862b9f9e37cb3df55eb` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:43.138064 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75675f01-6b0f-4cb3-9288-9656c0da5367 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54f877ffc1a34862b9f9e37cb3df55eb)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:43.140143 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75675f01-6b0f-4cb3-9288-9656c0da5367 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:43.351597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:43.364778 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-75675f01-6b0f-4cb3-9288-9656c0da5367 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54f877ffc1a34862b9f9e37cb3df55eb'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:43.468666 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-75675f01-6b0f-4cb3-9288-9656c0da5367 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54f877ffc1a34862b9f9e37cb3df55eb'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:43.482847 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-75675f01-6b0f-4cb3-9288-9656c0da5367 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54f877ffc1a34862b9f9e37cb3df55eb'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:43.483902 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-75675f01-6b0f-4cb3-9288-9656c0da5367 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54f877ffc1a34862b9f9e37cb3df55eb'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:43.491341 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-75675f01-6b0f-4cb3-9288-9656c0da5367 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54f877ffc1a34862b9f9e37cb3df55eb'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:43.497305 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1148/2310] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:35:43 2022] DELETE /identity/v3/users/54f877ffc1a34862b9f9e37cb3df55eb => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:43.506383 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03873bf5-7d0c-47ee-80b7-954f582d8c4c None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:43.506383 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03873bf5-7d0c-47ee-80b7-954f582d8c4c None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:43.506383 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03873bf5-7d0c-47ee-80b7-954f582d8c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:43.519858 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-03873bf5-7d0c-47ee-80b7-954f582d8c4c None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:43.521050 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-03873bf5-7d0c-47ee-80b7-954f582d8c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:43.582103 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1163/2311] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:35:43.592419 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75675f01-6b0f-4cb3-9288-9656c0da5367 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:43.594527 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-75675f01-6b0f-4cb3-9288-9656c0da5367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:43.649051 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:43.657474 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75675f01-6b0f-4cb3-9288-9656c0da5367 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:43.661222 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483eb959-232e-481a-a6ce-6a1d9f136a91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:43.661873 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483eb959-232e-481a-a6ce-6a1d9f136a91 service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:43.662156 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483eb959-232e-481a-a6ce-6a1d9f136a91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:43.662431 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483eb959-232e-481a-a6ce-6a1d9f136a91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:43.671871 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483eb959-232e-481a-a6ce-6a1d9f136a91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:43.673292 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483eb959-232e-481a-a6ce-6a1d9f136a91 service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:43.682988 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1149/2312] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:35:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:35:43.719490 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:44.069276 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:44.157966 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03873bf5-7d0c-47ee-80b7-954f582d8c4c None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:44.158674 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-03873bf5-7d0c-47ee-80b7-954f582d8c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:44.173009 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03873bf5-7d0c-47ee-80b7-954f582d8c4c None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:44.194818 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6fee3d-6819-413e-8e01-1b7bdc2382cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:44.198371 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fee3d-6819-413e-8e01-1b7bdc2382cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:44.198732 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fee3d-6819-413e-8e01-1b7bdc2382cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:44.199081 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fee3d-6819-413e-8e01-1b7bdc2382cf admin admin] PATH_INFO: `/v3/projects/67184639982746cf89c3176048ada58b` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:44.201291 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6fee3d-6819-413e-8e01-1b7bdc2382cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=67184639982746cf89c3176048ada58b)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:44.204160 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6fee3d-6819-413e-8e01-1b7bdc2382cf admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:44.343748 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-7f6fee3d-6819-413e-8e01-1b7bdc2382cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67184639982746cf89c3176048ada58b', 'request_id': 'req-7f6fee3d-6819-413e-8e01-1b7bdc2382cf'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:44.359475 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-7f6fee3d-6819-413e-8e01-1b7bdc2382cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67184639982746cf89c3176048ada58b', 'request_id': 'req-7f6fee3d-6819-413e-8e01-1b7bdc2382cf'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:44.422710 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-7f6fee3d-6819-413e-8e01-1b7bdc2382cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67184639982746cf89c3176048ada58b', 'request_id': 'req-7f6fee3d-6819-413e-8e01-1b7bdc2382cf'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:44.444790 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-7f6fee3d-6819-413e-8e01-1b7bdc2382cf admin admin] The token cache is being invalidate because project 67184639982746cf89c3176048ada58b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:35:44.445083 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-7f6fee3d-6819-413e-8e01-1b7bdc2382cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:44.445747 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-7f6fee3d-6819-413e-8e01-1b7bdc2382cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:44.447925 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1164/2313] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:35:44 2022] DELETE /identity/v3/projects/67184639982746cf89c3176048ada58b => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:44.452126 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483eb959-232e-481a-a6ce-6a1d9f136a91 service neutron] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:44.463524 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483eb959-232e-481a-a6ce-6a1d9f136a91 service neutron] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:44.527491 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be578c95-73c9-42c1-bdf9-8663d3c10e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:44.528602 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be578c95-73c9-42c1-bdf9-8663d3c10e22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:44.528915 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be578c95-73c9-42c1-bdf9-8663d3c10e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:44.529246 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be578c95-73c9-42c1-bdf9-8663d3c10e22 admin admin] PATH_INFO: `/v3/users/a4b19a7a7d90430b9a08c482ab1acf71` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:44.531075 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be578c95-73c9-42c1-bdf9-8663d3c10e22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4b19a7a7d90430b9a08c482ab1acf71)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:44.533236 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be578c95-73c9-42c1-bdf9-8663d3c10e22 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:44.736700 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-be578c95-73c9-42c1-bdf9-8663d3c10e22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4b19a7a7d90430b9a08c482ab1acf71'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:44.822321 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-be578c95-73c9-42c1-bdf9-8663d3c10e22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4b19a7a7d90430b9a08c482ab1acf71'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:44.837492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-be578c95-73c9-42c1-bdf9-8663d3c10e22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4b19a7a7d90430b9a08c482ab1acf71'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:44.838244 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-be578c95-73c9-42c1-bdf9-8663d3c10e22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4b19a7a7d90430b9a08c482ab1acf71'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:44.845367 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-be578c95-73c9-42c1-bdf9-8663d3c10e22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4b19a7a7d90430b9a08c482ab1acf71'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:44.851476 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1150/2314] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:35:44 2022] DELETE /identity/v3/users/a4b19a7a7d90430b9a08c482ab1acf71 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:45.332223 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6fee3d-6819-413e-8e01-1b7bdc2382cf admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:45.333802 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-7f6fee3d-6819-413e-8e01-1b7bdc2382cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:45.361984 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6fee3d-6819-413e-8e01-1b7bdc2382cf admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:45.414040 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:45.457925 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8d0ef-e945-4df3-b4ca-60fd2e0ef40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:45.460519 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8d0ef-e945-4df3-b4ca-60fd2e0ef40b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:45.460969 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8d0ef-e945-4df3-b4ca-60fd2e0ef40b admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:45.462012 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8d0ef-e945-4df3-b4ca-60fd2e0ef40b admin admin] PATH_INFO: `/v3/projects/5b6e56b1781d4f2ba79094d15ae62202` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:45.463410 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c8d0ef-e945-4df3-b4ca-60fd2e0ef40b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b6e56b1781d4f2ba79094d15ae62202)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:45.465369 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c8d0ef-e945-4df3-b4ca-60fd2e0ef40b admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:45.579995 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-23c8d0ef-e945-4df3-b4ca-60fd2e0ef40b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b6e56b1781d4f2ba79094d15ae62202', 'request_id': 'req-23c8d0ef-e945-4df3-b4ca-60fd2e0ef40b'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:45.586764 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-23c8d0ef-e945-4df3-b4ca-60fd2e0ef40b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b6e56b1781d4f2ba79094d15ae62202', 'request_id': 'req-23c8d0ef-e945-4df3-b4ca-60fd2e0ef40b'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:45.650839 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-23c8d0ef-e945-4df3-b4ca-60fd2e0ef40b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b6e56b1781d4f2ba79094d15ae62202', 'request_id': 'req-23c8d0ef-e945-4df3-b4ca-60fd2e0ef40b'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:45.663328 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-23c8d0ef-e945-4df3-b4ca-60fd2e0ef40b admin admin] The token cache is being invalidate because project 5b6e56b1781d4f2ba79094d15ae62202 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:35:45.666382 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-23c8d0ef-e945-4df3-b4ca-60fd2e0ef40b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:45.666382 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-23c8d0ef-e945-4df3-b4ca-60fd2e0ef40b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:45.666382 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1165/2315] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:35:45 2022] DELETE /identity/v3/projects/5b6e56b1781d4f2ba79094d15ae62202 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:45.671664 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb463d-d722-4483-8983-450f1c12cdd5 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:45.672197 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb463d-d722-4483-8983-450f1c12cdd5 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:45.672197 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb463d-d722-4483-8983-450f1c12cdd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:45.693333 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-9deb463d-d722-4483-8983-450f1c12cdd5 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:45.694081 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-9deb463d-d722-4483-8983-450f1c12cdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:45.732627 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:45.758545 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1151/2316] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:35:45.768218 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1eee3-f746-4cb5-8dfb-56b203ef0f02 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:45.768668 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1eee3-f746-4cb5-8dfb-56b203ef0f02 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:45.769016 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1eee3-f746-4cb5-8dfb-56b203ef0f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:45.790074 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-27b1eee3-f746-4cb5-8dfb-56b203ef0f02 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:45.791279 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-27b1eee3-f746-4cb5-8dfb-56b203ef0f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:45.800117 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1166/2317] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:35:45.805122 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb463d-d722-4483-8983-450f1c12cdd5 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:45.815061 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb463d-d722-4483-8983-450f1c12cdd5 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:45.820040 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03430c76-958e-4eaf-8e52-782bb5e66e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:45.820720 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03430c76-958e-4eaf-8e52-782bb5e66e51 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:45.821094 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03430c76-958e-4eaf-8e52-782bb5e66e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:45.821593 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03430c76-958e-4eaf-8e52-782bb5e66e51 admin admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:45.822545 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03430c76-958e-4eaf-8e52-782bb5e66e51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:35:45.823151 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03430c76-958e-4eaf-8e52-782bb5e66e51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:45.824882 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03430c76-958e-4eaf-8e52-782bb5e66e51 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:45.837129 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1152/2318] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:35:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:35:45.841523 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b1eee3-f746-4cb5-8dfb-56b203ef0f02 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:45.851774 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b1eee3-f746-4cb5-8dfb-56b203ef0f02 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:45.856472 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93011d6a-0353-42eb-83b5-3e7d9578e1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:45.857136 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93011d6a-0353-42eb-83b5-3e7d9578e1ff admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:45.862603 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93011d6a-0353-42eb-83b5-3e7d9578e1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:45.862603 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93011d6a-0353-42eb-83b5-3e7d9578e1ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:45.862603 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93011d6a-0353-42eb-83b5-3e7d9578e1ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:45.862603 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93011d6a-0353-42eb-83b5-3e7d9578e1ff admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:45.970513 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1167/2319] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:35:45 2022] POST /identity/v3/projects => generated 401 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:35:45.974814 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03430c76-958e-4eaf-8e52-782bb5e66e51 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:45.984770 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03430c76-958e-4eaf-8e52-782bb5e66e51 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:46.041604 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e709d4-d962-4aca-8857-c9b2776d0d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:46.042273 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e709d4-d962-4aca-8857-c9b2776d0d80 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:46.042558 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e709d4-d962-4aca-8857-c9b2776d0d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:46.042835 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e709d4-d962-4aca-8857-c9b2776d0d80 admin admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:46.043570 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e709d4-d962-4aca-8857-c9b2776d0d80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:46.045504 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e709d4-d962-4aca-8857-c9b2776d0d80 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:46.163253 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1153/2320] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:35:45 2022] POST /identity/v3/users => generated 301 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:35:46.164655 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93011d6a-0353-42eb-83b5-3e7d9578e1ff admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:46.177601 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93011d6a-0353-42eb-83b5-3e7d9578e1ff admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:46.182407 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4395c-7f9e-4fd9-ac47-b6fb179773f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:46.183105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4395c-7f9e-4fd9-ac47-b6fb179773f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:46.183389 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4395c-7f9e-4fd9-ac47-b6fb179773f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:46.183723 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4395c-7f9e-4fd9-ac47-b6fb179773f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:46.184432 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c4395c-7f9e-4fd9-ac47-b6fb179773f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:46.186620 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c4395c-7f9e-4fd9-ac47-b6fb179773f4 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:46.198120 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1168/2321] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:35:46.202663 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e709d4-d962-4aca-8857-c9b2776d0d80 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:46.213163 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e709d4-d962-4aca-8857-c9b2776d0d80 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:46.217720 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527de11-e6e3-4aab-bd38-f2021165a2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:46.218379 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527de11-e6e3-4aab-bd38-f2021165a2cf admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:46.218665 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527de11-e6e3-4aab-bd38-f2021165a2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:46.218943 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527de11-e6e3-4aab-bd38-f2021165a2cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:46.219726 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527de11-e6e3-4aab-bd38-f2021165a2cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:46.221310 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527de11-e6e3-4aab-bd38-f2021165a2cf admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:46.232323 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1154/2322] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:35:46.236866 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4395c-7f9e-4fd9-ac47-b6fb179773f4 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:46.250595 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4395c-7f9e-4fd9-ac47-b6fb179773f4 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:46.255305 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6cead3-e810-40b7-902f-025f207e25dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:46.256227 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6cead3-e810-40b7-902f-025f207e25dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:46.256512 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6cead3-e810-40b7-902f-025f207e25dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:46.256789 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6cead3-e810-40b7-902f-025f207e25dd admin admin] PATH_INFO: `/v3/projects/62c56838cb204ca8ae2cde7e469cbe7a/users/566eb873f7ed4aabb5c0cde47ea82edb/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:46.272526 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6cead3-e810-40b7-902f-025f207e25dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=62c56838cb204ca8ae2cde7e469cbe7a, user_id=566eb873f7ed4aabb5c0cde47ea82edb, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:46.275240 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6cead3-e810-40b7-902f-025f207e25dd admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:46.343345 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1169/2323] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:35:46 2022] PUT /identity/v3/projects/62c56838cb204ca8ae2cde7e469cbe7a/users/566eb873f7ed4aabb5c0cde47ea82edb/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:46.353727 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f4d4b-c450-4d61-ac33-88e0d8d06575 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:46.354028 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f4d4b-c450-4d61-ac33-88e0d8d06575 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:46.354313 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f4d4b-c450-4d61-ac33-88e0d8d06575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:46.381157 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-0c5f4d4b-c450-4d61-ac33-88e0d8d06575 None None] MFA Rules not processed for user `566eb873f7ed4aabb5c0cde47ea82edb`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:46.382402 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-0c5f4d4b-c450-4d61-ac33-88e0d8d06575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:46.447918 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1155/2324] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:46 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:35:46.453145 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6cead3-e810-40b7-902f-025f207e25dd admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:46.522135 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6cead3-e810-40b7-902f-025f207e25dd admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:46.528929 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b6491-b5c2-4397-823c-5d9d44374599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:46.530204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b6491-b5c2-4397-823c-5d9d44374599 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:46.530483 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b6491-b5c2-4397-823c-5d9d44374599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:46.530756 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b6491-b5c2-4397-823c-5d9d44374599 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:46.531493 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b6491-b5c2-4397-823c-5d9d44374599 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:46.533415 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b6491-b5c2-4397-823c-5d9d44374599 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:46.547756 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:46.613117 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1170/2325] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:35:46 2022] POST /identity/v3/projects => generated 399 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:35:46.617169 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f4d4b-c450-4d61-ac33-88e0d8d06575 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:46.628670 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f4d4b-c450-4d61-ac33-88e0d8d06575 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:46.665268 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:46.689169 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce33d36-88ba-48ba-80cf-d63a5c993f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:46.695511 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce33d36-88ba-48ba-80cf-d63a5c993f6c admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:46.695511 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce33d36-88ba-48ba-80cf-d63a5c993f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:46.695511 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce33d36-88ba-48ba-80cf-d63a5c993f6c admin admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:46.695511 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce33d36-88ba-48ba-80cf-d63a5c993f6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:46.695511 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce33d36-88ba-48ba-80cf-d63a5c993f6c admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:46.805752 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1156/2326] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:35:46 2022] POST /identity/v3/users => generated 306 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 19:35:46.816323 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b6491-b5c2-4397-823c-5d9d44374599 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:46.821170 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b6491-b5c2-4397-823c-5d9d44374599 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:46.825771 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6008b6a-d478-4dbe-86c9-6903acb9d7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:46.826552 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6008b6a-d478-4dbe-86c9-6903acb9d7b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:46.826963 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6008b6a-d478-4dbe-86c9-6903acb9d7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:46.827283 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6008b6a-d478-4dbe-86c9-6903acb9d7b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:46.828038 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6008b6a-d478-4dbe-86c9-6903acb9d7b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:46.829627 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6008b6a-d478-4dbe-86c9-6903acb9d7b4 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:46.840350 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1171/2327] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:35:46.845056 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce33d36-88ba-48ba-80cf-d63a5c993f6c admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:46.855260 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce33d36-88ba-48ba-80cf-d63a5c993f6c admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:46.861729 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a772e-427c-40c9-8604-3d7a3b4258f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:46.862790 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a772e-427c-40c9-8604-3d7a3b4258f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:46.863165 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a772e-427c-40c9-8604-3d7a3b4258f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:46.863509 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a772e-427c-40c9-8604-3d7a3b4258f4 admin admin] PATH_INFO: `/v3/projects/51a4cb1a46924524a50758937be5f477/users/a28560308cdf4a4999a77a46826220d7/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:46.880329 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a772e-427c-40c9-8604-3d7a3b4258f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51a4cb1a46924524a50758937be5f477, user_id=a28560308cdf4a4999a77a46826220d7, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:46.883075 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a772e-427c-40c9-8604-3d7a3b4258f4 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:46.962653 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1157/2328] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:35:46 2022] PUT /identity/v3/projects/51a4cb1a46924524a50758937be5f477/users/a28560308cdf4a4999a77a46826220d7/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:46.967230 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6008b6a-d478-4dbe-86c9-6903acb9d7b4 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:46.977336 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6008b6a-d478-4dbe-86c9-6903acb9d7b4 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:47.036845 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3712330-f0c1-4b19-a9b6-8843632396df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:47.037438 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3712330-f0c1-4b19-a9b6-8843632396df admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:47.037756 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3712330-f0c1-4b19-a9b6-8843632396df admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:47.038038 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3712330-f0c1-4b19-a9b6-8843632396df admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:47.038800 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3712330-f0c1-4b19-a9b6-8843632396df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:47.040472 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3712330-f0c1-4b19-a9b6-8843632396df admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:47.050491 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1172/2329] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:35:47.054770 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a772e-427c-40c9-8604-3d7a3b4258f4 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:47.066160 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a772e-427c-40c9-8604-3d7a3b4258f4 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:47.070846 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c4dbc-8686-4083-b2f8-fe3c2b6e68af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:47.071765 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c4dbc-8686-4083-b2f8-fe3c2b6e68af admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:47.072054 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c4dbc-8686-4083-b2f8-fe3c2b6e68af admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:47.072337 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c4dbc-8686-4083-b2f8-fe3c2b6e68af admin admin] PATH_INFO: `/v3/projects/51a4cb1a46924524a50758937be5f477/users/a28560308cdf4a4999a77a46826220d7/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:47.074307 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c4dbc-8686-4083-b2f8-fe3c2b6e68af admin admin] RBAC: Authorizing `identity:create_grant(project_id=51a4cb1a46924524a50758937be5f477, user_id=a28560308cdf4a4999a77a46826220d7, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:47.078221 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c4dbc-8686-4083-b2f8-fe3c2b6e68af admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:47.089041 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1158/2330] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:35:47 2022] PUT /identity/v3/projects/51a4cb1a46924524a50758937be5f477/users/a28560308cdf4a4999a77a46826220d7/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:47.099491 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ee3f7-38c1-4381-bfff-2b6f172b3792 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:47.099791 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ee3f7-38c1-4381-bfff-2b6f172b3792 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:47.100072 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ee3f7-38c1-4381-bfff-2b6f172b3792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:47.129730 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-447ee3f7-38c1-4381-bfff-2b6f172b3792 None None] MFA Rules not processed for user `a28560308cdf4a4999a77a46826220d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:47.131252 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-447ee3f7-38c1-4381-bfff-2b6f172b3792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:47.201270 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1173/2331] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:47 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:35:47.211816 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c4dbc-8686-4083-b2f8-fe3c2b6e68af admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:47.213473 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-911c4dbc-8686-4083-b2f8-fe3c2b6e68af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:47.272909 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c4dbc-8686-4083-b2f8-fe3c2b6e68af admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:47.276550 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ac3eb-8986-466c-8f81-b5abb8dd2e23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:47.277197 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ac3eb-8986-466c-8f81-b5abb8dd2e23 service cinder] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:47.277481 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ac3eb-8986-466c-8f81-b5abb8dd2e23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:47.277787 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ac3eb-8986-466c-8f81-b5abb8dd2e23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:47.287492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ac3eb-8986-466c-8f81-b5abb8dd2e23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:47.288858 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ac3eb-8986-466c-8f81-b5abb8dd2e23 service cinder] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:47.298643 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1159/2332] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:35:47 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:35:47.621743 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ee3f7-38c1-4381-bfff-2b6f172b3792 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:47.632966 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ee3f7-38c1-4381-bfff-2b6f172b3792 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:47.636567 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71858221-5424-4489-8631-2d0836646b61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:47.637215 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71858221-5424-4489-8631-2d0836646b61 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:47.637530 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71858221-5424-4489-8631-2d0836646b61 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:47.637812 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71858221-5424-4489-8631-2d0836646b61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:47.700498 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71858221-5424-4489-8631-2d0836646b61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:47.701952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71858221-5424-4489-8631-2d0836646b61 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:47.711900 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1174/2333] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:35:47 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:35:52.730912 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ac3eb-8986-466c-8f81-b5abb8dd2e23 service cinder] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:52.792965 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ac3eb-8986-466c-8f81-b5abb8dd2e23 service cinder] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:52.798109 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e123e2-370d-4a9b-a313-5f59de33728c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:52.798987 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e123e2-370d-4a9b-a313-5f59de33728c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:52.799272 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e123e2-370d-4a9b-a313-5f59de33728c admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:52.799600 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e123e2-370d-4a9b-a313-5f59de33728c admin admin] PATH_INFO: `/v3/users/566eb873f7ed4aabb5c0cde47ea82edb` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:52.800876 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e123e2-370d-4a9b-a313-5f59de33728c admin admin] RBAC: Authorizing `identity:delete_user(user_id=566eb873f7ed4aabb5c0cde47ea82edb)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:52.802788 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e123e2-370d-4a9b-a313-5f59de33728c admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:53.004029 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28c48e-8b5e-4381-9161-0126005abdc7 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:53.004576 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28c48e-8b5e-4381-9161-0126005abdc7 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:53.004696 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:53.004812 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28c48e-8b5e-4381-9161-0126005abdc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:53.010579 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:53.016751 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-32e123e2-370d-4a9b-a313-5f59de33728c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '566eb873f7ed4aabb5c0cde47ea82edb'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:53.023167 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-ed28c48e-8b5e-4381-9161-0126005abdc7 None None] MFA Rules not processed for user `d9f276efb89f4e869e7c58b2c492a0f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:53.024520 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ed28c48e-8b5e-4381-9161-0126005abdc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:53.080902 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1175/2334] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:35:53.116499 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-32e123e2-370d-4a9b-a313-5f59de33728c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '566eb873f7ed4aabb5c0cde47ea82edb'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:53.135611 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-32e123e2-370d-4a9b-a313-5f59de33728c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '566eb873f7ed4aabb5c0cde47ea82edb'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:53.136733 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-32e123e2-370d-4a9b-a313-5f59de33728c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '566eb873f7ed4aabb5c0cde47ea82edb'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:53.145070 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-32e123e2-370d-4a9b-a313-5f59de33728c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '566eb873f7ed4aabb5c0cde47ea82edb'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:53.151615 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1160/2335] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:35:52 2022] DELETE /identity/v3/users/566eb873f7ed4aabb5c0cde47ea82edb => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:53.156388 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1959cf-8abd-4aef-aad8-e8d1d0073458 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:53.156794 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1959cf-8abd-4aef-aad8-e8d1d0073458 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:53.157164 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1959cf-8abd-4aef-aad8-e8d1d0073458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:53.175138 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-8a1959cf-8abd-4aef-aad8-e8d1d0073458 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:53.176395 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-8a1959cf-8abd-4aef-aad8-e8d1d0073458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:53.240025 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1176/2336] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:35:53.249951 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e123e2-370d-4a9b-a313-5f59de33728c admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:53.251375 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-32e123e2-370d-4a9b-a313-5f59de33728c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:53.309591 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e123e2-370d-4a9b-a313-5f59de33728c admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:53.313174 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7285f89-e19e-46bb-9d02-9cb6a2023ded service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:53.313835 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7285f89-e19e-46bb-9d02-9cb6a2023ded service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:53.314089 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7285f89-e19e-46bb-9d02-9cb6a2023ded service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:53.314366 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7285f89-e19e-46bb-9d02-9cb6a2023ded service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:53.324186 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7285f89-e19e-46bb-9d02-9cb6a2023ded service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:53.325610 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7285f89-e19e-46bb-9d02-9cb6a2023ded service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:53.336859 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1161/2337] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:35:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:35:53.795800 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1959cf-8abd-4aef-aad8-e8d1d0073458 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:53.797822 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-8a1959cf-8abd-4aef-aad8-e8d1d0073458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:53.812630 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1959cf-8abd-4aef-aad8-e8d1d0073458 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:53.817965 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69097fde-faf7-4593-add3-33330ed1b0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:53.818828 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69097fde-faf7-4593-add3-33330ed1b0cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:53.819111 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69097fde-faf7-4593-add3-33330ed1b0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:53.819391 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69097fde-faf7-4593-add3-33330ed1b0cc admin admin] PATH_INFO: `/v3/projects/62c56838cb204ca8ae2cde7e469cbe7a` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:53.820610 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69097fde-faf7-4593-add3-33330ed1b0cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=62c56838cb204ca8ae2cde7e469cbe7a)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:53.823235 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69097fde-faf7-4593-add3-33330ed1b0cc admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:53.941568 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-69097fde-faf7-4593-add3-33330ed1b0cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62c56838cb204ca8ae2cde7e469cbe7a', 'request_id': 'req-69097fde-faf7-4593-add3-33330ed1b0cc'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:53.951093 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-69097fde-faf7-4593-add3-33330ed1b0cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62c56838cb204ca8ae2cde7e469cbe7a', 'request_id': 'req-69097fde-faf7-4593-add3-33330ed1b0cc'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:54.036824 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-69097fde-faf7-4593-add3-33330ed1b0cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62c56838cb204ca8ae2cde7e469cbe7a', 'request_id': 'req-69097fde-faf7-4593-add3-33330ed1b0cc'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:54.044286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-69097fde-faf7-4593-add3-33330ed1b0cc admin admin] The token cache is being invalidate because project 62c56838cb204ca8ae2cde7e469cbe7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:35:54.044576 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-69097fde-faf7-4593-add3-33330ed1b0cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:54.045262 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-69097fde-faf7-4593-add3-33330ed1b0cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:54.047657 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1177/2338] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:35:53 2022] DELETE /identity/v3/projects/62c56838cb204ca8ae2cde7e469cbe7a => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:54.051691 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7285f89-e19e-46bb-9d02-9cb6a2023ded service neutron] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:54.061461 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7285f89-e19e-46bb-9d02-9cb6a2023ded service neutron] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:54.118021 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e558f89-f8e0-4078-bc8c-52240410969b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:54.118890 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e558f89-f8e0-4078-bc8c-52240410969b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:54.119177 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e558f89-f8e0-4078-bc8c-52240410969b admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:54.119475 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e558f89-f8e0-4078-bc8c-52240410969b admin admin] PATH_INFO: `/v3/users/a28560308cdf4a4999a77a46826220d7` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:54.120666 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e558f89-f8e0-4078-bc8c-52240410969b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a28560308cdf4a4999a77a46826220d7)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:54.122597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e558f89-f8e0-4078-bc8c-52240410969b admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:54.310273 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-3e558f89-f8e0-4078-bc8c-52240410969b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a28560308cdf4a4999a77a46826220d7'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:54.393567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-3e558f89-f8e0-4078-bc8c-52240410969b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a28560308cdf4a4999a77a46826220d7'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:54.395602 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:54.413070 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-3e558f89-f8e0-4078-bc8c-52240410969b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a28560308cdf4a4999a77a46826220d7'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:54.414059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-3e558f89-f8e0-4078-bc8c-52240410969b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a28560308cdf4a4999a77a46826220d7'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:54.437715 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-3e558f89-f8e0-4078-bc8c-52240410969b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a28560308cdf4a4999a77a46826220d7'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:54.446342 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1162/2339] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:35:54 2022] DELETE /identity/v3/users/a28560308cdf4a4999a77a46826220d7 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:54.886012 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69097fde-faf7-4593-add3-33330ed1b0cc admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:54.887739 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-69097fde-faf7-4593-add3-33330ed1b0cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:54.901585 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69097fde-faf7-4593-add3-33330ed1b0cc admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:54.941830 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:54.982346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6286095-e350-4683-b550-999e3375218f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:54.984099 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6286095-e350-4683-b550-999e3375218f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:54.984752 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6286095-e350-4683-b550-999e3375218f admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:54.985210 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6286095-e350-4683-b550-999e3375218f admin admin] PATH_INFO: `/v3/projects/51a4cb1a46924524a50758937be5f477` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:54.988331 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6286095-e350-4683-b550-999e3375218f admin admin] RBAC: Authorizing `identity:delete_project(project_id=51a4cb1a46924524a50758937be5f477)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:54.991020 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6286095-e350-4683-b550-999e3375218f admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:55.133736 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-e6286095-e350-4683-b550-999e3375218f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51a4cb1a46924524a50758937be5f477', 'request_id': 'req-e6286095-e350-4683-b550-999e3375218f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:55.141095 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-e6286095-e350-4683-b550-999e3375218f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51a4cb1a46924524a50758937be5f477', 'request_id': 'req-e6286095-e350-4683-b550-999e3375218f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:55.205158 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-e6286095-e350-4683-b550-999e3375218f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51a4cb1a46924524a50758937be5f477', 'request_id': 'req-e6286095-e350-4683-b550-999e3375218f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:55.216192 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-e6286095-e350-4683-b550-999e3375218f admin admin] The token cache is being invalidate because project 51a4cb1a46924524a50758937be5f477 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:35:55.216430 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-e6286095-e350-4683-b550-999e3375218f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:55.217053 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-e6286095-e350-4683-b550-999e3375218f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:55.218777 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1178/2340] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:35:54 2022] DELETE /identity/v3/projects/51a4cb1a46924524a50758937be5f477 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:35:55.223904 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5985a-0132-4652-9c5a-33defa9d8aba None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:55.224388 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5985a-0132-4652-9c5a-33defa9d8aba None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:55.224533 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5985a-0132-4652-9c5a-33defa9d8aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:55.243470 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-4ab5985a-0132-4652-9c5a-33defa9d8aba None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:55.244714 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-4ab5985a-0132-4652-9c5a-33defa9d8aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:55.306037 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1163/2341] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:35:55.314621 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf509e-a4de-4ba3-9128-33e45e1a2d1b None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:55.314913 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf509e-a4de-4ba3-9128-33e45e1a2d1b None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:55.315192 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf509e-a4de-4ba3-9128-33e45e1a2d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:55.333684 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-c5bf509e-a4de-4ba3-9128-33e45e1a2d1b None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:55.334896 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-c5bf509e-a4de-4ba3-9128-33e45e1a2d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:55.342827 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1179/2342] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:35:55.347937 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab5985a-0132-4652-9c5a-33defa9d8aba None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:55.359233 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab5985a-0132-4652-9c5a-33defa9d8aba None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:55.364284 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f220acab-ba4c-473f-9cc0-5f28f79dcbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:55.366242 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220acab-ba4c-473f-9cc0-5f28f79dcbe7 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:55.366242 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220acab-ba4c-473f-9cc0-5f28f79dcbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:55.366242 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220acab-ba4c-473f-9cc0-5f28f79dcbe7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:55.366242 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f220acab-ba4c-473f-9cc0-5f28f79dcbe7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:35:55.366576 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f220acab-ba4c-473f-9cc0-5f28f79dcbe7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:55.368128 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f220acab-ba4c-473f-9cc0-5f28f79dcbe7 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:55.381529 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1164/2343] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:35:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:35:55.385866 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf509e-a4de-4ba3-9128-33e45e1a2d1b None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:55.395249 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf509e-a4de-4ba3-9128-33e45e1a2d1b None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:55.399957 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82fd67-e39a-44e3-9964-9b4c224dce4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:55.400656 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82fd67-e39a-44e3-9964-9b4c224dce4f admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:55.400941 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82fd67-e39a-44e3-9964-9b4c224dce4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:55.401217 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82fd67-e39a-44e3-9964-9b4c224dce4f admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:55.401908 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a82fd67-e39a-44e3-9964-9b4c224dce4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:55.403849 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a82fd67-e39a-44e3-9964-9b4c224dce4f admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:55.535761 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1180/2344] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:35:55 2022] POST /identity/v3/projects => generated 389 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:35:55.539818 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f220acab-ba4c-473f-9cc0-5f28f79dcbe7 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:55.550454 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f220acab-ba4c-473f-9cc0-5f28f79dcbe7 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:55.606478 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7b020-3d6d-4ba3-a502-32b1b88b1285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:55.607153 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7b020-3d6d-4ba3-a502-32b1b88b1285 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:55.607462 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7b020-3d6d-4ba3-a502-32b1b88b1285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:55.607745 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7b020-3d6d-4ba3-a502-32b1b88b1285 admin admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:55.608457 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b7b020-3d6d-4ba3-a502-32b1b88b1285 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:55.610895 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b7b020-3d6d-4ba3-a502-32b1b88b1285 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:55.709406 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1165/2345] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:35:55 2022] POST /identity/v3/users => generated 295 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 19:35:55.713775 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82fd67-e39a-44e3-9964-9b4c224dce4f admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:55.726892 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82fd67-e39a-44e3-9964-9b4c224dce4f admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:55.738854 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f2853-8534-404c-a7a8-cc1ba6fabb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:55.738854 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f2853-8534-404c-a7a8-cc1ba6fabb76 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:55.738854 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f2853-8534-404c-a7a8-cc1ba6fabb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:55.738854 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f2853-8534-404c-a7a8-cc1ba6fabb76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:55.739533 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f2853-8534-404c-a7a8-cc1ba6fabb76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:55.739533 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f2853-8534-404c-a7a8-cc1ba6fabb76 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:55.754780 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1181/2346] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:35:55.754975 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7b020-3d6d-4ba3-a502-32b1b88b1285 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:55.767004 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7b020-3d6d-4ba3-a502-32b1b88b1285 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:55.772497 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0724a098-f372-4db0-967d-2f982ef92061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:55.773171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724a098-f372-4db0-967d-2f982ef92061 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:55.773461 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724a098-f372-4db0-967d-2f982ef92061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:55.773831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724a098-f372-4db0-967d-2f982ef92061 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:55.774569 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0724a098-f372-4db0-967d-2f982ef92061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:55.776216 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0724a098-f372-4db0-967d-2f982ef92061 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:55.873163 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1166/2347] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 19:35:55.873750 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f2853-8534-404c-a7a8-cc1ba6fabb76 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:55.873750 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f2853-8534-404c-a7a8-cc1ba6fabb76 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:55.873750 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd5444f-65fe-4c00-8e14-da5524118922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:55.873750 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5444f-65fe-4c00-8e14-da5524118922 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:55.874503 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5444f-65fe-4c00-8e14-da5524118922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:55.874503 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5444f-65fe-4c00-8e14-da5524118922 admin admin] PATH_INFO: `/v3/projects/3c704a606dfa4891978299825af5dbb5/users/18c54ab7e0ad42b080d50c61f605197b/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:55.874503 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd5444f-65fe-4c00-8e14-da5524118922 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c704a606dfa4891978299825af5dbb5, user_id=18c54ab7e0ad42b080d50c61f605197b, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:55.874503 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd5444f-65fe-4c00-8e14-da5524118922 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:56.278476 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1182/2348] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:35:55 2022] PUT /identity/v3/projects/3c704a606dfa4891978299825af5dbb5/users/18c54ab7e0ad42b080d50c61f605197b/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:56.291341 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d3815-6020-402b-9567-cdf9ba1cb659 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:56.291919 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d3815-6020-402b-9567-cdf9ba1cb659 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:56.292171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d3815-6020-402b-9567-cdf9ba1cb659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:56.321377 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-0e6d3815-6020-402b-9567-cdf9ba1cb659 None None] MFA Rules not processed for user `18c54ab7e0ad42b080d50c61f605197b`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:56.322823 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-0e6d3815-6020-402b-9567-cdf9ba1cb659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:56.351002 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:56.392162 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1167/2349] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:35:56.396473 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd5444f-65fe-4c00-8e14-da5524118922 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:56.467254 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:56.473226 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd5444f-65fe-4c00-8e14-da5524118922 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:56.481436 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfdb1c2-5e86-4bdb-b72b-bef701fe6fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:56.483182 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfdb1c2-5e86-4bdb-b72b-bef701fe6fa6 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:56.483787 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfdb1c2-5e86-4bdb-b72b-bef701fe6fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:56.484489 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfdb1c2-5e86-4bdb-b72b-bef701fe6fa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:56.485417 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfdb1c2-5e86-4bdb-b72b-bef701fe6fa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:56.487345 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfdb1c2-5e86-4bdb-b72b-bef701fe6fa6 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:56.587727 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1183/2350] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:35:56 2022] POST /identity/v3/projects => generated 387 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 19:35:56.591754 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d3815-6020-402b-9567-cdf9ba1cb659 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:56.607381 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d3815-6020-402b-9567-cdf9ba1cb659 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:56.619902 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814d584-8817-40e5-a02f-998ff6a58b5f None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:56.620334 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814d584-8817-40e5-a02f-998ff6a58b5f None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:56.620691 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814d584-8817-40e5-a02f-998ff6a58b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:56.654951 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-d814d584-8817-40e5-a02f-998ff6a58b5f None None] MFA Rules not processed for user `22d11b8e390e4b9db3b84c419266c4b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:56.656596 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-d814d584-8817-40e5-a02f-998ff6a58b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:56.724117 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f73019b-406b-4d3a-ad40-59fec024db46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:56.726028 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73019b-406b-4d3a-ad40-59fec024db46 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:56.728224 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73019b-406b-4d3a-ad40-59fec024db46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:56.728728 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73019b-406b-4d3a-ad40-59fec024db46 admin admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:56.729607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f73019b-406b-4d3a-ad40-59fec024db46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:56.733033 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f73019b-406b-4d3a-ad40-59fec024db46 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:56.770130 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1184/2351] 10.222.0.60 () {58 vars in 1009 bytes} [Thu Jul 21 19:35:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:35:56.816930 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d814d584-8817-40e5-a02f-998ff6a58b5f None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:56.818388 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-d814d584-8817-40e5-a02f-998ff6a58b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:56.883047 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1168/2352] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:35:56 2022] POST /identity/v3/users => generated 300 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:35:56.887067 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f73019b-406b-4d3a-ad40-59fec024db46 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:56.900881 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d814d584-8817-40e5-a02f-998ff6a58b5f None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:56.906237 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5385222f-ce8e-44a6-927f-89b8b1659603 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa579af53a6441a9205cf82864a640e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:56.906895 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385222f-ce8e-44a6-927f-89b8b1659603 service swift] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:56.907173 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385222f-ce8e-44a6-927f-89b8b1659603 service swift] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:56.907504 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385222f-ce8e-44a6-927f-89b8b1659603 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:56.911826 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f73019b-406b-4d3a-ad40-59fec024db46 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:56.917130 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5385222f-ce8e-44a6-927f-89b8b1659603 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:56.920228 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c575c-9b7d-482f-870c-741e28a829cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:56.920228 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c575c-9b7d-482f-870c-741e28a829cd admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:56.920228 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c575c-9b7d-482f-870c-741e28a829cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:56.920523 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5385222f-ce8e-44a6-927f-89b8b1659603 service swift] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:56.920640 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c575c-9b7d-482f-870c-741e28a829cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:56.920640 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85c575c-9b7d-482f-870c-741e28a829cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:56.921774 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85c575c-9b7d-482f-870c-741e28a829cd admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:56.929638 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1185/2353] 10.222.0.60 () {60 vars in 1384 bytes} [Thu Jul 21 19:35:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 19:35:56.942586 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1169/2354] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:35:56.950420 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5385222f-ce8e-44a6-927f-89b8b1659603 service swift] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:56.958224 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5385222f-ce8e-44a6-927f-89b8b1659603 service swift] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:56.964532 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9215e5-742a-4133-bc7b-8532eae633a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:56.965469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9215e5-742a-4133-bc7b-8532eae633a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:56.965753 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9215e5-742a-4133-bc7b-8532eae633a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:56.966043 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9215e5-742a-4133-bc7b-8532eae633a1 admin admin] PATH_INFO: `/v3/projects/c90ecce1a52a439781e3604505729caa/users/d07d4b34394643e9beeecbf50d5e17c3/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:56.988403 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9215e5-742a-4133-bc7b-8532eae633a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c90ecce1a52a439781e3604505729caa, user_id=d07d4b34394643e9beeecbf50d5e17c3, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:56.991198 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9215e5-742a-4133-bc7b-8532eae633a1 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:57.098358 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1186/2355] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:35:56 2022] PUT /identity/v3/projects/c90ecce1a52a439781e3604505729caa/users/d07d4b34394643e9beeecbf50d5e17c3/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:57.109608 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c575c-9b7d-482f-870c-741e28a829cd admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:57.115670 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c575c-9b7d-482f-870c-741e28a829cd admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:57.211860 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e43a99-3a68-4660-87d1-1166befd5b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:57.212823 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e43a99-3a68-4660-87d1-1166befd5b1b admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:57.213118 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e43a99-3a68-4660-87d1-1166befd5b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:57.213400 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e43a99-3a68-4660-87d1-1166befd5b1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:57.214131 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e43a99-3a68-4660-87d1-1166befd5b1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:57.215763 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e43a99-3a68-4660-87d1-1166befd5b1b admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:57.231994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1170/2356] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:35:57 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:35:57.236906 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9215e5-742a-4133-bc7b-8532eae633a1 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:57.254228 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9215e5-742a-4133-bc7b-8532eae633a1 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:57.265790 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627aed9-0b9f-4e48-8c0a-c18b0104ea96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:57.267092 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627aed9-0b9f-4e48-8c0a-c18b0104ea96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:57.267686 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627aed9-0b9f-4e48-8c0a-c18b0104ea96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:57.268189 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627aed9-0b9f-4e48-8c0a-c18b0104ea96 admin admin] PATH_INFO: `/v3/projects/c90ecce1a52a439781e3604505729caa/users/d07d4b34394643e9beeecbf50d5e17c3/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:57.271366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627aed9-0b9f-4e48-8c0a-c18b0104ea96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c90ecce1a52a439781e3604505729caa, user_id=d07d4b34394643e9beeecbf50d5e17c3, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:57.282206 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627aed9-0b9f-4e48-8c0a-c18b0104ea96 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:57.295814 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1187/2357] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:35:57 2022] PUT /identity/v3/projects/c90ecce1a52a439781e3604505729caa/users/d07d4b34394643e9beeecbf50d5e17c3/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:57.391046 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3defa6c0-0061-40e9-bdbb-6660d6fe1381 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:57.391046 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3defa6c0-0061-40e9-bdbb-6660d6fe1381 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:57.391046 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3defa6c0-0061-40e9-bdbb-6660d6fe1381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:57.434910 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-3defa6c0-0061-40e9-bdbb-6660d6fe1381 None None] MFA Rules not processed for user `d07d4b34394643e9beeecbf50d5e17c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:57.436440 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-3defa6c0-0061-40e9-bdbb-6660d6fe1381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:57.489206 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:57.565608 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1171/2358] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:57 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:35:57.579195 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627aed9-0b9f-4e48-8c0a-c18b0104ea96 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:57.584771 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-4627aed9-0b9f-4e48-8c0a-c18b0104ea96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:57.682117 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627aed9-0b9f-4e48-8c0a-c18b0104ea96 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:57.690807 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dca407-525d-40e8-ab75-48a4c175f471 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:57.692005 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dca407-525d-40e8-ab75-48a4c175f471 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:57.692460 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dca407-525d-40e8-ab75-48a4c175f471 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:57.692945 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dca407-525d-40e8-ab75-48a4c175f471 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:57.705181 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dca407-525d-40e8-ab75-48a4c175f471 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:57.706871 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dca407-525d-40e8-ab75-48a4c175f471 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:57.719116 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1188/2359] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:35:57 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:35:57.782532 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:57.916356 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3defa6c0-0061-40e9-bdbb-6660d6fe1381 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:58.031845 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3defa6c0-0061-40e9-bdbb-6660d6fe1381 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:58.040240 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f94ab-cc3b-4ebc-8755-e79bd727b179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:58.042103 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f94ab-cc3b-4ebc-8755-e79bd727b179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:58.042573 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f94ab-cc3b-4ebc-8755-e79bd727b179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:58.043014 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f94ab-cc3b-4ebc-8755-e79bd727b179 admin admin] PATH_INFO: `/v3/users/18c54ab7e0ad42b080d50c61f605197b` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:58.044515 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985f94ab-cc3b-4ebc-8755-e79bd727b179 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18c54ab7e0ad42b080d50c61f605197b)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:58.048037 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985f94ab-cc3b-4ebc-8755-e79bd727b179 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:58.323359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-985f94ab-cc3b-4ebc-8755-e79bd727b179 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18c54ab7e0ad42b080d50c61f605197b'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:58.413858 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-985f94ab-cc3b-4ebc-8755-e79bd727b179 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18c54ab7e0ad42b080d50c61f605197b'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:58.439395 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-985f94ab-cc3b-4ebc-8755-e79bd727b179 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18c54ab7e0ad42b080d50c61f605197b'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:58.440231 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-985f94ab-cc3b-4ebc-8755-e79bd727b179 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18c54ab7e0ad42b080d50c61f605197b'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:58.457989 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-985f94ab-cc3b-4ebc-8755-e79bd727b179 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18c54ab7e0ad42b080d50c61f605197b'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:35:58.467184 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1172/2360] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:35:57 2022] DELETE /identity/v3/users/18c54ab7e0ad42b080d50c61f605197b => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:35:58.471885 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6172f-09f3-4fc6-b0b3-308c60598a12 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:58.472838 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6172f-09f3-4fc6-b0b3-308c60598a12 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:58.475013 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6172f-09f3-4fc6-b0b3-308c60598a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:58.506515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-53f6172f-09f3-4fc6-b0b3-308c60598a12 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:35:58.508172 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-53f6172f-09f3-4fc6-b0b3-308c60598a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:58.654774 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1189/2361] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:35:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:35:58.741911 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f94ab-cc3b-4ebc-8755-e79bd727b179 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:58.744014 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-985f94ab-cc3b-4ebc-8755-e79bd727b179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:58.823970 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:35:58.832079 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f94ab-cc3b-4ebc-8755-e79bd727b179 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:58.852996 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe33a59-3e3a-4e97-adf8-defae2edd3b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:58.854184 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe33a59-3e3a-4e97-adf8-defae2edd3b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:58.854846 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe33a59-3e3a-4e97-adf8-defae2edd3b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:58.855637 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe33a59-3e3a-4e97-adf8-defae2edd3b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:58.881020 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe33a59-3e3a-4e97-adf8-defae2edd3b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:58.883245 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe33a59-3e3a-4e97-adf8-defae2edd3b6 service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:35:58.895093 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1173/2362] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:35:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:35:59.782468 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f6172f-09f3-4fc6-b0b3-308c60598a12 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:35:59.784847 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-53f6172f-09f3-4fc6-b0b3-308c60598a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:35:59.837095 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f6172f-09f3-4fc6-b0b3-308c60598a12 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:35:59.855847 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab93f4b-98de-4d31-922a-88cd58b709f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:35:59.856726 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab93f4b-98de-4d31-922a-88cd58b709f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:35:59.857014 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab93f4b-98de-4d31-922a-88cd58b709f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:35:59.857294 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab93f4b-98de-4d31-922a-88cd58b709f7 admin admin] PATH_INFO: `/v3/projects/3c704a606dfa4891978299825af5dbb5` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:35:59.863640 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab93f4b-98de-4d31-922a-88cd58b709f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c704a606dfa4891978299825af5dbb5)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:35:59.868724 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab93f4b-98de-4d31-922a-88cd58b709f7 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:36:00.038113 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-dab93f4b-98de-4d31-922a-88cd58b709f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c704a606dfa4891978299825af5dbb5', 'request_id': 'req-dab93f4b-98de-4d31-922a-88cd58b709f7'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:36:00.075520 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-dab93f4b-98de-4d31-922a-88cd58b709f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c704a606dfa4891978299825af5dbb5', 'request_id': 'req-dab93f4b-98de-4d31-922a-88cd58b709f7'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:36:00.150781 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-dab93f4b-98de-4d31-922a-88cd58b709f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c704a606dfa4891978299825af5dbb5', 'request_id': 'req-dab93f4b-98de-4d31-922a-88cd58b709f7'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:36:00.175742 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-dab93f4b-98de-4d31-922a-88cd58b709f7 admin admin] The token cache is being invalidate because project 3c704a606dfa4891978299825af5dbb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:36:00.176038 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-dab93f4b-98de-4d31-922a-88cd58b709f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:36:00.176771 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-dab93f4b-98de-4d31-922a-88cd58b709f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:36:00.179235 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1190/2363] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:35:59 2022] DELETE /identity/v3/projects/3c704a606dfa4891978299825af5dbb5 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:36:00.183369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe33a59-3e3a-4e97-adf8-defae2edd3b6 service neutron] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:36:00.198118 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe33a59-3e3a-4e97-adf8-defae2edd3b6 service neutron] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:36:00.284686 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc1849-ed1e-4079-839b-c777eec512cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:36:00.286316 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc1849-ed1e-4079-839b-c777eec512cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:36:00.286702 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc1849-ed1e-4079-839b-c777eec512cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:36:00.287084 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc1849-ed1e-4079-839b-c777eec512cb admin admin] PATH_INFO: `/v3/users/d07d4b34394643e9beeecbf50d5e17c3` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:36:00.288726 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc1849-ed1e-4079-839b-c777eec512cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d07d4b34394643e9beeecbf50d5e17c3)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:36:00.290914 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc1849-ed1e-4079-839b-c777eec512cb admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:36:00.562299 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-20bc1849-ed1e-4079-839b-c777eec512cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd07d4b34394643e9beeecbf50d5e17c3'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:36:00.659741 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-20bc1849-ed1e-4079-839b-c777eec512cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd07d4b34394643e9beeecbf50d5e17c3'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:36:00.698617 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-20bc1849-ed1e-4079-839b-c777eec512cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd07d4b34394643e9beeecbf50d5e17c3'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:36:00.699392 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-20bc1849-ed1e-4079-839b-c777eec512cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd07d4b34394643e9beeecbf50d5e17c3'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:36:00.714215 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-20bc1849-ed1e-4079-839b-c777eec512cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd07d4b34394643e9beeecbf50d5e17c3'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:36:00.722883 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1174/2364] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:36:00 2022] DELETE /identity/v3/users/d07d4b34394643e9beeecbf50d5e17c3 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:36:01.419933 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab93f4b-98de-4d31-922a-88cd58b709f7 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:36:01.419933 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-dab93f4b-98de-4d31-922a-88cd58b709f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:36:01.453001 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab93f4b-98de-4d31-922a-88cd58b709f7 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:36:01.530660 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704cc6d-ed39-4c38-b9ae-a39e6bd00cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:36:01.531711 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704cc6d-ed39-4c38-b9ae-a39e6bd00cfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:36:01.534953 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704cc6d-ed39-4c38-b9ae-a39e6bd00cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:36:01.535334 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704cc6d-ed39-4c38-b9ae-a39e6bd00cfc admin admin] PATH_INFO: `/v3/projects/c90ecce1a52a439781e3604505729caa` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:36:01.540146 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5704cc6d-ed39-4c38-b9ae-a39e6bd00cfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c90ecce1a52a439781e3604505729caa)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:36:01.542097 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5704cc6d-ed39-4c38-b9ae-a39e6bd00cfc admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:36:01.563328 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:36:01.736643 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-5704cc6d-ed39-4c38-b9ae-a39e6bd00cfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c90ecce1a52a439781e3604505729caa', 'request_id': 'req-5704cc6d-ed39-4c38-b9ae-a39e6bd00cfc'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:36:01.745872 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-5704cc6d-ed39-4c38-b9ae-a39e6bd00cfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c90ecce1a52a439781e3604505729caa', 'request_id': 'req-5704cc6d-ed39-4c38-b9ae-a39e6bd00cfc'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:36:01.850979 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-5704cc6d-ed39-4c38-b9ae-a39e6bd00cfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c90ecce1a52a439781e3604505729caa', 'request_id': 'req-5704cc6d-ed39-4c38-b9ae-a39e6bd00cfc'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:36:01.876167 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-5704cc6d-ed39-4c38-b9ae-a39e6bd00cfc admin admin] The token cache is being invalidate because project c90ecce1a52a439781e3604505729caa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:36:01.877789 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-5704cc6d-ed39-4c38-b9ae-a39e6bd00cfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:36:01.879838 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-5704cc6d-ed39-4c38-b9ae-a39e6bd00cfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:36:01.884250 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1191/2365] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:36:01 2022] DELETE /identity/v3/projects/c90ecce1a52a439781e3604505729caa => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:36:01.888844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998c100-2521-4322-a599-2f93988a57f7 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:36:01.889733 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998c100-2521-4322-a599-2f93988a57f7 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:36:01.890184 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998c100-2521-4322-a599-2f93988a57f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:36:01.914692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-6998c100-2521-4322-a599-2f93988a57f7 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:36:01.916268 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-6998c100-2521-4322-a599-2f93988a57f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:36:01.993994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1175/2366] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:36:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:36:02.006736 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827eee82-7ef1-470a-ac06-c2f4a11f25e8 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:36:02.007400 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827eee82-7ef1-470a-ac06-c2f4a11f25e8 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:36:02.007875 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827eee82-7ef1-470a-ac06-c2f4a11f25e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:36:02.047650 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-827eee82-7ef1-470a-ac06-c2f4a11f25e8 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:36:02.049747 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-827eee82-7ef1-470a-ac06-c2f4a11f25e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:36:02.060689 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1192/2367] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:36:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:36:02.073800 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6998c100-2521-4322-a599-2f93988a57f7 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:36:02.088040 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6998c100-2521-4322-a599-2f93988a57f7 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:36:02.094725 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7898c5-36d4-47cc-a836-c543831f5a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:36:02.095997 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7898c5-36d4-47cc-a836-c543831f5a47 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:36:02.095997 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7898c5-36d4-47cc-a836-c543831f5a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:36:02.096431 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7898c5-36d4-47cc-a836-c543831f5a47 admin admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:36:02.097267 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7898c5-36d4-47cc-a836-c543831f5a47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:36:02.097879 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7898c5-36d4-47cc-a836-c543831f5a47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:36:02.099421 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7898c5-36d4-47cc-a836-c543831f5a47 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:36:02.102267 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:36:02.116824 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1176/2368] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:36:02.120804 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827eee82-7ef1-470a-ac06-c2f4a11f25e8 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:36:02.132799 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827eee82-7ef1-470a-ac06-c2f4a11f25e8 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:36:02.141340 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762378a7-4fbd-48a4-8bac-710a7517f8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:36:02.141340 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762378a7-4fbd-48a4-8bac-710a7517f8e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:36:02.142306 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762378a7-4fbd-48a4-8bac-710a7517f8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:36:02.142306 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762378a7-4fbd-48a4-8bac-710a7517f8e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:36:02.142599 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762378a7-4fbd-48a4-8bac-710a7517f8e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:36:02.145473 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762378a7-4fbd-48a4-8bac-710a7517f8e0 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:36:02.224009 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1193/2369] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:36:02 2022] POST /identity/v3/projects => generated 371 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 19:36:02.227604 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7898c5-36d4-47cc-a836-c543831f5a47 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:36:02.239413 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7898c5-36d4-47cc-a836-c543831f5a47 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:36:02.342667 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316eed4d-73f8-4e85-93b4-39f35c626cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:36:02.344382 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316eed4d-73f8-4e85-93b4-39f35c626cba admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:36:02.349168 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316eed4d-73f8-4e85-93b4-39f35c626cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:36:02.349168 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316eed4d-73f8-4e85-93b4-39f35c626cba admin admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:36:02.349168 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316eed4d-73f8-4e85-93b4-39f35c626cba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:36:02.349168 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316eed4d-73f8-4e85-93b4-39f35c626cba admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:36:02.467591 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1177/2370] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:36:02 2022] POST /identity/v3/users => generated 286 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:36:02.471472 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762378a7-4fbd-48a4-8bac-710a7517f8e0 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:36:02.483406 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762378a7-4fbd-48a4-8bac-710a7517f8e0 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:36:02.488360 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b914f-6957-46c4-b592-8e839986fd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:36:02.492744 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b914f-6957-46c4-b592-8e839986fd3a admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:36:02.492744 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b914f-6957-46c4-b592-8e839986fd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:36:02.492744 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b914f-6957-46c4-b592-8e839986fd3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:36:02.492744 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b914f-6957-46c4-b592-8e839986fd3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:36:02.492744 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b914f-6957-46c4-b592-8e839986fd3a admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:36:02.526283 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1194/2371] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:36:02.527555 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316eed4d-73f8-4e85-93b4-39f35c626cba admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:36:02.540863 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316eed4d-73f8-4e85-93b4-39f35c626cba admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:36:02.546142 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332815ad-c80e-41db-bc75-f09405a218db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:36:02.547102 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332815ad-c80e-41db-bc75-f09405a218db admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:36:02.547500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332815ad-c80e-41db-bc75-f09405a218db admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:36:02.547878 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332815ad-c80e-41db-bc75-f09405a218db admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:36:02.548725 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332815ad-c80e-41db-bc75-f09405a218db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:36:02.550739 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332815ad-c80e-41db-bc75-f09405a218db admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:36:02.567567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1178/2372] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 19:36:02.571650 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b914f-6957-46c4-b592-8e839986fd3a admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:36:02.583363 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b914f-6957-46c4-b592-8e839986fd3a admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:36:02.591124 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957c52f-6354-40b7-be1b-f8bf49f5c7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:36:02.592122 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957c52f-6354-40b7-be1b-f8bf49f5c7af admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:36:02.592561 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957c52f-6354-40b7-be1b-f8bf49f5c7af admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:36:02.592952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957c52f-6354-40b7-be1b-f8bf49f5c7af admin admin] PATH_INFO: `/v3/projects/92c1f949ad384b309d62f6eb285fca8f/users/c8efed4da63846d4be0f6198729f3af8/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:36:02.613702 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7957c52f-6354-40b7-be1b-f8bf49f5c7af admin admin] RBAC: Authorizing `identity:create_grant(project_id=92c1f949ad384b309d62f6eb285fca8f, user_id=c8efed4da63846d4be0f6198729f3af8, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:36:02.616867 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7957c52f-6354-40b7-be1b-f8bf49f5c7af admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:36:02.710346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1195/2373] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:36:02 2022] PUT /identity/v3/projects/92c1f949ad384b309d62f6eb285fca8f/users/c8efed4da63846d4be0f6198729f3af8/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:36:02.710869 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580f59a-f474-4c05-ad66-e647d46d22f3 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:36:02.710869 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580f59a-f474-4c05-ad66-e647d46d22f3 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:36:02.710869 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580f59a-f474-4c05-ad66-e647d46d22f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:36:02.747480 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-8580f59a-f474-4c05-ad66-e647d46d22f3 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:36:02.747480 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-8580f59a-f474-4c05-ad66-e647d46d22f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:36:02.853549 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1179/2374] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:36:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:36:02.862250 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957c52f-6354-40b7-be1b-f8bf49f5c7af admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:36:02.872179 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-7957c52f-6354-40b7-be1b-f8bf49f5c7af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:36:02.945377 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957c52f-6354-40b7-be1b-f8bf49f5c7af admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:36:02.950312 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6866443-0517-4dcd-8d52-3379321a1538 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:36:02.951157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6866443-0517-4dcd-8d52-3379321a1538 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:36:02.951633 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6866443-0517-4dcd-8d52-3379321a1538 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:36:02.951915 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6866443-0517-4dcd-8d52-3379321a1538 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:36:02.963311 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6866443-0517-4dcd-8d52-3379321a1538 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:36:02.964981 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6866443-0517-4dcd-8d52-3379321a1538 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:36:02.976082 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1196/2375] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:36:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:36:05.152542 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580f59a-f474-4c05-ad66-e647d46d22f3 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:36:05.158794 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-8580f59a-f474-4c05-ad66-e647d46d22f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:36:05.168427 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580f59a-f474-4c05-ad66-e647d46d22f3 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:36:05.173859 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cecc13-2730-48c3-91b8-947b2d6d62bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:36:05.174941 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cecc13-2730-48c3-91b8-947b2d6d62bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:36:05.175174 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cecc13-2730-48c3-91b8-947b2d6d62bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:36:05.175475 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cecc13-2730-48c3-91b8-947b2d6d62bb admin admin] PATH_INFO: `/v3/users/3b376f8de1ab44b98e8ca5ea6a5cae1d` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:36:05.179877 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cecc13-2730-48c3-91b8-947b2d6d62bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b376f8de1ab44b98e8ca5ea6a5cae1d)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:36:05.180676 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cecc13-2730-48c3-91b8-947b2d6d62bb admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:36:05.261210 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df86604-40cb-42df-acbb-53df0e8da3bb None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:36:05.261821 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df86604-40cb-42df-acbb-53df0e8da3bb None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:36:05.262681 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df86604-40cb-42df-acbb-53df0e8da3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:36:05.322778 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-3df86604-40cb-42df-acbb-53df0e8da3bb None None] MFA Rules not processed for user `c8efed4da63846d4be0f6198729f3af8`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:36:05.324188 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3df86604-40cb-42df-acbb-53df0e8da3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:36:05.383120 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:36:05.454754 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-d1cecc13-2730-48c3-91b8-947b2d6d62bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b376f8de1ab44b98e8ca5ea6a5cae1d'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:36:05.482900 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1197/2376] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:36:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:36:05.492775 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df86604-40cb-42df-acbb-53df0e8da3bb None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:36:05.494330 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3df86604-40cb-42df-acbb-53df0e8da3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:36:05.533587 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-d1cecc13-2730-48c3-91b8-947b2d6d62bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b376f8de1ab44b98e8ca5ea6a5cae1d'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:36:05.554611 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:36:05.556076 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-d1cecc13-2730-48c3-91b8-947b2d6d62bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b376f8de1ab44b98e8ca5ea6a5cae1d'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:36:05.557283 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-d1cecc13-2730-48c3-91b8-947b2d6d62bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b376f8de1ab44b98e8ca5ea6a5cae1d'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:36:05.569706 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-d1cecc13-2730-48c3-91b8-947b2d6d62bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b376f8de1ab44b98e8ca5ea6a5cae1d'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:36:05.587639 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1180/2377] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:36:05 2022] DELETE /identity/v3/users/3b376f8de1ab44b98e8ca5ea6a5cae1d => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:36:05.587862 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df86604-40cb-42df-acbb-53df0e8da3bb None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:36:05.588001 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d133f0b-bdc0-47c7-8e68-30666b0cb6d5 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:36:05.588001 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d133f0b-bdc0-47c7-8e68-30666b0cb6d5 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:36:05.588001 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d133f0b-bdc0-47c7-8e68-30666b0cb6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:36:05.617439 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-3d133f0b-bdc0-47c7-8e68-30666b0cb6d5 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:36:05.619131 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-3d133f0b-bdc0-47c7-8e68-30666b0cb6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:36:05.683463 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40646d-3e32-41da-a528-0d161583d752 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:36:05.684134 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40646d-3e32-41da-a528-0d161583d752 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:36:05.684423 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40646d-3e32-41da-a528-0d161583d752 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:36:05.684706 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40646d-3e32-41da-a528-0d161583d752 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:36:05.692675 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-5e40646d-3e32-41da-a528-0d161583d752 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:36:05.728349 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1181/2378] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:36:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:36:05.735345 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d133f0b-bdc0-47c7-8e68-30666b0cb6d5 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:36:05.736942 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-3d133f0b-bdc0-47c7-8e68-30666b0cb6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:36:05.783504 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e40646d-3e32-41da-a528-0d161583d752 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:36:05.788033 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e40646d-3e32-41da-a528-0d161583d752 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:36:05.798897 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1198/2379] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:36:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 19:36:05.802960 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d133f0b-bdc0-47c7-8e68-30666b0cb6d5 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:36:05.807378 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386dd874-bc18-4e39-a160-0f3cc8209e6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:36:05.808288 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386dd874-bc18-4e39-a160-0f3cc8209e6c service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:36:05.808772 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386dd874-bc18-4e39-a160-0f3cc8209e6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:36:05.809252 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386dd874-bc18-4e39-a160-0f3cc8209e6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:36:05.823344 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386dd874-bc18-4e39-a160-0f3cc8209e6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:36:05.828702 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386dd874-bc18-4e39-a160-0f3cc8209e6c service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:36:05.839501 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1182/2380] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:36:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:36:06.424658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40646d-3e32-41da-a528-0d161583d752 service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:36:06.426119 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-5e40646d-3e32-41da-a528-0d161583d752 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:36:06.461977 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40646d-3e32-41da-a528-0d161583d752 service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:36:06.467384 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d9ba7-c916-4aec-94a0-8d9b6253e569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:36:06.468805 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d9ba7-c916-4aec-94a0-8d9b6253e569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:36:06.469094 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d9ba7-c916-4aec-94a0-8d9b6253e569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:36:06.469365 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d9ba7-c916-4aec-94a0-8d9b6253e569 admin admin] PATH_INFO: `/v3/projects/6de5bd48bf9540eebd868e36f761befa` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:36:06.470760 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40d9ba7-c916-4aec-94a0-8d9b6253e569 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6de5bd48bf9540eebd868e36f761befa)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:36:06.473331 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40d9ba7-c916-4aec-94a0-8d9b6253e569 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:36:06.650355 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:36:06.668395 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c40d9ba7-c916-4aec-94a0-8d9b6253e569 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6de5bd48bf9540eebd868e36f761befa', 'request_id': 'req-c40d9ba7-c916-4aec-94a0-8d9b6253e569'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:36:06.679733 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c40d9ba7-c916-4aec-94a0-8d9b6253e569 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6de5bd48bf9540eebd868e36f761befa', 'request_id': 'req-c40d9ba7-c916-4aec-94a0-8d9b6253e569'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:36:06.765460 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c40d9ba7-c916-4aec-94a0-8d9b6253e569 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6de5bd48bf9540eebd868e36f761befa', 'request_id': 'req-c40d9ba7-c916-4aec-94a0-8d9b6253e569'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:36:06.782068 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c40d9ba7-c916-4aec-94a0-8d9b6253e569 admin admin] The token cache is being invalidate because project 6de5bd48bf9540eebd868e36f761befa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:36:06.782366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c40d9ba7-c916-4aec-94a0-8d9b6253e569 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:36:06.784256 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c40d9ba7-c916-4aec-94a0-8d9b6253e569 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:36:06.785865 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1199/2381] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:36:06 2022] DELETE /identity/v3/projects/6de5bd48bf9540eebd868e36f761befa => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:36:07.825001 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cfe65-77e6-4d3c-a1fd-78fb32b6a708 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:36:07.825546 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cfe65-77e6-4d3c-a1fd-78fb32b6a708 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:36:07.827824 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cfe65-77e6-4d3c-a1fd-78fb32b6a708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:36:07.854478 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-ed5cfe65-77e6-4d3c-a1fd-78fb32b6a708 None None] MFA Rules not processed for user `c8efed4da63846d4be0f6198729f3af8`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:36:07.856407 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-ed5cfe65-77e6-4d3c-a1fd-78fb32b6a708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:36:07.925868 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1183/2382] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:36:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:36:17.029986 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d6ca6-311d-454a-9d29-c6a696185223 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:36:17.030501 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d6ca6-311d-454a-9d29-c6a696185223 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:36:17.030595 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d6ca6-311d-454a-9d29-c6a696185223 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:36:17.032125 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1200/2383] 10.222.0.60 () {54 vars in 921 bytes} [Thu Jul 21 19:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:36:17.038200 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860902a-7f64-4d0a-a839-e1f759e442bd None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:36:17.038639 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860902a-7f64-4d0a-a839-e1f759e442bd None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:36:17.038785 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860902a-7f64-4d0a-a839-e1f759e442bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:36:17.058013 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-8860902a-7f64-4d0a-a839-e1f759e442bd None None] MFA Rules not processed for user `6b4d98e967814e5f84f5f0d67ebb3c17`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:36:17.059289 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-8860902a-7f64-4d0a-a839-e1f759e442bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:36:17.091301 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:36:17.129213 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1184/2384] 10.222.0.60 () {58 vars in 1018 bytes} [Thu Jul 21 19:36:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:36:17.140832 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d6ca6-311d-454a-9d29-c6a696185223 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:36:17.142617 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-648d6ca6-311d-454a-9d29-c6a696185223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:36:17.201006 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d6ca6-311d-454a-9d29-c6a696185223 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:36:17.204888 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7c178-fad1-4983-ad9b-41e8c34b3934 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a23a8e608f94d5d8153dcf7e79250f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:36:17.205553 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7c178-fad1-4983-ad9b-41e8c34b3934 service glance] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:36:17.205875 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7c178-fad1-4983-ad9b-41e8c34b3934 service glance] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:36:17.206154 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7c178-fad1-4983-ad9b-41e8c34b3934 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:36:17.216833 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7c178-fad1-4983-ad9b-41e8c34b3934 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:36:17.218318 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7c178-fad1-4983-ad9b-41e8c34b3934 service glance] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:36:17.229063 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1201/2385] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:36:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:36:17.463670 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09edc8ff-bb85-4f24-bea3-d7c89a2cb9e6 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:36:17.463968 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09edc8ff-bb85-4f24-bea3-d7c89a2cb9e6 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:36:17.464253 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09edc8ff-bb85-4f24-bea3-d7c89a2cb9e6 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:36:17.465712 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1185/2386] 10.222.0.60 () {54 vars in 921 bytes} [Thu Jul 21 19:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:36:17.471578 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5b3d7-d552-47ca-a046-e694d5856b9e None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:36:17.471864 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5b3d7-d552-47ca-a046-e694d5856b9e None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:36:17.472138 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5b3d7-d552-47ca-a046-e694d5856b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:36:17.491251 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-4fd5b3d7-d552-47ca-a046-e694d5856b9e None None] MFA Rules not processed for user `b1908b2f87d5442da8ba826489cb2018`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:36:17.492486 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-4fd5b3d7-d552-47ca-a046-e694d5856b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:36:17.541899 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1202/2387] 10.222.0.60 () {58 vars in 1018 bytes} [Thu Jul 21 19:36:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:36:17.554554 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09edc8ff-bb85-4f24-bea3-d7c89a2cb9e6 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:36:17.556257 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-09edc8ff-bb85-4f24-bea3-d7c89a2cb9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:36:17.569725 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09edc8ff-bb85-4f24-bea3-d7c89a2cb9e6 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:36:17.573283 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac5b00-b7d3-4831-b4c2-148f84f4a897 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:36:17.573916 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac5b00-b7d3-4831-b4c2-148f84f4a897 service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:36:17.574200 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac5b00-b7d3-4831-b4c2-148f84f4a897 service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:36:17.574479 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac5b00-b7d3-4831-b4c2-148f84f4a897 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:36:17.581363 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bac5b00-b7d3-4831-b4c2-148f84f4a897 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:36:17.582768 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bac5b00-b7d3-4831-b4c2-148f84f4a897 service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:36:17.590453 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1186/2388] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:36:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:36:17.706884 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0b86c-f5d4-4ef9-8dc0-1bb6d2b2c253 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:36:17.707179 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0b86c-f5d4-4ef9-8dc0-1bb6d2b2c253 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:36:17.707486 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0b86c-f5d4-4ef9-8dc0-1bb6d2b2c253 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:36:17.708919 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1203/2389] 10.222.0.60 () {54 vars in 921 bytes} [Thu Jul 21 19:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:36:17.714184 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470529d-b428-4ed6-a52c-3b40a83b0d3e None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:36:17.714475 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470529d-b428-4ed6-a52c-3b40a83b0d3e None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:36:17.714755 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470529d-b428-4ed6-a52c-3b40a83b0d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:36:17.736227 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-6470529d-b428-4ed6-a52c-3b40a83b0d3e None None] MFA Rules not processed for user `6b4d98e967814e5f84f5f0d67ebb3c17`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:36:17.737421 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-6470529d-b428-4ed6-a52c-3b40a83b0d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:36:17.746532 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1187/2390] 10.222.0.60 () {58 vars in 1018 bytes} [Thu Jul 21 19:36:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:36:17.756987 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0b86c-f5d4-4ef9-8dc0-1bb6d2b2c253 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:36:17.767902 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0b86c-f5d4-4ef9-8dc0-1bb6d2b2c253 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:36:17.771664 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c5d3e-f082-4762-b082-eecbc4fc4703 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:36:17.772301 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c5d3e-f082-4762-b082-eecbc4fc4703 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:36:17.772585 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c5d3e-f082-4762-b082-eecbc4fc4703 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:36:17.772860 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c5d3e-f082-4762-b082-eecbc4fc4703 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:36:17.783750 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c5d3e-f082-4762-b082-eecbc4fc4703 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:36:17.785170 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c5d3e-f082-4762-b082-eecbc4fc4703 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:36:17.796461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1204/2391] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:36:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:36:21.230642 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872f248-bf79-4fea-a26b-5786af81c0b5 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:36:21.231125 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872f248-bf79-4fea-a26b-5786af81c0b5 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:36:21.231221 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872f248-bf79-4fea-a26b-5786af81c0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:36:21.249377 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-9872f248-bf79-4fea-a26b-5786af81c0b5 None None] MFA Rules not processed for user `22d11b8e390e4b9db3b84c419266c4b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:36:21.250570 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-9872f248-bf79-4fea-a26b-5786af81c0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:36:21.307124 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1188/2392] 10.222.0.60 () {58 vars in 1009 bytes} [Thu Jul 21 19:36:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:36:21.319785 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c5d3e-f082-4762-b082-eecbc4fc4703 service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:36:21.321200 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-4e6c5d3e-f082-4762-b082-eecbc4fc4703 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:36:21.376704 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:36:21.390763 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c5d3e-f082-4762-b082-eecbc4fc4703 service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:36:21.395889 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f246178e-560f-4d20-993a-928d846a2fb1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa579af53a6441a9205cf82864a640e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:36:21.396569 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246178e-560f-4d20-993a-928d846a2fb1 service swift] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:36:21.396854 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246178e-560f-4d20-993a-928d846a2fb1 service swift] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:36:21.397133 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246178e-560f-4d20-993a-928d846a2fb1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:36:21.405155 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f246178e-560f-4d20-993a-928d846a2fb1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:36:21.406791 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f246178e-560f-4d20-993a-928d846a2fb1 service swift] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:36:21.415185 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1205/2393] 10.222.0.60 () {60 vars in 1384 bytes} [Thu Jul 21 19:36:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 19:36:31.300301 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=49 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:36:31.478352 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=6 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:36:39.411109 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8966420-2a6f-40da-8fed-79f5b43f881d None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:36:39.411622 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8966420-2a6f-40da-8fed-79f5b43f881d None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:36:39.411726 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8966420-2a6f-40da-8fed-79f5b43f881d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:36:39.431310 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-c8966420-2a6f-40da-8fed-79f5b43f881d None None] MFA Rules not processed for user `22d11b8e390e4b9db3b84c419266c4b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:36:39.434950 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-c8966420-2a6f-40da-8fed-79f5b43f881d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:36:39.440681 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1189/2394] 10.222.0.60 () {58 vars in 967 bytes} [Thu Jul 21 19:36:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:36:39.453972 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f246178e-560f-4d20-993a-928d846a2fb1 service swift] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:36:39.464481 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f246178e-560f-4d20-993a-928d846a2fb1 service swift] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:36:39.469603 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561b04c-6b2b-4027-8127-3d9cb73701ff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa579af53a6441a9205cf82864a640e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:36:39.470228 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561b04c-6b2b-4027-8127-3d9cb73701ff service swift] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:36:39.470510 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561b04c-6b2b-4027-8127-3d9cb73701ff service swift] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:36:39.470783 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561b04c-6b2b-4027-8127-3d9cb73701ff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:36:39.478659 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561b04c-6b2b-4027-8127-3d9cb73701ff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:36:39.480333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561b04c-6b2b-4027-8127-3d9cb73701ff service swift] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:36:39.488630 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1206/2395] 10.222.0.60 () {60 vars in 1384 bytes} [Thu Jul 21 19:36:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 19:36:40.418475 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac589d-772a-43e1-a8ae-c1ef82e0f244 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:36:40.419080 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac589d-772a-43e1-a8ae-c1ef82e0f244 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:36:40.419080 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac589d-772a-43e1-a8ae-c1ef82e0f244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:36:40.441810 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-6bac589d-772a-43e1-a8ae-c1ef82e0f244 None None] MFA Rules not processed for user `c8efed4da63846d4be0f6198729f3af8`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:36:40.443008 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-6bac589d-772a-43e1-a8ae-c1ef82e0f244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:36:40.449915 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1190/2396] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:36:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:36:42.123061 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561b04c-6b2b-4027-8127-3d9cb73701ff service swift] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:36:42.124684 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-9561b04c-6b2b-4027-8127-3d9cb73701ff service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:36:42.202463 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561b04c-6b2b-4027-8127-3d9cb73701ff service swift] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:36:42.207834 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0478c80a-d660-4ab0-8725-30b69d6ac736 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcc5eefc2f7c419190e96b46b163fedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:36:42.208487 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478c80a-d660-4ab0-8725-30b69d6ac736 service placement] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:36:42.208785 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478c80a-d660-4ab0-8725-30b69d6ac736 service placement] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:36:42.209139 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478c80a-d660-4ab0-8725-30b69d6ac736 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:36:42.210923 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-0478c80a-d660-4ab0-8725-30b69d6ac736 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:36:42.223148 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0478c80a-d660-4ab0-8725-30b69d6ac736 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:36:42.224780 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0478c80a-d660-4ab0-8725-30b69d6ac736 service placement] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:36:42.236414 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1207/2397] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:36:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:36:50.436386 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=6 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:36:52.231800 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=38 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:37:01.871981 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63f453-4465-426c-8609-24d5a57693b6 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:37:01.872502 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63f453-4465-426c-8609-24d5a57693b6 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:37:01.872601 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63f453-4465-426c-8609-24d5a57693b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:37:01.890320 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-6e63f453-4465-426c-8609-24d5a57693b6 None None] MFA Rules not processed for user `22d11b8e390e4b9db3b84c419266c4b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:37:01.891541 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-6e63f453-4465-426c-8609-24d5a57693b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:37:01.898514 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1191/2398] 10.222.0.60 () {58 vars in 1009 bytes} [Thu Jul 21 19:37:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:37:01.920511 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0478c80a-d660-4ab0-8725-30b69d6ac736 service placement] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:37:01.932444 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0478c80a-d660-4ab0-8725-30b69d6ac736 service placement] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:37:01.937450 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e2ab2-f3d8-4c89-8bec-e8aca207b1c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa579af53a6441a9205cf82864a640e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:37:01.938085 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e2ab2-f3d8-4c89-8bec-e8aca207b1c3 service swift] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:37:01.938371 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e2ab2-f3d8-4c89-8bec-e8aca207b1c3 service swift] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:37:01.938649 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e2ab2-f3d8-4c89-8bec-e8aca207b1c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:37:01.946998 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e2ab2-f3d8-4c89-8bec-e8aca207b1c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:37:01.948654 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e2ab2-f3d8-4c89-8bec-e8aca207b1c3 service swift] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:37:01.956835 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1208/2399] 10.222.0.60 () {60 vars in 1384 bytes} [Thu Jul 21 19:37:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 19:37:11.885119 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=3 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:37:11.953676 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=6 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:37:13.647882 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89337477-32b2-4269-9ee6-421626c05c42 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:37:13.648475 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89337477-32b2-4269-9ee6-421626c05c42 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:37:13.648475 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89337477-32b2-4269-9ee6-421626c05c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:37:13.669405 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-89337477-32b2-4269-9ee6-421626c05c42 None None] MFA Rules not processed for user `d9f276efb89f4e869e7c58b2c492a0f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:37:13.670719 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-89337477-32b2-4269-9ee6-421626c05c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:37:13.732549 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1192/2400] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:37:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:37:18.537437 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5c186-aa62-433a-acea-f3fff5791ebc None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:37:18.537920 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5c186-aa62-433a-acea-f3fff5791ebc None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:37:18.538026 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5c186-aa62-433a-acea-f3fff5791ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:37:18.556080 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-76f5c186-aa62-433a-acea-f3fff5791ebc None None] MFA Rules not processed for user `22d11b8e390e4b9db3b84c419266c4b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:37:18.557325 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-76f5c186-aa62-433a-acea-f3fff5791ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:37:18.565646 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1209/2401] 10.222.0.60 () {58 vars in 967 bytes} [Thu Jul 21 19:37:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:37:18.578523 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89337477-32b2-4269-9ee6-421626c05c42 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:37:18.590410 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89337477-32b2-4269-9ee6-421626c05c42 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:37:18.595532 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0dc7bb-cfc6-42d6-824c-a968ef374305 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa579af53a6441a9205cf82864a640e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:37:18.596212 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0dc7bb-cfc6-42d6-824c-a968ef374305 service swift] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:37:18.596538 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0dc7bb-cfc6-42d6-824c-a968ef374305 service swift] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:37:18.596778 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0dc7bb-cfc6-42d6-824c-a968ef374305 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:37:18.604785 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0dc7bb-cfc6-42d6-824c-a968ef374305 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:37:18.606355 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0dc7bb-cfc6-42d6-824c-a968ef374305 service swift] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:37:18.615182 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1193/2402] 10.222.0.60 () {60 vars in 1384 bytes} [Thu Jul 21 19:37:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 19:37:21.746182 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f5c186-aa62-433a-acea-f3fff5791ebc None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:37:21.747853 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-76f5c186-aa62-433a-acea-f3fff5791ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:37:21.837870 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f5c186-aa62-433a-acea-f3fff5791ebc None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:37:21.842718 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05baeb0f-e9ea-4fcb-ac45-9f3d3aa6afda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:37:21.843714 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05baeb0f-e9ea-4fcb-ac45-9f3d3aa6afda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:37:21.844185 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05baeb0f-e9ea-4fcb-ac45-9f3d3aa6afda admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:37:21.844542 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05baeb0f-e9ea-4fcb-ac45-9f3d3aa6afda admin admin] PATH_INFO: `/v3/users/c8efed4da63846d4be0f6198729f3af8` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:37:21.846010 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05baeb0f-e9ea-4fcb-ac45-9f3d3aa6afda admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8efed4da63846d4be0f6198729f3af8)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:37:21.848060 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05baeb0f-e9ea-4fcb-ac45-9f3d3aa6afda admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:37:22.057730 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-05baeb0f-e9ea-4fcb-ac45-9f3d3aa6afda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8efed4da63846d4be0f6198729f3af8'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:37:22.121061 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-05baeb0f-e9ea-4fcb-ac45-9f3d3aa6afda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8efed4da63846d4be0f6198729f3af8'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:37:22.121699 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-05baeb0f-e9ea-4fcb-ac45-9f3d3aa6afda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8efed4da63846d4be0f6198729f3af8'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:37:22.129300 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-05baeb0f-e9ea-4fcb-ac45-9f3d3aa6afda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8efed4da63846d4be0f6198729f3af8'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:37:22.141587 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-05baeb0f-e9ea-4fcb-ac45-9f3d3aa6afda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8efed4da63846d4be0f6198729f3af8'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:37:22.147725 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1210/2403] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:37:21 2022] DELETE /identity/v3/users/c8efed4da63846d4be0f6198729f3af8 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:37:22.387724 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0dc7bb-cfc6-42d6-824c-a968ef374305 service swift] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:37:22.395985 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0dc7bb-cfc6-42d6-824c-a968ef374305 service swift] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:37:22.458035 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced4d02-e56a-4685-948a-0971c109d49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:37:22.459019 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced4d02-e56a-4685-948a-0971c109d49f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:37:22.459308 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced4d02-e56a-4685-948a-0971c109d49f admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:37:22.460017 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced4d02-e56a-4685-948a-0971c109d49f admin admin] PATH_INFO: `/v3/projects/92c1f949ad384b309d62f6eb285fca8f` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:37:22.460891 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bced4d02-e56a-4685-948a-0971c109d49f admin admin] RBAC: Authorizing `identity:delete_project(project_id=92c1f949ad384b309d62f6eb285fca8f)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:37:22.462806 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bced4d02-e56a-4685-948a-0971c109d49f admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:37:22.564094 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-bced4d02-e56a-4685-948a-0971c109d49f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92c1f949ad384b309d62f6eb285fca8f', 'request_id': 'req-bced4d02-e56a-4685-948a-0971c109d49f'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:37:22.637460 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-bced4d02-e56a-4685-948a-0971c109d49f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92c1f949ad384b309d62f6eb285fca8f', 'request_id': 'req-bced4d02-e56a-4685-948a-0971c109d49f'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:37:22.643237 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-bced4d02-e56a-4685-948a-0971c109d49f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92c1f949ad384b309d62f6eb285fca8f', 'request_id': 'req-bced4d02-e56a-4685-948a-0971c109d49f'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:37:22.654125 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-bced4d02-e56a-4685-948a-0971c109d49f admin admin] The token cache is being invalidate because project 92c1f949ad384b309d62f6eb285fca8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:37:22.654407 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-bced4d02-e56a-4685-948a-0971c109d49f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:37:22.655574 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-bced4d02-e56a-4685-948a-0971c109d49f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:37:22.657175 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1194/2404] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:37:22 2022] DELETE /identity/v3/projects/92c1f949ad384b309d62f6eb285fca8f => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:37:22.662055 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a989349-32e4-46fd-b399-2040603a5688 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:37:22.662343 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a989349-32e4-46fd-b399-2040603a5688 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:37:22.662619 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a989349-32e4-46fd-b399-2040603a5688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:37:22.680463 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-5a989349-32e4-46fd-b399-2040603a5688 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:37:22.681651 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-5a989349-32e4-46fd-b399-2040603a5688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:37:22.740713 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1211/2405] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:37:22.748766 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f064786-2242-496c-8039-516c38ea760d None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:37:22.749064 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f064786-2242-496c-8039-516c38ea760d None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:37:22.749346 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f064786-2242-496c-8039-516c38ea760d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:37:22.767262 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-8f064786-2242-496c-8039-516c38ea760d None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:37:22.768491 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-8f064786-2242-496c-8039-516c38ea760d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:37:22.776317 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1195/2406] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:37:22.781004 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a989349-32e4-46fd-b399-2040603a5688 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:37:22.790795 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a989349-32e4-46fd-b399-2040603a5688 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:37:22.795698 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af46d29-3438-480b-bc73-38f84fdc00c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:37:22.796111 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af46d29-3438-480b-bc73-38f84fdc00c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:37:22.796397 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af46d29-3438-480b-bc73-38f84fdc00c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:37:22.796674 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af46d29-3438-480b-bc73-38f84fdc00c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:37:22.797398 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af46d29-3438-480b-bc73-38f84fdc00c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:37:22.797706 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af46d29-3438-480b-bc73-38f84fdc00c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:37:22.799313 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af46d29-3438-480b-bc73-38f84fdc00c4 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:37:22.808089 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:37:22.811811 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1212/2407] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:37:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:37:22.816164 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f064786-2242-496c-8039-516c38ea760d None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:37:22.825524 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f064786-2242-496c-8039-516c38ea760d None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:37:22.831199 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e840098-8a56-4cb6-8727-4ae729affb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:37:22.831892 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e840098-8a56-4cb6-8727-4ae729affb47 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:37:22.832178 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e840098-8a56-4cb6-8727-4ae729affb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:37:22.832453 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e840098-8a56-4cb6-8727-4ae729affb47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:37:22.833139 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e840098-8a56-4cb6-8727-4ae729affb47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:37:22.835026 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e840098-8a56-4cb6-8727-4ae729affb47 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:37:22.848398 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:37:22.918742 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1196/2408] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:37:22 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:37:22.922865 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af46d29-3438-480b-bc73-38f84fdc00c4 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:37:22.932922 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af46d29-3438-480b-bc73-38f84fdc00c4 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:37:22.991837 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb6686-31ff-48d0-b32c-34facbac3f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:37:22.992503 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb6686-31ff-48d0-b32c-34facbac3f50 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:37:22.992790 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb6686-31ff-48d0-b32c-34facbac3f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:37:22.993068 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb6686-31ff-48d0-b32c-34facbac3f50 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:37:22.993747 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddb6686-31ff-48d0-b32c-34facbac3f50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:37:22.995711 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddb6686-31ff-48d0-b32c-34facbac3f50 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:37:23.070001 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1213/2409] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:37:22 2022] POST /identity/v3/users => generated 287 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:37:23.074041 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e840098-8a56-4cb6-8727-4ae729affb47 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:37:23.084650 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e840098-8a56-4cb6-8727-4ae729affb47 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:37:23.089368 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ff628-1712-4ed3-9043-4c24e3b91867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:37:23.090026 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ff628-1712-4ed3-9043-4c24e3b91867 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:37:23.090316 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ff628-1712-4ed3-9043-4c24e3b91867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:37:23.090596 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ff628-1712-4ed3-9043-4c24e3b91867 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:37:23.091323 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ff628-1712-4ed3-9043-4c24e3b91867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:37:23.092977 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ff628-1712-4ed3-9043-4c24e3b91867 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:37:23.103192 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1197/2410] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:37:23.113963 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb6686-31ff-48d0-b32c-34facbac3f50 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:37:23.124778 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb6686-31ff-48d0-b32c-34facbac3f50 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:37:23.129451 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf18e0b-2e78-4507-8107-f69ae7ae40ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:37:23.130105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf18e0b-2e78-4507-8107-f69ae7ae40ec admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:37:23.130393 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf18e0b-2e78-4507-8107-f69ae7ae40ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:37:23.130672 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf18e0b-2e78-4507-8107-f69ae7ae40ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:37:23.131395 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf18e0b-2e78-4507-8107-f69ae7ae40ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:37:23.133006 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf18e0b-2e78-4507-8107-f69ae7ae40ec admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:37:23.143074 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1214/2411] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:37:23.147120 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ff628-1712-4ed3-9043-4c24e3b91867 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:37:23.157585 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ff628-1712-4ed3-9043-4c24e3b91867 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:37:23.162469 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8fbcc6-6800-4a03-9af4-b30644b201e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:37:23.163370 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fbcc6-6800-4a03-9af4-b30644b201e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:37:23.163698 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fbcc6-6800-4a03-9af4-b30644b201e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:37:23.163975 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fbcc6-6800-4a03-9af4-b30644b201e1 admin admin] PATH_INFO: `/v3/projects/15c07905f8f4493eabb207270b8c3352/users/eed35c6ee67d4a498b8dc2c6d39f11f2/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:37:23.179090 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8fbcc6-6800-4a03-9af4-b30644b201e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15c07905f8f4493eabb207270b8c3352, user_id=eed35c6ee67d4a498b8dc2c6d39f11f2, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:37:23.181741 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8fbcc6-6800-4a03-9af4-b30644b201e1 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:37:23.249374 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1198/2412] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:37:23 2022] PUT /identity/v3/projects/15c07905f8f4493eabb207270b8c3352/users/eed35c6ee67d4a498b8dc2c6d39f11f2/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:37:23.259471 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff44d94-dfb7-481e-9837-3763b3464af9 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:37:23.259759 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff44d94-dfb7-481e-9837-3763b3464af9 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:37:23.260062 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff44d94-dfb7-481e-9837-3763b3464af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:37:23.288374 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-6ff44d94-dfb7-481e-9837-3763b3464af9 None None] MFA Rules not processed for user `eed35c6ee67d4a498b8dc2c6d39f11f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:37:23.289664 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-6ff44d94-dfb7-481e-9837-3763b3464af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:37:23.356791 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1215/2413] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:37:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:37:23.368971 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8fbcc6-6800-4a03-9af4-b30644b201e1 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:37:23.370527 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-6d8fbcc6-6800-4a03-9af4-b30644b201e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:37:23.444206 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8fbcc6-6800-4a03-9af4-b30644b201e1 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:37:23.444206 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c3614-ec0d-4d77-bbbf-0db0c242353b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:37:23.444206 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c3614-ec0d-4d77-bbbf-0db0c242353b service cinder] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:37:23.444206 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c3614-ec0d-4d77-bbbf-0db0c242353b service cinder] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:37:23.445010 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c3614-ec0d-4d77-bbbf-0db0c242353b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:37:23.449552 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c3614-ec0d-4d77-bbbf-0db0c242353b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:37:23.450975 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c3614-ec0d-4d77-bbbf-0db0c242353b service cinder] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:37:23.460318 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1199/2414] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:37:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:37:23.486506 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff44d94-dfb7-481e-9837-3763b3464af9 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:37:23.548848 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff44d94-dfb7-481e-9837-3763b3464af9 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:37:23.553315 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0bfde-db6d-4828-90f2-82dccde56528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:37:23.554174 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0bfde-db6d-4828-90f2-82dccde56528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:37:23.554456 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0bfde-db6d-4828-90f2-82dccde56528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:37:23.554736 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0bfde-db6d-4828-90f2-82dccde56528 admin admin] PATH_INFO: `/v3/users/eed35c6ee67d4a498b8dc2c6d39f11f2` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:37:23.555935 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a0bfde-db6d-4828-90f2-82dccde56528 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eed35c6ee67d4a498b8dc2c6d39f11f2)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:37:23.557844 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a0bfde-db6d-4828-90f2-82dccde56528 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:37:23.568316 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:37:23.751295 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-67a0bfde-db6d-4828-90f2-82dccde56528 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eed35c6ee67d4a498b8dc2c6d39f11f2'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:37:23.812607 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-67a0bfde-db6d-4828-90f2-82dccde56528 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eed35c6ee67d4a498b8dc2c6d39f11f2'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:37:23.813277 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-67a0bfde-db6d-4828-90f2-82dccde56528 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eed35c6ee67d4a498b8dc2c6d39f11f2'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:37:23.821556 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-67a0bfde-db6d-4828-90f2-82dccde56528 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eed35c6ee67d4a498b8dc2c6d39f11f2'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:37:23.834514 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-67a0bfde-db6d-4828-90f2-82dccde56528 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eed35c6ee67d4a498b8dc2c6d39f11f2'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:37:23.840914 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1216/2415] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:37:23 2022] DELETE /identity/v3/users/eed35c6ee67d4a498b8dc2c6d39f11f2 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:37:23.845770 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf037f6-6437-46cd-bc73-a178eebb797e None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:37:23.846127 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf037f6-6437-46cd-bc73-a178eebb797e None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:37:23.846474 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf037f6-6437-46cd-bc73-a178eebb797e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:37:23.864531 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-2cf037f6-6437-46cd-bc73-a178eebb797e None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:37:23.866986 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-2cf037f6-6437-46cd-bc73-a178eebb797e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:37:23.925387 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1200/2416] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:37:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:37:23.934877 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0bfde-db6d-4828-90f2-82dccde56528 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:37:23.936342 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-67a0bfde-db6d-4828-90f2-82dccde56528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:37:23.994732 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0bfde-db6d-4828-90f2-82dccde56528 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:37:23.999170 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63a5b9-ab69-4853-8b7b-5985049f9238 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:37:23.999878 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63a5b9-ab69-4853-8b7b-5985049f9238 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:37:24.000167 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63a5b9-ab69-4853-8b7b-5985049f9238 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:37:24.000448 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63a5b9-ab69-4853-8b7b-5985049f9238 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:37:24.009843 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63a5b9-ab69-4853-8b7b-5985049f9238 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:37:24.011230 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63a5b9-ab69-4853-8b7b-5985049f9238 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:37:24.021836 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1217/2417] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:37:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:37:24.422453 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf037f6-6437-46cd-bc73-a178eebb797e None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:37:24.423948 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-2cf037f6-6437-46cd-bc73-a178eebb797e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:37:24.436599 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf037f6-6437-46cd-bc73-a178eebb797e None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:37:24.441344 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea2fcf-347b-493a-9331-5dc152e0ba4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:37:24.442467 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea2fcf-347b-493a-9331-5dc152e0ba4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:37:24.442752 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea2fcf-347b-493a-9331-5dc152e0ba4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:37:24.443028 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea2fcf-347b-493a-9331-5dc152e0ba4c admin admin] PATH_INFO: `/v3/projects/15c07905f8f4493eabb207270b8c3352` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:37:24.444271 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea2fcf-347b-493a-9331-5dc152e0ba4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=15c07905f8f4493eabb207270b8c3352)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:37:24.446271 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea2fcf-347b-493a-9331-5dc152e0ba4c admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:37:24.595301 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-7eea2fcf-347b-493a-9331-5dc152e0ba4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15c07905f8f4493eabb207270b8c3352', 'request_id': 'req-7eea2fcf-347b-493a-9331-5dc152e0ba4c'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:37:24.678000 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-7eea2fcf-347b-493a-9331-5dc152e0ba4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15c07905f8f4493eabb207270b8c3352', 'request_id': 'req-7eea2fcf-347b-493a-9331-5dc152e0ba4c'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:37:24.679679 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:INSERT=3,keystone:SELECT=92,keystone:DELETE=5 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:37:24.685041 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-7eea2fcf-347b-493a-9331-5dc152e0ba4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15c07905f8f4493eabb207270b8c3352', 'request_id': 'req-7eea2fcf-347b-493a-9331-5dc152e0ba4c'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:37:24.697525 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-7eea2fcf-347b-493a-9331-5dc152e0ba4c admin admin] The token cache is being invalidate because project 15c07905f8f4493eabb207270b8c3352 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:37:24.697819 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-7eea2fcf-347b-493a-9331-5dc152e0ba4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:37:24.698561 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-7eea2fcf-347b-493a-9331-5dc152e0ba4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:37:24.710269 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1201/2418] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:37:24 2022] DELETE /identity/v3/projects/15c07905f8f4493eabb207270b8c3352 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:37:30.073553 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ea46b-28cb-4025-80bd-b8b026cb282d None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:37:30.074096 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ea46b-28cb-4025-80bd-b8b026cb282d None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:37:30.074096 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ea46b-28cb-4025-80bd-b8b026cb282d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:37:30.091030 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-1e2ea46b-28cb-4025-80bd-b8b026cb282d None None] MFA Rules not processed for user `42b8bcddb4a24befbad0a5f4ac7ad925`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:37:30.092721 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-1e2ea46b-28cb-4025-80bd-b8b026cb282d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:37:30.147701 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1218/2419] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:37:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:37:35.120949 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:DELETE=2,keystone:SELECT=5 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:37:40.141187 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:DELETE=10,keystone:SELECT=73,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:37:44.679730 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f3964-07bc-4e80-b48e-e126adff78f4 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:37:44.680221 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f3964-07bc-4e80-b48e-e126adff78f4 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:37:44.680329 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f3964-07bc-4e80-b48e-e126adff78f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:37:44.698650 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-db7f3964-07bc-4e80-b48e-e126adff78f4 None None] MFA Rules not processed for user `44076ea4ef504e6a957e84dcb83c5d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:37:44.699942 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-db7f3964-07bc-4e80-b48e-e126adff78f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:37:44.757352 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1202/2420] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:37:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:37:54.750545 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=25 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:38:16.494258 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ea46b-28cb-4025-80bd-b8b026cb282d None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:38:16.495778 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-1e2ea46b-28cb-4025-80bd-b8b026cb282d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:38:16.562786 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ea46b-28cb-4025-80bd-b8b026cb282d None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:38:16.567556 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4accb493-d91c-4390-989e-6f1484cdb349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:38:16.568424 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4accb493-d91c-4390-989e-6f1484cdb349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:38:16.568708 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4accb493-d91c-4390-989e-6f1484cdb349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:38:16.568982 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4accb493-d91c-4390-989e-6f1484cdb349 admin admin] PATH_INFO: `/v3/users/d9f276efb89f4e869e7c58b2c492a0f0` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:38:16.570161 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4accb493-d91c-4390-989e-6f1484cdb349 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9f276efb89f4e869e7c58b2c492a0f0)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:38:16.572149 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4accb493-d91c-4390-989e-6f1484cdb349 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:38:16.739356 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-4accb493-d91c-4390-989e-6f1484cdb349 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9f276efb89f4e869e7c58b2c492a0f0'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:38:16.802488 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-4accb493-d91c-4390-989e-6f1484cdb349 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9f276efb89f4e869e7c58b2c492a0f0'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:38:16.803090 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-4accb493-d91c-4390-989e-6f1484cdb349 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9f276efb89f4e869e7c58b2c492a0f0'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:38:16.811160 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-4accb493-d91c-4390-989e-6f1484cdb349 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9f276efb89f4e869e7c58b2c492a0f0'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:38:16.823531 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-4accb493-d91c-4390-989e-6f1484cdb349 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9f276efb89f4e869e7c58b2c492a0f0'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:38:16.830409 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1219/2421] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:38:16 2022] DELETE /identity/v3/users/d9f276efb89f4e869e7c58b2c492a0f0 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:38:17.105083 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f3964-07bc-4e80-b48e-e126adff78f4 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:38:17.128243 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f3964-07bc-4e80-b48e-e126adff78f4 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:38:17.196766 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e85026-4109-4b3a-8ca7-9ec6cd627115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:38:17.197942 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e85026-4109-4b3a-8ca7-9ec6cd627115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:38:17.198538 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e85026-4109-4b3a-8ca7-9ec6cd627115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:38:17.198919 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e85026-4109-4b3a-8ca7-9ec6cd627115 admin admin] PATH_INFO: `/v3/projects/8661e778c49a4a34963e5d6c48b72797` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:38:17.200814 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e85026-4109-4b3a-8ca7-9ec6cd627115 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8661e778c49a4a34963e5d6c48b72797)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:38:17.202768 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e85026-4109-4b3a-8ca7-9ec6cd627115 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:38:17.308659 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-02e85026-4109-4b3a-8ca7-9ec6cd627115 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8661e778c49a4a34963e5d6c48b72797', 'request_id': 'req-02e85026-4109-4b3a-8ca7-9ec6cd627115'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:38:17.379475 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-02e85026-4109-4b3a-8ca7-9ec6cd627115 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8661e778c49a4a34963e5d6c48b72797', 'request_id': 'req-02e85026-4109-4b3a-8ca7-9ec6cd627115'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:38:17.385136 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-02e85026-4109-4b3a-8ca7-9ec6cd627115 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8661e778c49a4a34963e5d6c48b72797', 'request_id': 'req-02e85026-4109-4b3a-8ca7-9ec6cd627115'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:38:17.396219 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-02e85026-4109-4b3a-8ca7-9ec6cd627115 admin admin] The token cache is being invalidate because project 8661e778c49a4a34963e5d6c48b72797 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:38:17.402195 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-02e85026-4109-4b3a-8ca7-9ec6cd627115 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:38:17.402195 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-02e85026-4109-4b3a-8ca7-9ec6cd627115 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:38:17.402195 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1203/2422] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:38:17 2022] DELETE /identity/v3/projects/8661e778c49a4a34963e5d6c48b72797 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:38:17.404645 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fab684-b762-46ae-9b66-2f97f82a833f None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:38:17.404939 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fab684-b762-46ae-9b66-2f97f82a833f None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:38:17.405220 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fab684-b762-46ae-9b66-2f97f82a833f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:38:17.423855 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-39fab684-b762-46ae-9b66-2f97f82a833f None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:38:17.428539 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-39fab684-b762-46ae-9b66-2f97f82a833f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:38:17.487736 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1220/2423] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:38:17.495374 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4f5ae-93f1-4c98-af46-8f422a160d4c None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:38:17.495705 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4f5ae-93f1-4c98-af46-8f422a160d4c None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:38:17.495987 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4f5ae-93f1-4c98-af46-8f422a160d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:38:17.514060 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-fab4f5ae-93f1-4c98-af46-8f422a160d4c None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:38:17.515258 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-fab4f5ae-93f1-4c98-af46-8f422a160d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:38:17.523127 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1204/2424] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:38:17.527305 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fab684-b762-46ae-9b66-2f97f82a833f None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:38:17.537922 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fab684-b762-46ae-9b66-2f97f82a833f None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:38:17.542690 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e923a-4d33-429e-b344-d8f6704945f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:38:17.543387 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e923a-4d33-429e-b344-d8f6704945f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:38:17.544487 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e923a-4d33-429e-b344-d8f6704945f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:38:17.544770 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e923a-4d33-429e-b344-d8f6704945f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:38:17.545500 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e923a-4d33-429e-b344-d8f6704945f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:38:17.545806 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e923a-4d33-429e-b344-d8f6704945f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:38:17.547406 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e923a-4d33-429e-b344-d8f6704945f0 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:38:17.559521 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1221/2425] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:38:17.563908 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4f5ae-93f1-4c98-af46-8f422a160d4c None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:38:17.573222 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4f5ae-93f1-4c98-af46-8f422a160d4c None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:38:17.583396 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8379bc-8e40-4046-8eeb-24c31ef17694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:38:17.584093 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8379bc-8e40-4046-8eeb-24c31ef17694 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:38:17.584376 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8379bc-8e40-4046-8eeb-24c31ef17694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:38:17.584654 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8379bc-8e40-4046-8eeb-24c31ef17694 admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:38:17.585395 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8379bc-8e40-4046-8eeb-24c31ef17694 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:38:17.587379 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8379bc-8e40-4046-8eeb-24c31ef17694 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:38:17.666193 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1205/2426] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:38:17 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 19:38:17.671092 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e923a-4d33-429e-b344-d8f6704945f0 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:38:17.681341 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e923a-4d33-429e-b344-d8f6704945f0 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:38:17.684962 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:38:17.739668 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f9e299-f0b9-46ff-bd7b-1179f71fd39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:38:17.740353 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9e299-f0b9-46ff-bd7b-1179f71fd39d admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:38:17.740636 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9e299-f0b9-46ff-bd7b-1179f71fd39d admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:38:17.740913 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9e299-f0b9-46ff-bd7b-1179f71fd39d admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:38:17.741611 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f9e299-f0b9-46ff-bd7b-1179f71fd39d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:38:17.743615 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f9e299-f0b9-46ff-bd7b-1179f71fd39d admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:38:17.820023 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1222/2427] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:38:17 2022] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:38:17.824304 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8379bc-8e40-4046-8eeb-24c31ef17694 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:38:17.835615 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8379bc-8e40-4046-8eeb-24c31ef17694 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:38:17.840325 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c29037-be8f-4859-b869-8ac997964fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:38:17.841751 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c29037-be8f-4859-b869-8ac997964fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:38:17.842040 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c29037-be8f-4859-b869-8ac997964fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:38:17.842538 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c29037-be8f-4859-b869-8ac997964fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:38:17.843255 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c29037-be8f-4859-b869-8ac997964fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:38:17.844969 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c29037-be8f-4859-b869-8ac997964fd6 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:38:17.855543 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1206/2428] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:38:17.859568 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f9e299-f0b9-46ff-bd7b-1179f71fd39d admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:38:17.869409 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f9e299-f0b9-46ff-bd7b-1179f71fd39d admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:38:17.873967 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b66d38-1f75-4abe-af26-5c0c292e86f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:38:17.874618 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b66d38-1f75-4abe-af26-5c0c292e86f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:38:17.874901 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b66d38-1f75-4abe-af26-5c0c292e86f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:38:17.875177 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b66d38-1f75-4abe-af26-5c0c292e86f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:38:17.875937 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b66d38-1f75-4abe-af26-5c0c292e86f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:38:17.877521 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b66d38-1f75-4abe-af26-5c0c292e86f7 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:38:17.887829 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1223/2429] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:38:17.891849 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c29037-be8f-4859-b869-8ac997964fd6 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:38:17.901592 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c29037-be8f-4859-b869-8ac997964fd6 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:38:17.906841 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45150456-ef07-4699-904d-6d4d482ccd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:38:17.907772 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45150456-ef07-4699-904d-6d4d482ccd0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:38:17.908056 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45150456-ef07-4699-904d-6d4d482ccd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:38:17.908332 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45150456-ef07-4699-904d-6d4d482ccd0d admin admin] PATH_INFO: `/v3/projects/12edd41c20b64228a7ffec6c0fecceaa/users/87f021ceaea34306a44761f4e984bf9e/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:38:17.922494 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45150456-ef07-4699-904d-6d4d482ccd0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=12edd41c20b64228a7ffec6c0fecceaa, user_id=87f021ceaea34306a44761f4e984bf9e, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:38:17.925092 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45150456-ef07-4699-904d-6d4d482ccd0d admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:38:18.011719 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1207/2430] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:38:17 2022] PUT /identity/v3/projects/12edd41c20b64228a7ffec6c0fecceaa/users/87f021ceaea34306a44761f4e984bf9e/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:38:18.017420 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75453b54-62ec-44ce-bac2-6337b1dc5fd2 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:38:18.017726 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75453b54-62ec-44ce-bac2-6337b1dc5fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:38:18.018042 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75453b54-62ec-44ce-bac2-6337b1dc5fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:38:18.036713 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-75453b54-62ec-44ce-bac2-6337b1dc5fd2 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:38:18.037926 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-75453b54-62ec-44ce-bac2-6337b1dc5fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:38:18.096431 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1224/2431] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:38:18.110908 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45150456-ef07-4699-904d-6d4d482ccd0d admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:38:18.112639 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-45150456-ef07-4699-904d-6d4d482ccd0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:38:18.143626 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:38:18.169855 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45150456-ef07-4699-904d-6d4d482ccd0d admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:38:18.173831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea311a7c-b87f-440d-9949-a84838a857c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:38:18.174747 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea311a7c-b87f-440d-9949-a84838a857c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:38:18.175083 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea311a7c-b87f-440d-9949-a84838a857c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:38:18.175366 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea311a7c-b87f-440d-9949-a84838a857c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:38:18.184823 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea311a7c-b87f-440d-9949-a84838a857c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:38:18.186292 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea311a7c-b87f-440d-9949-a84838a857c9 service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:38:18.196077 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1208/2432] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:38:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:38:23.027407 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560f4c3-3def-4b79-b77a-0f7f16e25c21 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:38:23.027407 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560f4c3-3def-4b79-b77a-0f7f16e25c21 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:38:23.027407 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560f4c3-3def-4b79-b77a-0f7f16e25c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:38:23.063304 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-a560f4c3-3def-4b79-b77a-0f7f16e25c21 None None] MFA Rules not processed for user `87f021ceaea34306a44761f4e984bf9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:38:23.064686 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-a560f4c3-3def-4b79-b77a-0f7f16e25c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:38:23.132645 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1225/2433] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:38:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:38:23.150257 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea311a7c-b87f-440d-9949-a84838a857c9 service neutron] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:38:23.151974 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-ea311a7c-b87f-440d-9949-a84838a857c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:38:23.289552 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea311a7c-b87f-440d-9949-a84838a857c9 service neutron] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:38:23.296614 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc332f4f-8722-4c4c-befd-970b341289e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:38:23.302197 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc332f4f-8722-4c4c-befd-970b341289e2 service nova] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:38:23.302667 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc332f4f-8722-4c4c-befd-970b341289e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:38:23.303102 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc332f4f-8722-4c4c-befd-970b341289e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:38:23.322442 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc332f4f-8722-4c4c-befd-970b341289e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:38:23.329439 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc332f4f-8722-4c4c-befd-970b341289e2 service nova] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:38:23.339151 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1209/2434] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:38:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:38:26.141461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced48af-4627-48d0-95c1-7d9266265973 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:38:26.142035 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced48af-4627-48d0-95c1-7d9266265973 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:38:26.142035 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced48af-4627-48d0-95c1-7d9266265973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:38:26.164443 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-7ced48af-4627-48d0-95c1-7d9266265973 None None] MFA Rules not processed for user `87f021ceaea34306a44761f4e984bf9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:38:26.166023 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-7ced48af-4627-48d0-95c1-7d9266265973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:38:26.175805 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1226/2435] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:38:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:38:33.334641 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=48 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:38:36.157870 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=93,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:38:37.142744 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc332f4f-8722-4c4c-befd-970b341289e2 service nova] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:38:37.154845 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc332f4f-8722-4c4c-befd-970b341289e2 service nova] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:38:37.159294 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36214b96-c825-485d-8325-4cd5af824335 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:38:37.160142 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36214b96-c825-485d-8325-4cd5af824335 service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:38:37.160449 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36214b96-c825-485d-8325-4cd5af824335 service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:38:37.160816 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36214b96-c825-485d-8325-4cd5af824335 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:38:37.162974 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-36214b96-c825-485d-8325-4cd5af824335 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:38:37.180541 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36214b96-c825-485d-8325-4cd5af824335 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:38:37.182380 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36214b96-c825-485d-8325-4cd5af824335 service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:38:37.196222 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1210/2436] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:38:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:38:39.574188 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced48af-4627-48d0-95c1-7d9266265973 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:38:39.576731 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-7ced48af-4627-48d0-95c1-7d9266265973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:38:39.591787 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced48af-4627-48d0-95c1-7d9266265973 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:38:39.595844 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38751a99-d699-4380-a34d-0174466beeae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:38:39.596499 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38751a99-d699-4380-a34d-0174466beeae service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:38:39.596784 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38751a99-d699-4380-a34d-0174466beeae service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:38:39.597063 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38751a99-d699-4380-a34d-0174466beeae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:38:39.599051 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-38751a99-d699-4380-a34d-0174466beeae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:38:39.614742 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38751a99-d699-4380-a34d-0174466beeae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:38:39.616399 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38751a99-d699-4380-a34d-0174466beeae service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:38:39.629722 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1227/2437] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:38:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:38:42.470838 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b1cfa-7e58-4013-9780-2f7a682db98c None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:38:42.471769 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b1cfa-7e58-4013-9780-2f7a682db98c None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:38:42.471958 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b1cfa-7e58-4013-9780-2f7a682db98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:38:42.494651 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-220b1cfa-7e58-4013-9780-2f7a682db98c None None] MFA Rules not processed for user `22d11b8e390e4b9db3b84c419266c4b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:38:42.496324 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-220b1cfa-7e58-4013-9780-2f7a682db98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:38:42.572430 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1211/2438] 10.222.0.60 () {58 vars in 1009 bytes} [Thu Jul 21 19:38:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:38:42.742938 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38751a99-d699-4380-a34d-0174466beeae service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:38:42.744523 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-38751a99-d699-4380-a34d-0174466beeae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:38:42.848447 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38751a99-d699-4380-a34d-0174466beeae service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:38:42.853755 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc81847-671f-48e0-97e5-41456816b46f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa579af53a6441a9205cf82864a640e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:38:42.859479 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc81847-671f-48e0-97e5-41456816b46f service swift] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:38:42.859479 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc81847-671f-48e0-97e5-41456816b46f service swift] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:38:42.859479 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc81847-671f-48e0-97e5-41456816b46f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:38:42.863185 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc81847-671f-48e0-97e5-41456816b46f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:38:42.864854 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc81847-671f-48e0-97e5-41456816b46f service swift] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:38:42.877320 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1228/2439] 10.222.0.60 () {60 vars in 1384 bytes} [Thu Jul 21 19:38:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 19:38:52.565415 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=31 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:38:52.873829 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=38 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:38:53.362069 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b1cfa-7e58-4013-9780-2f7a682db98c None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:38:53.375667 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b1cfa-7e58-4013-9780-2f7a682db98c None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:38:53.381116 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59abaffb-4638-490f-83ef-da3b0100fde9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:38:53.382722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59abaffb-4638-490f-83ef-da3b0100fde9 service nova] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:38:53.382722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59abaffb-4638-490f-83ef-da3b0100fde9 service nova] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:38:53.382722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59abaffb-4638-490f-83ef-da3b0100fde9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:38:53.384177 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-59abaffb-4638-490f-83ef-da3b0100fde9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:38:53.454196 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59abaffb-4638-490f-83ef-da3b0100fde9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:38:53.455748 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59abaffb-4638-490f-83ef-da3b0100fde9 service nova] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:38:53.466201 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1212/2440] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:38:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:38:58.038634 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6093ef-9d71-497f-95af-7f3426899c74 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:38:58.039211 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6093ef-9d71-497f-95af-7f3426899c74 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:38:58.039468 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6093ef-9d71-497f-95af-7f3426899c74 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:38:58.041429 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1229/2441] 10.222.0.60 () {54 vars in 921 bytes} [Thu Jul 21 19:38:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:38:58.053372 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4693e-ec42-496c-9d21-4e4d409be9be None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:38:58.057971 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4693e-ec42-496c-9d21-4e4d409be9be None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:38:58.057971 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4693e-ec42-496c-9d21-4e4d409be9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:38:58.075047 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-35e4693e-ec42-496c-9d21-4e4d409be9be None None] MFA Rules not processed for user `6b4d98e967814e5f84f5f0d67ebb3c17`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:38:58.077225 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-35e4693e-ec42-496c-9d21-4e4d409be9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:38:58.089517 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1213/2442] 10.222.0.60 () {58 vars in 1018 bytes} [Thu Jul 21 19:38:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:38:58.101055 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6093ef-9d71-497f-95af-7f3426899c74 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:38:58.102806 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-0a6093ef-9d71-497f-95af-7f3426899c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:38:58.165283 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6093ef-9d71-497f-95af-7f3426899c74 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:38:58.169024 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d1700-a09a-41da-95b1-dff8c27a70a1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a23a8e608f94d5d8153dcf7e79250f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:38:58.169673 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d1700-a09a-41da-95b1-dff8c27a70a1 service glance] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:38:58.169955 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d1700-a09a-41da-95b1-dff8c27a70a1 service glance] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:38:58.170235 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d1700-a09a-41da-95b1-dff8c27a70a1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:38:58.180828 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d1700-a09a-41da-95b1-dff8c27a70a1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:38:58.182270 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d1700-a09a-41da-95b1-dff8c27a70a1 service glance] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:38:58.194778 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1230/2443] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:38:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:38:58.512717 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb820e-b983-463d-8749-d958202ebd03 None None] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:38:58.513129 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb820e-b983-463d-8749-d958202ebd03 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:38:58.513563 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb820e-b983-463d-8749-d958202ebd03 None None] PATH_INFO: `/` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:38:58.515058 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1214/2444] 10.222.0.60 () {54 vars in 921 bytes} [Thu Jul 21 19:38:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:38:58.520550 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f79b48-557c-47ab-b38c-3dedef2539e1 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:38:58.520853 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f79b48-557c-47ab-b38c-3dedef2539e1 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:38:58.521138 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f79b48-557c-47ab-b38c-3dedef2539e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:38:58.545275 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-28f79b48-557c-47ab-b38c-3dedef2539e1 None None] MFA Rules not processed for user `b1908b2f87d5442da8ba826489cb2018`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:38:58.547040 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-28f79b48-557c-47ab-b38c-3dedef2539e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:38:58.557346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1231/2445] 10.222.0.60 () {58 vars in 1018 bytes} [Thu Jul 21 19:38:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:38:58.572442 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb820e-b983-463d-8749-d958202ebd03 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:38:58.590780 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb820e-b983-463d-8749-d958202ebd03 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:38:58.596846 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b93ca1-ab76-45b2-b833-bf8b776c7b39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:38:58.598047 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b93ca1-ab76-45b2-b833-bf8b776c7b39 service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:38:58.598631 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b93ca1-ab76-45b2-b833-bf8b776c7b39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:38:58.599107 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b93ca1-ab76-45b2-b833-bf8b776c7b39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:38:58.611800 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b93ca1-ab76-45b2-b833-bf8b776c7b39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:38:58.614706 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b93ca1-ab76-45b2-b833-bf8b776c7b39 service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:38:58.628064 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1215/2446] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:38:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:38:58.718396 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7f281-02a2-47bb-9690-0cd73da705bd None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:38:58.718771 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7f281-02a2-47bb-9690-0cd73da705bd None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:38:58.719136 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7f281-02a2-47bb-9690-0cd73da705bd None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:38:58.720738 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1232/2447] 10.222.0.60 () {54 vars in 921 bytes} [Thu Jul 21 19:38:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 19:38:58.726382 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2f1fd-0c12-497a-8f53-102617751508 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:38:58.726679 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2f1fd-0c12-497a-8f53-102617751508 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:38:58.726961 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2f1fd-0c12-497a-8f53-102617751508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:38:58.745664 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-76e2f1fd-0c12-497a-8f53-102617751508 None None] MFA Rules not processed for user `6b4d98e967814e5f84f5f0d67ebb3c17`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:38:58.747375 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-76e2f1fd-0c12-497a-8f53-102617751508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:38:58.757089 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1216/2448] 10.222.0.60 () {58 vars in 1018 bytes} [Thu Jul 21 19:38:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:38:58.768799 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7f281-02a2-47bb-9690-0cd73da705bd None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:38:58.780819 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7f281-02a2-47bb-9690-0cd73da705bd None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:38:58.784370 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d41e93-fb5a-4792-ace7-4f5ca2693f22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:38:58.785017 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d41e93-fb5a-4792-ace7-4f5ca2693f22 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:38:58.785296 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d41e93-fb5a-4792-ace7-4f5ca2693f22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:38:58.785572 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d41e93-fb5a-4792-ace7-4f5ca2693f22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:38:58.797835 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d41e93-fb5a-4792-ace7-4f5ca2693f22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:38:58.799292 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d41e93-fb5a-4792-ace7-4f5ca2693f22 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:38:58.811871 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1233/2449] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:38:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:39:01.081795 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff647d-f5e8-4d35-9224-112af7cd6046 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:01.082751 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff647d-f5e8-4d35-9224-112af7cd6046 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:01.082751 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff647d-f5e8-4d35-9224-112af7cd6046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:01.100272 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-0fff647d-f5e8-4d35-9224-112af7cd6046 None None] MFA Rules not processed for user `22d11b8e390e4b9db3b84c419266c4b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:39:01.101497 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-0fff647d-f5e8-4d35-9224-112af7cd6046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:01.109704 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1217/2450] 10.222.0.60 () {58 vars in 1009 bytes} [Thu Jul 21 19:39:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:39:01.121728 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d41e93-fb5a-4792-ace7-4f5ca2693f22 service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:01.133893 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d41e93-fb5a-4792-ace7-4f5ca2693f22 service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:01.139312 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caaaaf6-e99e-48b7-a4f3-e16c31a001b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa579af53a6441a9205cf82864a640e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:01.140122 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caaaaf6-e99e-48b7-a4f3-e16c31a001b1 service swift] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:01.140412 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caaaaf6-e99e-48b7-a4f3-e16c31a001b1 service swift] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:01.140724 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caaaaf6-e99e-48b7-a4f3-e16c31a001b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:01.149217 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caaaaf6-e99e-48b7-a4f3-e16c31a001b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:01.150841 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caaaaf6-e99e-48b7-a4f3-e16c31a001b1 service swift] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:01.159929 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1234/2451] 10.222.0.60 () {60 vars in 1384 bytes} [Thu Jul 21 19:39:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 19:39:02.516954 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff647d-f5e8-4d35-9224-112af7cd6046 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:02.530419 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff647d-f5e8-4d35-9224-112af7cd6046 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:02.535956 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9345a5-4b21-4203-aa10-a521a8cd9512 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:02.536613 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9345a5-4b21-4203-aa10-a521a8cd9512 service nova] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:02.536956 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9345a5-4b21-4203-aa10-a521a8cd9512 service nova] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:02.537236 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9345a5-4b21-4203-aa10-a521a8cd9512 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:02.539268 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-ca9345a5-4b21-4203-aa10-a521a8cd9512 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:02.612939 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9345a5-4b21-4203-aa10-a521a8cd9512 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:02.614572 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9345a5-4b21-4203-aa10-a521a8cd9512 service nova] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:02.626981 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1218/2452] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:39:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:39:11.156686 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=41 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:39:12.621118 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=71 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:39:14.656917 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caaaaf6-e99e-48b7-a4f3-e16c31a001b1 service swift] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:14.667093 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caaaaf6-e99e-48b7-a4f3-e16c31a001b1 service swift] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:14.671461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da09c1e-2344-4c59-9b9d-b6a18e102a44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:14.672232 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da09c1e-2344-4c59-9b9d-b6a18e102a44 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:14.672535 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da09c1e-2344-4c59-9b9d-b6a18e102a44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:14.672756 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da09c1e-2344-4c59-9b9d-b6a18e102a44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:14.674504 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-6da09c1e-2344-4c59-9b9d-b6a18e102a44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:14.686413 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da09c1e-2344-4c59-9b9d-b6a18e102a44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:14.687843 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da09c1e-2344-4c59-9b9d-b6a18e102a44 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:14.696700 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1235/2453] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:39:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:39:15.850314 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d50ed5-8de7-4df6-8894-d7feb709039f None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:15.850777 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d50ed5-8de7-4df6-8894-d7feb709039f None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:15.850912 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d50ed5-8de7-4df6-8894-d7feb709039f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:15.993846 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-e4d50ed5-8de7-4df6-8894-d7feb709039f None None] MFA Rules not processed for user `22d11b8e390e4b9db3b84c419266c4b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:39:15.995110 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-e4d50ed5-8de7-4df6-8894-d7feb709039f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:16.003009 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1219/2454] 10.222.0.60 () {58 vars in 967 bytes} [Thu Jul 21 19:39:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:39:16.018908 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da09c1e-2344-4c59-9b9d-b6a18e102a44 service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:16.031621 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da09c1e-2344-4c59-9b9d-b6a18e102a44 service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:16.037041 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e5d10-a6f0-411c-8bfd-95e337e58f7e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa579af53a6441a9205cf82864a640e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:16.037496 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e5d10-a6f0-411c-8bfd-95e337e58f7e service swift] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:16.037786 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e5d10-a6f0-411c-8bfd-95e337e58f7e service swift] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:16.038382 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e5d10-a6f0-411c-8bfd-95e337e58f7e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:16.047671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e5d10-a6f0-411c-8bfd-95e337e58f7e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:16.063670 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e5d10-a6f0-411c-8bfd-95e337e58f7e service swift] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:16.073596 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1236/2455] 10.222.0.60 () {60 vars in 1384 bytes} [Thu Jul 21 19:39:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 19:39:24.693857 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736e86f-587e-41d4-88f2-8f664041dfcf None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:24.694356 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736e86f-587e-41d4-88f2-8f664041dfcf None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:24.694450 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736e86f-587e-41d4-88f2-8f664041dfcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:24.711505 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-4736e86f-587e-41d4-88f2-8f664041dfcf None None] MFA Rules not processed for user `87f021ceaea34306a44761f4e984bf9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:39:24.712698 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-4736e86f-587e-41d4-88f2-8f664041dfcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:24.719630 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1220/2456] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:39:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:39:25.020245 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e5d10-a6f0-411c-8bfd-95e337e58f7e service swift] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:25.029938 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e5d10-a6f0-411c-8bfd-95e337e58f7e service swift] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:25.033693 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24fcd4-517f-46b9-93ee-56c7f18989fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:25.034323 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24fcd4-517f-46b9-93ee-56c7f18989fa service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:25.034603 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24fcd4-517f-46b9-93ee-56c7f18989fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:25.034880 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24fcd4-517f-46b9-93ee-56c7f18989fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:25.036634 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-8b24fcd4-517f-46b9-93ee-56c7f18989fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:25.047182 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b24fcd4-517f-46b9-93ee-56c7f18989fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:25.048418 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b24fcd4-517f-46b9-93ee-56c7f18989fa service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:25.057027 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1237/2457] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:39:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:39:25.463123 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736e86f-587e-41d4-88f2-8f664041dfcf None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:25.464552 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-4736e86f-587e-41d4-88f2-8f664041dfcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:25.535323 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736e86f-587e-41d4-88f2-8f664041dfcf None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:25.540411 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e709f0-115a-45d4-ad52-d3b5e673304f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcc5eefc2f7c419190e96b46b163fedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:25.541058 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e709f0-115a-45d4-ad52-d3b5e673304f service placement] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:25.541343 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e709f0-115a-45d4-ad52-d3b5e673304f service placement] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:25.541623 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e709f0-115a-45d4-ad52-d3b5e673304f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:25.544240 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-f5e709f0-115a-45d4-ad52-d3b5e673304f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:25.555653 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e709f0-115a-45d4-ad52-d3b5e673304f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:25.557339 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e709f0-115a-45d4-ad52-d3b5e673304f service placement] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:25.567849 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1221/2458] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:39:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:39:26.539643 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24fcd4-517f-46b9-93ee-56c7f18989fa service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:26.541165 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-8b24fcd4-517f-46b9-93ee-56c7f18989fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:26.560776 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24fcd4-517f-46b9-93ee-56c7f18989fa service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:26.567621 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64139e-c47e-4c08-8224-e718e26ca948 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:26.568901 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64139e-c47e-4c08-8224-e718e26ca948 service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:26.569400 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64139e-c47e-4c08-8224-e718e26ca948 service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:26.569862 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64139e-c47e-4c08-8224-e718e26ca948 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:26.571924 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-2b64139e-c47e-4c08-8224-e718e26ca948 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:26.587746 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64139e-c47e-4c08-8224-e718e26ca948 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:26.589414 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64139e-c47e-4c08-8224-e718e26ca948 service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:26.602792 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1238/2459] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:39:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:39:33.711771 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e709f0-115a-45d4-ad52-d3b5e673304f service placement] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:33.721644 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e709f0-115a-45d4-ad52-d3b5e673304f service placement] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:33.726058 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f1b4e-ac0b-4ac6-91db-dcc90e56e3bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:33.726777 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f1b4e-ac0b-4ac6-91db-dcc90e56e3bf service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:33.727144 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f1b4e-ac0b-4ac6-91db-dcc90e56e3bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:33.727529 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f1b4e-ac0b-4ac6-91db-dcc90e56e3bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:33.729487 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-9b7f1b4e-ac0b-4ac6-91db-dcc90e56e3bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:33.742975 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f1b4e-ac0b-4ac6-91db-dcc90e56e3bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:33.744535 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f1b4e-ac0b-4ac6-91db-dcc90e56e3bf service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:33.755922 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1222/2460] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:39:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:39:36.021510 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64139e-c47e-4c08-8224-e718e26ca948 service nova] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:36.033280 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64139e-c47e-4c08-8224-e718e26ca948 service nova] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:36.039404 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b377e9-8021-40fc-915a-efb2cc01a00d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:36.040098 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b377e9-8021-40fc-915a-efb2cc01a00d service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:36.040383 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b377e9-8021-40fc-915a-efb2cc01a00d service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:36.040663 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b377e9-8021-40fc-915a-efb2cc01a00d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:36.042449 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-39b377e9-8021-40fc-915a-efb2cc01a00d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:36.055401 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b377e9-8021-40fc-915a-efb2cc01a00d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:36.057009 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b377e9-8021-40fc-915a-efb2cc01a00d service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:36.069537 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1239/2461] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:39:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:39:37.455721 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f1b4e-ac0b-4ac6-91db-dcc90e56e3bf service neutron] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:37.457288 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-9b7f1b4e-ac0b-4ac6-91db-dcc90e56e3bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:37.472273 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f1b4e-ac0b-4ac6-91db-dcc90e56e3bf service neutron] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:37.477589 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac61a0-db34-4fd8-8227-a9c7d9d51b00 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcc5eefc2f7c419190e96b46b163fedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:37.478235 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac61a0-db34-4fd8-8227-a9c7d9d51b00 service placement] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:37.478518 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac61a0-db34-4fd8-8227-a9c7d9d51b00 service placement] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:37.478809 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac61a0-db34-4fd8-8227-a9c7d9d51b00 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:37.481627 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-24ac61a0-db34-4fd8-8227-a9c7d9d51b00 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:37.492889 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac61a0-db34-4fd8-8227-a9c7d9d51b00 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:37.494477 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac61a0-db34-4fd8-8227-a9c7d9d51b00 service placement] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:37.505625 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1223/2462] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:39:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:39:37.613761 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b377e9-8021-40fc-915a-efb2cc01a00d service nova] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:37.616016 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-39b377e9-8021-40fc-915a-efb2cc01a00d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:37.633148 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b377e9-8021-40fc-915a-efb2cc01a00d service nova] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:37.638397 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4472d94-1886-410d-9f2a-e9440739db4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:37.639221 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4472d94-1886-410d-9f2a-e9440739db4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:37.639537 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4472d94-1886-410d-9f2a-e9440739db4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:37.639820 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4472d94-1886-410d-9f2a-e9440739db4f admin admin] PATH_INFO: `/v3/users/44076ea4ef504e6a957e84dcb83c5d09` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:37.640988 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4472d94-1886-410d-9f2a-e9440739db4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=44076ea4ef504e6a957e84dcb83c5d09)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:37.642897 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4472d94-1886-410d-9f2a-e9440739db4f admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:37.821572 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-d4472d94-1886-410d-9f2a-e9440739db4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44076ea4ef504e6a957e84dcb83c5d09'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:37.913581 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-d4472d94-1886-410d-9f2a-e9440739db4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44076ea4ef504e6a957e84dcb83c5d09'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:37.914195 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-d4472d94-1886-410d-9f2a-e9440739db4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44076ea4ef504e6a957e84dcb83c5d09'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:37.922149 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-d4472d94-1886-410d-9f2a-e9440739db4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44076ea4ef504e6a957e84dcb83c5d09'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:37.935463 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-d4472d94-1886-410d-9f2a-e9440739db4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44076ea4ef504e6a957e84dcb83c5d09'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:37.941632 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1240/2463] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:39:37 2022] DELETE /identity/v3/users/44076ea4ef504e6a957e84dcb83c5d09 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:39:38.206917 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac61a0-db34-4fd8-8227-a9c7d9d51b00 service placement] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:38.217653 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac61a0-db34-4fd8-8227-a9c7d9d51b00 service placement] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:38.276289 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877c67c-1848-4b60-81ab-11ea4047c72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:38.277173 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877c67c-1848-4b60-81ab-11ea4047c72a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:38.277457 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877c67c-1848-4b60-81ab-11ea4047c72a admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:38.277736 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877c67c-1848-4b60-81ab-11ea4047c72a admin admin] PATH_INFO: `/v3/projects/49d8cb9232e6425681988949eb40432f` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:38.278911 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5877c67c-1848-4b60-81ab-11ea4047c72a admin admin] RBAC: Authorizing `identity:delete_project(project_id=49d8cb9232e6425681988949eb40432f)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:38.280832 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5877c67c-1848-4b60-81ab-11ea4047c72a admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:38.393323 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-5877c67c-1848-4b60-81ab-11ea4047c72a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49d8cb9232e6425681988949eb40432f', 'request_id': 'req-5877c67c-1848-4b60-81ab-11ea4047c72a'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:38.395855 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:39:38.479127 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-5877c67c-1848-4b60-81ab-11ea4047c72a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49d8cb9232e6425681988949eb40432f', 'request_id': 'req-5877c67c-1848-4b60-81ab-11ea4047c72a'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:38.485861 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-5877c67c-1848-4b60-81ab-11ea4047c72a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49d8cb9232e6425681988949eb40432f', 'request_id': 'req-5877c67c-1848-4b60-81ab-11ea4047c72a'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:38.499310 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-5877c67c-1848-4b60-81ab-11ea4047c72a admin admin] The token cache is being invalidate because project 49d8cb9232e6425681988949eb40432f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:39:38.499706 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-5877c67c-1848-4b60-81ab-11ea4047c72a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:38.500338 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-5877c67c-1848-4b60-81ab-11ea4047c72a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:38.501853 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1224/2464] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:39:38 2022] DELETE /identity/v3/projects/49d8cb9232e6425681988949eb40432f => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:39:38.506837 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbeca5-3a63-4dd3-8d4d-ea377cfc04a1 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:38.507129 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbeca5-3a63-4dd3-8d4d-ea377cfc04a1 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:38.507576 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbeca5-3a63-4dd3-8d4d-ea377cfc04a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:38.526458 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-75fbeca5-3a63-4dd3-8d4d-ea377cfc04a1 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:39:38.528391 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-75fbeca5-3a63-4dd3-8d4d-ea377cfc04a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:38.593787 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1241/2465] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:39:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:39:38.602272 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c2081-9906-416c-a3c8-a3712e4f70f0 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:38.602562 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c2081-9906-416c-a3c8-a3712e4f70f0 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:38.602841 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c2081-9906-416c-a3c8-a3712e4f70f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:38.621555 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-610c2081-9906-416c-a3c8-a3712e4f70f0 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:39:38.622744 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-610c2081-9906-416c-a3c8-a3712e4f70f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:38.630858 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1225/2466] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:39:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:39:38.634825 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbeca5-3a63-4dd3-8d4d-ea377cfc04a1 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:38.644976 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbeca5-3a63-4dd3-8d4d-ea377cfc04a1 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:38.650163 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda26b6e-256b-4950-ad76-da8588851815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:38.651188 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda26b6e-256b-4950-ad76-da8588851815 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:38.651507 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda26b6e-256b-4950-ad76-da8588851815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:38.651819 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda26b6e-256b-4950-ad76-da8588851815 admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:38.653118 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda26b6e-256b-4950-ad76-da8588851815 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:39:38.653427 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda26b6e-256b-4950-ad76-da8588851815 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:38.655378 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda26b6e-256b-4950-ad76-da8588851815 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:38.656665 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:39:38.671483 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1242/2467] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:39:38.672584 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c2081-9906-416c-a3c8-a3712e4f70f0 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:38.682077 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c2081-9906-416c-a3c8-a3712e4f70f0 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:38.687271 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e85668a-0f04-4b4c-b200-1474df6e79b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:38.687972 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85668a-0f04-4b4c-b200-1474df6e79b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:38.688258 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85668a-0f04-4b4c-b200-1474df6e79b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:38.688543 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85668a-0f04-4b4c-b200-1474df6e79b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:38.689240 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e85668a-0f04-4b4c-b200-1474df6e79b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:38.691161 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e85668a-0f04-4b4c-b200-1474df6e79b1 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:38.794993 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1226/2468] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:39:38 2022] POST /identity/v3/projects => generated 363 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 19:39:38.796085 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda26b6e-256b-4950-ad76-da8588851815 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:38.807824 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda26b6e-256b-4950-ad76-da8588851815 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:38.865140 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46c3d9-44bf-4877-9622-01f72791955e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:38.865827 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46c3d9-44bf-4877-9622-01f72791955e admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:38.866137 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46c3d9-44bf-4877-9622-01f72791955e admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:38.866472 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46c3d9-44bf-4877-9622-01f72791955e admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:38.867221 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a46c3d9-44bf-4877-9622-01f72791955e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:38.869203 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a46c3d9-44bf-4877-9622-01f72791955e admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:38.943490 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1243/2469] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:39:38 2022] POST /identity/v3/users => generated 282 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:39:38.947606 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e85668a-0f04-4b4c-b200-1474df6e79b1 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:38.958915 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e85668a-0f04-4b4c-b200-1474df6e79b1 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:38.963975 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a236e-dccd-48fd-8733-6e0f5ccabc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:38.965309 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a236e-dccd-48fd-8733-6e0f5ccabc56 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:38.965589 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a236e-dccd-48fd-8733-6e0f5ccabc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:38.965860 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a236e-dccd-48fd-8733-6e0f5ccabc56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:38.966585 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a236e-dccd-48fd-8733-6e0f5ccabc56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:38.968239 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a236e-dccd-48fd-8733-6e0f5ccabc56 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:38.978758 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1227/2470] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 19:39:38.982765 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46c3d9-44bf-4877-9622-01f72791955e admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:38.992759 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46c3d9-44bf-4877-9622-01f72791955e admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:38.997397 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241ff18-9b52-47ef-a9dd-c005280d1808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:38.998059 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241ff18-9b52-47ef-a9dd-c005280d1808 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:38.998350 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241ff18-9b52-47ef-a9dd-c005280d1808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:38.998630 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241ff18-9b52-47ef-a9dd-c005280d1808 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:38.999353 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b241ff18-9b52-47ef-a9dd-c005280d1808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:39.001160 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b241ff18-9b52-47ef-a9dd-c005280d1808 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:39.012941 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1244/2471] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:39:39.016915 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a236e-dccd-48fd-8733-6e0f5ccabc56 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:39.026949 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a236e-dccd-48fd-8733-6e0f5ccabc56 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:39.032213 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a882745-31f3-484d-abd7-1457e8e56705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:39.033123 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a882745-31f3-484d-abd7-1457e8e56705 admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:39.033409 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a882745-31f3-484d-abd7-1457e8e56705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:39.033685 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a882745-31f3-484d-abd7-1457e8e56705 admin admin] PATH_INFO: `/v3/projects/7a10266870b74200bc02fc90ed0057cf/users/3232de0020d64a1e9c2b0ceecb15654c/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:39.048578 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a882745-31f3-484d-abd7-1457e8e56705 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a10266870b74200bc02fc90ed0057cf, user_id=3232de0020d64a1e9c2b0ceecb15654c, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:39.053934 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a882745-31f3-484d-abd7-1457e8e56705 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:39.126212 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1228/2472] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:39:39 2022] PUT /identity/v3/projects/7a10266870b74200bc02fc90ed0057cf/users/3232de0020d64a1e9c2b0ceecb15654c/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:39:39.137030 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eab521-915d-4ee4-a020-aec6cdd90b48 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:39.137321 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eab521-915d-4ee4-a020-aec6cdd90b48 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:39.137601 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eab521-915d-4ee4-a020-aec6cdd90b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:39.164784 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-d9eab521-915d-4ee4-a020-aec6cdd90b48 None None] MFA Rules not processed for user `3232de0020d64a1e9c2b0ceecb15654c`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:39:39.165999 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-d9eab521-915d-4ee4-a020-aec6cdd90b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:39.235076 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1245/2473] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:39:39 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:39:39.239618 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a882745-31f3-484d-abd7-1457e8e56705 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:39.301179 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a882745-31f3-484d-abd7-1457e8e56705 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:39.305777 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ab176-6cf1-4a51-afc9-046db776729c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:39.306435 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ab176-6cf1-4a51-afc9-046db776729c admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:39.306718 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ab176-6cf1-4a51-afc9-046db776729c admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:39.306995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ab176-6cf1-4a51-afc9-046db776729c admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:39.307739 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ab176-6cf1-4a51-afc9-046db776729c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:39.310320 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ab176-6cf1-4a51-afc9-046db776729c admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:39.403090 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1229/2474] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:39:39 2022] POST /identity/v3/projects => generated 363 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 19:39:39.407229 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eab521-915d-4ee4-a020-aec6cdd90b48 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:39.418096 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eab521-915d-4ee4-a020-aec6cdd90b48 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:39.479894 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee1fbc-f351-43ab-81a2-87ed223f1d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:39.481064 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee1fbc-f351-43ab-81a2-87ed223f1d83 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:39.481352 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee1fbc-f351-43ab-81a2-87ed223f1d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:39.481632 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee1fbc-f351-43ab-81a2-87ed223f1d83 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:39.482347 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee1fbc-f351-43ab-81a2-87ed223f1d83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:39.484351 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee1fbc-f351-43ab-81a2-87ed223f1d83 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:39.492602 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:39:39.584634 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1246/2475] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:39:39 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:39:39.588433 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ab176-6cf1-4a51-afc9-046db776729c admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:39.599525 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ab176-6cf1-4a51-afc9-046db776729c admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:39.604302 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c8b0e-8c59-4201-8f37-dfc5cae3ff79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:39.605577 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c8b0e-8c59-4201-8f37-dfc5cae3ff79 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:39.606253 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c8b0e-8c59-4201-8f37-dfc5cae3ff79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:39.606593 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c8b0e-8c59-4201-8f37-dfc5cae3ff79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:39.607385 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c8b0e-8c59-4201-8f37-dfc5cae3ff79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:39.609089 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c8b0e-8c59-4201-8f37-dfc5cae3ff79 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:39.632762 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1230/2476] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:39:39.633992 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee1fbc-f351-43ab-81a2-87ed223f1d83 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:39.646281 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee1fbc-f351-43ab-81a2-87ed223f1d83 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:39.651762 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1f0ed-4e6a-44c2-bccc-c1d9299803fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:39.652763 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1f0ed-4e6a-44c2-bccc-c1d9299803fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:39.653050 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1f0ed-4e6a-44c2-bccc-c1d9299803fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:39.653333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1f0ed-4e6a-44c2-bccc-c1d9299803fb admin admin] PATH_INFO: `/v3/projects/d0d22675711a40499bbad73666c850ee/users/6c6a42bba14942ab9e91822651294fa0/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:39.670099 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1f0ed-4e6a-44c2-bccc-c1d9299803fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0d22675711a40499bbad73666c850ee, user_id=6c6a42bba14942ab9e91822651294fa0, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:39.672847 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1f0ed-4e6a-44c2-bccc-c1d9299803fb admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:39.915401 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1247/2477] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:39:39 2022] PUT /identity/v3/projects/d0d22675711a40499bbad73666c850ee/users/6c6a42bba14942ab9e91822651294fa0/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:39:39.918983 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c8b0e-8c59-4201-8f37-dfc5cae3ff79 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:39.919155 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1f0ed-4e6a-44c2-bccc-c1d9299803fb admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:39.920841 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-259c8b0e-8c59-4201-8f37-dfc5cae3ff79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:39.981296 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:39:39.989883 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1f0ed-4e6a-44c2-bccc-c1d9299803fb admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:39.994905 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca102354-c6b5-47d0-8846-ee3cfc3e8f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:39.995618 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca102354-c6b5-47d0-8846-ee3cfc3e8f4c admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:39.996157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca102354-c6b5-47d0-8846-ee3cfc3e8f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:39.996327 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca102354-c6b5-47d0-8846-ee3cfc3e8f4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:39.997067 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca102354-c6b5-47d0-8846-ee3cfc3e8f4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:39.998676 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca102354-c6b5-47d0-8846-ee3cfc3e8f4c admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:40.004481 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c8b0e-8c59-4201-8f37-dfc5cae3ff79 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:40.010442 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1248/2478] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:39:40.014749 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca102354-c6b5-47d0-8846-ee3cfc3e8f4c admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:40.025668 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca102354-c6b5-47d0-8846-ee3cfc3e8f4c admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:40.031373 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a529c06-e3c7-4628-b775-3bf6a967e050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:40.032484 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a529c06-e3c7-4628-b775-3bf6a967e050 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:40.032796 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a529c06-e3c7-4628-b775-3bf6a967e050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:40.033566 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a529c06-e3c7-4628-b775-3bf6a967e050 admin admin] PATH_INFO: `/v3/projects/d0d22675711a40499bbad73666c850ee/users/6c6a42bba14942ab9e91822651294fa0/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:40.035809 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a529c06-e3c7-4628-b775-3bf6a967e050 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0d22675711a40499bbad73666c850ee, user_id=6c6a42bba14942ab9e91822651294fa0, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:40.038640 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a529c06-e3c7-4628-b775-3bf6a967e050 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:40.062442 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1249/2479] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:39:40 2022] PUT /identity/v3/projects/d0d22675711a40499bbad73666c850ee/users/6c6a42bba14942ab9e91822651294fa0/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:39:40.065442 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9c852-9880-4a6f-8f9a-498a7c7e8bd3 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:40.065442 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9c852-9880-4a6f-8f9a-498a7c7e8bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:40.065442 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9c852-9880-4a6f-8f9a-498a7c7e8bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:40.080245 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70572c9c-9340-4fa0-9807-4e0a78aa1afb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:40.081201 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70572c9c-9340-4fa0-9807-4e0a78aa1afb service nova] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:40.081485 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70572c9c-9340-4fa0-9807-4e0a78aa1afb service nova] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:40.081761 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70572c9c-9340-4fa0-9807-4e0a78aa1afb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:40.083627 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-70572c9c-9340-4fa0-9807-4e0a78aa1afb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:40.097743 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-1ec9c852-9880-4a6f-8f9a-498a7c7e8bd3 None None] MFA Rules not processed for user `6c6a42bba14942ab9e91822651294fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:39:40.097992 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70572c9c-9340-4fa0-9807-4e0a78aa1afb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:40.099187 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-1ec9c852-9880-4a6f-8f9a-498a7c7e8bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:40.099967 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70572c9c-9340-4fa0-9807-4e0a78aa1afb service nova] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:40.114431 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1231/2480] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:39:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 19:39:40.178374 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1250/2481] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:39:40 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:39:40.192241 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70572c9c-9340-4fa0-9807-4e0a78aa1afb service nova] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:40.193926 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-70572c9c-9340-4fa0-9807-4e0a78aa1afb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:40.262055 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70572c9c-9340-4fa0-9807-4e0a78aa1afb service nova] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:40.322129 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc62141-6542-4f83-bd25-726cc1f9bb5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:40.322791 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc62141-6542-4f83-bd25-726cc1f9bb5a service cinder] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:40.323079 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc62141-6542-4f83-bd25-726cc1f9bb5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:40.323359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc62141-6542-4f83-bd25-726cc1f9bb5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:40.334323 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc62141-6542-4f83-bd25-726cc1f9bb5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:40.335552 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc62141-6542-4f83-bd25-726cc1f9bb5a service cinder] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:40.347529 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1232/2482] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:39:40 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:39:40.545204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec9c852-9880-4a6f-8f9a-498a7c7e8bd3 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:40.559498 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec9c852-9880-4a6f-8f9a-498a7c7e8bd3 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:40.565768 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb5e36e-1d4c-4015-8140-e479622a0905 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:40.566429 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5e36e-1d4c-4015-8140-e479622a0905 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:40.567518 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5e36e-1d4c-4015-8140-e479622a0905 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:40.567518 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5e36e-1d4c-4015-8140-e479622a0905 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:40.608060 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:39:40.640273 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb5e36e-1d4c-4015-8140-e479622a0905 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:40.642601 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb5e36e-1d4c-4015-8140-e479622a0905 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:40.653716 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1251/2483] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:39:40 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:39:44.073261 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc62141-6542-4f83-bd25-726cc1f9bb5a service cinder] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:44.105747 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:39:44.133964 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc62141-6542-4f83-bd25-726cc1f9bb5a service cinder] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:44.138541 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56a54f-715a-48cc-8a4c-d7d081c3f501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:44.139405 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56a54f-715a-48cc-8a4c-d7d081c3f501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:44.139716 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56a54f-715a-48cc-8a4c-d7d081c3f501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:44.139988 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56a54f-715a-48cc-8a4c-d7d081c3f501 admin admin] PATH_INFO: `/v3/users/3232de0020d64a1e9c2b0ceecb15654c` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:44.141141 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d56a54f-715a-48cc-8a4c-d7d081c3f501 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3232de0020d64a1e9c2b0ceecb15654c)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:44.143030 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d56a54f-715a-48cc-8a4c-d7d081c3f501 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:44.282142 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-9d56a54f-715a-48cc-8a4c-d7d081c3f501 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3232de0020d64a1e9c2b0ceecb15654c'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:44.332193 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-9d56a54f-715a-48cc-8a4c-d7d081c3f501 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3232de0020d64a1e9c2b0ceecb15654c'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:44.344805 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-9d56a54f-715a-48cc-8a4c-d7d081c3f501 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3232de0020d64a1e9c2b0ceecb15654c'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:44.349778 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-9d56a54f-715a-48cc-8a4c-d7d081c3f501 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3232de0020d64a1e9c2b0ceecb15654c'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:44.352139 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-9d56a54f-715a-48cc-8a4c-d7d081c3f501 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3232de0020d64a1e9c2b0ceecb15654c'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:44.358900 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1233/2484] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:39:44 2022] DELETE /identity/v3/users/3232de0020d64a1e9c2b0ceecb15654c => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:39:44.363389 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cffcb-73d7-4224-9a68-da44325d66ca None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:44.363895 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cffcb-73d7-4224-9a68-da44325d66ca None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:44.364009 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cffcb-73d7-4224-9a68-da44325d66ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:44.380676 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-9f0cffcb-73d7-4224-9a68-da44325d66ca None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:39:44.381861 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-9f0cffcb-73d7-4224-9a68-da44325d66ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:44.445807 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1252/2485] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:39:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:39:44.455844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56a54f-715a-48cc-8a4c-d7d081c3f501 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:44.457537 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-9d56a54f-715a-48cc-8a4c-d7d081c3f501 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:44.515235 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56a54f-715a-48cc-8a4c-d7d081c3f501 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:44.519070 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47821143-c9ae-4111-b837-907d9163561e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:44.519530 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47821143-c9ae-4111-b837-907d9163561e service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:44.519813 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47821143-c9ae-4111-b837-907d9163561e service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:44.520089 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47821143-c9ae-4111-b837-907d9163561e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:44.529660 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47821143-c9ae-4111-b837-907d9163561e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:44.531067 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47821143-c9ae-4111-b837-907d9163561e service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:44.540651 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1234/2486] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:39:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:39:44.944559 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0cffcb-73d7-4224-9a68-da44325d66ca None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:44.946060 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-9f0cffcb-73d7-4224-9a68-da44325d66ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:44.960270 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0cffcb-73d7-4224-9a68-da44325d66ca None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:44.965136 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89c514-fd40-4fa5-b91c-51389ff74be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:44.966787 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89c514-fd40-4fa5-b91c-51389ff74be4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:44.967077 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89c514-fd40-4fa5-b91c-51389ff74be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:44.967360 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89c514-fd40-4fa5-b91c-51389ff74be4 admin admin] PATH_INFO: `/v3/projects/7a10266870b74200bc02fc90ed0057cf` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:44.974219 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee89c514-fd40-4fa5-b91c-51389ff74be4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a10266870b74200bc02fc90ed0057cf)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:44.976197 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee89c514-fd40-4fa5-b91c-51389ff74be4 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:45.082575 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ee89c514-fd40-4fa5-b91c-51389ff74be4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a10266870b74200bc02fc90ed0057cf', 'request_id': 'req-ee89c514-fd40-4fa5-b91c-51389ff74be4'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:45.088893 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ee89c514-fd40-4fa5-b91c-51389ff74be4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a10266870b74200bc02fc90ed0057cf', 'request_id': 'req-ee89c514-fd40-4fa5-b91c-51389ff74be4'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:45.149693 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ee89c514-fd40-4fa5-b91c-51389ff74be4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a10266870b74200bc02fc90ed0057cf', 'request_id': 'req-ee89c514-fd40-4fa5-b91c-51389ff74be4'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:45.160965 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ee89c514-fd40-4fa5-b91c-51389ff74be4 admin admin] The token cache is being invalidate because project 7a10266870b74200bc02fc90ed0057cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:39:45.161337 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ee89c514-fd40-4fa5-b91c-51389ff74be4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:45.161957 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ee89c514-fd40-4fa5-b91c-51389ff74be4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:45.163550 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1253/2487] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:39:44 2022] DELETE /identity/v3/projects/7a10266870b74200bc02fc90ed0057cf => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:39:45.167504 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47821143-c9ae-4111-b837-907d9163561e service neutron] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:45.177092 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47821143-c9ae-4111-b837-907d9163561e service neutron] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:45.225915 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:39:45.233271 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a46ba-2e3d-4e4c-a24e-e8fb739442b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:45.234177 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a46ba-2e3d-4e4c-a24e-e8fb739442b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:45.234472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a46ba-2e3d-4e4c-a24e-e8fb739442b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:45.239413 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a46ba-2e3d-4e4c-a24e-e8fb739442b5 admin admin] PATH_INFO: `/v3/users/6c6a42bba14942ab9e91822651294fa0` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:45.239413 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9a46ba-2e3d-4e4c-a24e-e8fb739442b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c6a42bba14942ab9e91822651294fa0)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:45.239413 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9a46ba-2e3d-4e4c-a24e-e8fb739442b5 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:45.386524 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-0d9a46ba-2e3d-4e4c-a24e-e8fb739442b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c6a42bba14942ab9e91822651294fa0'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:45.446545 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-0d9a46ba-2e3d-4e4c-a24e-e8fb739442b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c6a42bba14942ab9e91822651294fa0'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:45.459358 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-0d9a46ba-2e3d-4e4c-a24e-e8fb739442b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c6a42bba14942ab9e91822651294fa0'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:45.460008 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-0d9a46ba-2e3d-4e4c-a24e-e8fb739442b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c6a42bba14942ab9e91822651294fa0'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:45.466905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-0d9a46ba-2e3d-4e4c-a24e-e8fb739442b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c6a42bba14942ab9e91822651294fa0'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:45.472748 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1235/2488] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:39:45 2022] DELETE /identity/v3/users/6c6a42bba14942ab9e91822651294fa0 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:39:45.882577 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89c514-fd40-4fa5-b91c-51389ff74be4 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:45.884105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ee89c514-fd40-4fa5-b91c-51389ff74be4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:45.897264 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89c514-fd40-4fa5-b91c-51389ff74be4 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:45.949511 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:39:45.955262 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f5fc5f-d921-42d5-b26a-6d0bf10317eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:45.956163 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5fc5f-d921-42d5-b26a-6d0bf10317eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:45.957377 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5fc5f-d921-42d5-b26a-6d0bf10317eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:45.957377 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5fc5f-d921-42d5-b26a-6d0bf10317eb admin admin] PATH_INFO: `/v3/projects/d0d22675711a40499bbad73666c850ee` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:45.958135 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f5fc5f-d921-42d5-b26a-6d0bf10317eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0d22675711a40499bbad73666c850ee)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:45.960046 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f5fc5f-d921-42d5-b26a-6d0bf10317eb admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:46.067928 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-e8f5fc5f-d921-42d5-b26a-6d0bf10317eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0d22675711a40499bbad73666c850ee', 'request_id': 'req-e8f5fc5f-d921-42d5-b26a-6d0bf10317eb'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:46.074210 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-e8f5fc5f-d921-42d5-b26a-6d0bf10317eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0d22675711a40499bbad73666c850ee', 'request_id': 'req-e8f5fc5f-d921-42d5-b26a-6d0bf10317eb'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:46.136345 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-e8f5fc5f-d921-42d5-b26a-6d0bf10317eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0d22675711a40499bbad73666c850ee', 'request_id': 'req-e8f5fc5f-d921-42d5-b26a-6d0bf10317eb'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:46.147288 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-e8f5fc5f-d921-42d5-b26a-6d0bf10317eb admin admin] The token cache is being invalidate because project d0d22675711a40499bbad73666c850ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:39:46.147764 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-e8f5fc5f-d921-42d5-b26a-6d0bf10317eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:46.148478 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-e8f5fc5f-d921-42d5-b26a-6d0bf10317eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:46.150552 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1254/2489] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:39:45 2022] DELETE /identity/v3/projects/d0d22675711a40499bbad73666c850ee => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:39:46.157539 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa73118-9c23-49d2-a920-be11553bae17 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:46.157827 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa73118-9c23-49d2-a920-be11553bae17 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:46.158104 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa73118-9c23-49d2-a920-be11553bae17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:46.176965 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-5aa73118-9c23-49d2-a920-be11553bae17 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:39:46.178171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-5aa73118-9c23-49d2-a920-be11553bae17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:46.234864 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1236/2490] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:39:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:39:46.242403 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6d909-0ad7-43db-9995-3635e2bb1f28 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:46.242720 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6d909-0ad7-43db-9995-3635e2bb1f28 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:46.243029 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6d909-0ad7-43db-9995-3635e2bb1f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:46.261436 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-71d6d909-0ad7-43db-9995-3635e2bb1f28 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:39:46.263428 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-71d6d909-0ad7-43db-9995-3635e2bb1f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:46.271302 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1255/2491] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:39:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:39:46.275357 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa73118-9c23-49d2-a920-be11553bae17 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:46.285555 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa73118-9c23-49d2-a920-be11553bae17 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:46.290079 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b1e9d-b930-4242-af67-85b4d034435d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:46.290725 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b1e9d-b930-4242-af67-85b4d034435d admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:46.291011 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b1e9d-b930-4242-af67-85b4d034435d admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:46.291292 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b1e9d-b930-4242-af67-85b4d034435d admin admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:46.292054 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b1e9d-b930-4242-af67-85b4d034435d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:39:46.292363 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b1e9d-b930-4242-af67-85b4d034435d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:46.294067 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b1e9d-b930-4242-af67-85b4d034435d admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:46.305499 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1237/2492] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:39:46.309623 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d6d909-0ad7-43db-9995-3635e2bb1f28 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:46.319037 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d6d909-0ad7-43db-9995-3635e2bb1f28 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:46.323619 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ecfa98-c9da-4709-8eec-257177d3e34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:46.324262 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ecfa98-c9da-4709-8eec-257177d3e34d admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:46.325047 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ecfa98-c9da-4709-8eec-257177d3e34d admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:46.325322 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ecfa98-c9da-4709-8eec-257177d3e34d admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:46.326090 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ecfa98-c9da-4709-8eec-257177d3e34d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:46.328077 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ecfa98-c9da-4709-8eec-257177d3e34d admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:46.412352 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1256/2493] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:39:46 2022] POST /identity/v3/projects => generated 369 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 19:39:46.416311 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b1e9d-b930-4242-af67-85b4d034435d admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:46.426504 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b1e9d-b930-4242-af67-85b4d034435d admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:46.483353 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0e99a-bcbc-46bf-bf59-01ec4fec6afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:46.484058 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0e99a-bcbc-46bf-bf59-01ec4fec6afb admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:46.484349 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0e99a-bcbc-46bf-bf59-01ec4fec6afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:46.484623 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0e99a-bcbc-46bf-bf59-01ec4fec6afb admin admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:46.485294 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c0e99a-bcbc-46bf-bf59-01ec4fec6afb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:46.487179 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c0e99a-bcbc-46bf-bf59-01ec4fec6afb admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:46.494467 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:39:46.583986 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1238/2494] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:39:46 2022] POST /identity/v3/users => generated 285 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:39:46.588044 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ecfa98-c9da-4709-8eec-257177d3e34d admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:46.598459 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ecfa98-c9da-4709-8eec-257177d3e34d admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:46.603067 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605b710-94d8-45f3-b548-b4b102fa7171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:46.603791 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605b710-94d8-45f3-b548-b4b102fa7171 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:46.604076 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605b710-94d8-45f3-b548-b4b102fa7171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:46.604354 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605b710-94d8-45f3-b548-b4b102fa7171 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:46.605074 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4605b710-94d8-45f3-b548-b4b102fa7171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:46.606676 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4605b710-94d8-45f3-b548-b4b102fa7171 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:46.617539 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1257/2495] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:39:46.621536 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0e99a-bcbc-46bf-bf59-01ec4fec6afb admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:46.632432 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0e99a-bcbc-46bf-bf59-01ec4fec6afb admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:46.637204 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c90e55d-f282-4f38-839c-1ecd209254bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:46.637983 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90e55d-f282-4f38-839c-1ecd209254bb admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:46.638271 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90e55d-f282-4f38-839c-1ecd209254bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:46.639470 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90e55d-f282-4f38-839c-1ecd209254bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:46.640147 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c90e55d-f282-4f38-839c-1ecd209254bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:46.642252 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c90e55d-f282-4f38-839c-1ecd209254bb admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:46.652165 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1239/2496] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:39:46.656153 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605b710-94d8-45f3-b548-b4b102fa7171 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:46.666023 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605b710-94d8-45f3-b548-b4b102fa7171 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:46.670711 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90a455-1340-4c77-8dab-3b95942015c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:46.671629 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90a455-1340-4c77-8dab-3b95942015c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:46.671917 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90a455-1340-4c77-8dab-3b95942015c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:46.672194 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90a455-1340-4c77-8dab-3b95942015c8 admin admin] PATH_INFO: `/v3/projects/56d176bc7577424183c8f77170e90d90/users/39cb953bacad4b2eb08f3c0ed314ed54/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:46.687877 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b90a455-1340-4c77-8dab-3b95942015c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56d176bc7577424183c8f77170e90d90, user_id=39cb953bacad4b2eb08f3c0ed314ed54, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:46.690520 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b90a455-1340-4c77-8dab-3b95942015c8 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:46.737761 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1258/2497] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:39:46 2022] PUT /identity/v3/projects/56d176bc7577424183c8f77170e90d90/users/39cb953bacad4b2eb08f3c0ed314ed54/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:39:46.748582 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765d925-4a55-41e2-b100-7f69ae305322 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:46.748908 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765d925-4a55-41e2-b100-7f69ae305322 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:46.749280 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765d925-4a55-41e2-b100-7f69ae305322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:46.776102 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-5765d925-4a55-41e2-b100-7f69ae305322 None None] MFA Rules not processed for user `39cb953bacad4b2eb08f3c0ed314ed54`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:39:46.777390 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-5765d925-4a55-41e2-b100-7f69ae305322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:46.841618 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1240/2498] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:39:46 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:39:46.846037 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90a455-1340-4c77-8dab-3b95942015c8 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:46.910630 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90a455-1340-4c77-8dab-3b95942015c8 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:46.915885 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85656e1a-e605-4d3f-af67-461753c6a3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:46.916538 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85656e1a-e605-4d3f-af67-461753c6a3a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:46.916822 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85656e1a-e605-4d3f-af67-461753c6a3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:46.917122 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85656e1a-e605-4d3f-af67-461753c6a3a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:46.917822 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85656e1a-e605-4d3f-af67-461753c6a3a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:46.920260 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85656e1a-e605-4d3f-af67-461753c6a3a8 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:46.991096 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1259/2499] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:39:46 2022] POST /identity/v3/projects => generated 369 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:39:46.995116 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5765d925-4a55-41e2-b100-7f69ae305322 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:47.006459 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5765d925-4a55-41e2-b100-7f69ae305322 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:47.063311 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4aeae-dbc5-44c1-bedb-6a73c5ad7bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:47.064020 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4aeae-dbc5-44c1-bedb-6a73c5ad7bc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:47.064304 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4aeae-dbc5-44c1-bedb-6a73c5ad7bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:47.064582 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4aeae-dbc5-44c1-bedb-6a73c5ad7bc8 admin admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:47.065292 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e4aeae-dbc5-44c1-bedb-6a73c5ad7bc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:47.067183 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e4aeae-dbc5-44c1-bedb-6a73c5ad7bc8 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:47.134322 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1241/2500] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:39:46 2022] POST /identity/v3/users => generated 291 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:39:47.137663 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85656e1a-e605-4d3f-af67-461753c6a3a8 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:47.149404 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85656e1a-e605-4d3f-af67-461753c6a3a8 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:47.154810 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b89107-5ba6-4b44-9d30-bee24a966f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:47.155657 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b89107-5ba6-4b44-9d30-bee24a966f62 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:47.155947 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b89107-5ba6-4b44-9d30-bee24a966f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:47.156225 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b89107-5ba6-4b44-9d30-bee24a966f62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:47.157096 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b89107-5ba6-4b44-9d30-bee24a966f62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:47.158732 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b89107-5ba6-4b44-9d30-bee24a966f62 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:47.164773 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:39:47.180368 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1260/2501] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:39:47.183127 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4aeae-dbc5-44c1-bedb-6a73c5ad7bc8 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:47.194137 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4aeae-dbc5-44c1-bedb-6a73c5ad7bc8 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:47.198851 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8fb648-81b4-4359-85b2-52492626edb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:47.199784 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fb648-81b4-4359-85b2-52492626edb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:47.200073 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fb648-81b4-4359-85b2-52492626edb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:47.200350 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fb648-81b4-4359-85b2-52492626edb8 admin admin] PATH_INFO: `/v3/projects/2d44076a5bb24745ac67bf12b15d69de/users/107f8374a0344fe1a99a3f55ef89b672/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:47.224894 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8fb648-81b4-4359-85b2-52492626edb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d44076a5bb24745ac67bf12b15d69de, user_id=107f8374a0344fe1a99a3f55ef89b672, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:47.227751 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8fb648-81b4-4359-85b2-52492626edb8 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:47.299012 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1242/2502] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:39:47 2022] PUT /identity/v3/projects/2d44076a5bb24745ac67bf12b15d69de/users/107f8374a0344fe1a99a3f55ef89b672/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:39:47.303092 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b89107-5ba6-4b44-9d30-bee24a966f62 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:47.313714 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b89107-5ba6-4b44-9d30-bee24a966f62 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:47.372390 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf04d33-47d3-466d-be36-02b13bda85c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:47.373578 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf04d33-47d3-466d-be36-02b13bda85c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:47.373878 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf04d33-47d3-466d-be36-02b13bda85c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:47.374136 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf04d33-47d3-466d-be36-02b13bda85c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:47.375049 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf04d33-47d3-466d-be36-02b13bda85c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:47.376869 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf04d33-47d3-466d-be36-02b13bda85c0 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:47.387876 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1261/2503] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 19:39:47.392539 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8fb648-81b4-4359-85b2-52492626edb8 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:47.403678 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8fb648-81b4-4359-85b2-52492626edb8 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:47.407831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fbd338-5bb4-46cb-8df2-db6f13775375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:47.408781 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbd338-5bb4-46cb-8df2-db6f13775375 admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:47.409064 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbd338-5bb4-46cb-8df2-db6f13775375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:47.409333 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbd338-5bb4-46cb-8df2-db6f13775375 admin admin] PATH_INFO: `/v3/projects/2d44076a5bb24745ac67bf12b15d69de/users/107f8374a0344fe1a99a3f55ef89b672/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:47.411316 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fbd338-5bb4-46cb-8df2-db6f13775375 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d44076a5bb24745ac67bf12b15d69de, user_id=107f8374a0344fe1a99a3f55ef89b672, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:47.413936 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fbd338-5bb4-46cb-8df2-db6f13775375 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:47.425535 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1243/2504] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:39:47 2022] PUT /identity/v3/projects/2d44076a5bb24745ac67bf12b15d69de/users/107f8374a0344fe1a99a3f55ef89b672/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:39:47.437489 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5039cf1-77f4-4dc0-b1b4-b143703c1b8a None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:47.437791 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5039cf1-77f4-4dc0-b1b4-b143703c1b8a None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:47.438136 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5039cf1-77f4-4dc0-b1b4-b143703c1b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:47.467844 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-e5039cf1-77f4-4dc0-b1b4-b143703c1b8a None None] MFA Rules not processed for user `107f8374a0344fe1a99a3f55ef89b672`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:39:47.469121 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-e5039cf1-77f4-4dc0-b1b4-b143703c1b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:47.543507 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1262/2505] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:39:47 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:39:47.555241 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fbd338-5bb4-46cb-8df2-db6f13775375 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:47.563198 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-70fbd338-5bb4-46cb-8df2-db6f13775375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:47.585752 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:39:47.618056 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fbd338-5bb4-46cb-8df2-db6f13775375 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:47.622034 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae98e0-b2a8-454e-a0bb-3b0dc1faa94b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:47.622740 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae98e0-b2a8-454e-a0bb-3b0dc1faa94b service cinder] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:47.623111 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae98e0-b2a8-454e-a0bb-3b0dc1faa94b service cinder] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:47.623640 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae98e0-b2a8-454e-a0bb-3b0dc1faa94b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:47.633476 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deae98e0-b2a8-454e-a0bb-3b0dc1faa94b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:47.637827 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deae98e0-b2a8-454e-a0bb-3b0dc1faa94b service cinder] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:47.646798 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1244/2506] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:39:47 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:39:50.374312 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5039cf1-77f4-4dc0-b1b4-b143703c1b8a None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:50.448208 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5039cf1-77f4-4dc0-b1b4-b143703c1b8a None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:50.453556 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56206496-0205-47ef-be7d-0311e06667df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:50.454440 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56206496-0205-47ef-be7d-0311e06667df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:50.454721 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56206496-0205-47ef-be7d-0311e06667df admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:50.454999 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56206496-0205-47ef-be7d-0311e06667df admin admin] PATH_INFO: `/v3/users/39cb953bacad4b2eb08f3c0ed314ed54` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:50.456220 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56206496-0205-47ef-be7d-0311e06667df admin admin] RBAC: Authorizing `identity:delete_user(user_id=39cb953bacad4b2eb08f3c0ed314ed54)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:50.458322 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56206496-0205-47ef-be7d-0311e06667df admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:50.481238 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:39:50.621730 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-56206496-0205-47ef-be7d-0311e06667df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39cb953bacad4b2eb08f3c0ed314ed54'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:50.669673 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-56206496-0205-47ef-be7d-0311e06667df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39cb953bacad4b2eb08f3c0ed314ed54'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:50.670412 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-56206496-0205-47ef-be7d-0311e06667df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39cb953bacad4b2eb08f3c0ed314ed54'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:50.678592 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-56206496-0205-47ef-be7d-0311e06667df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39cb953bacad4b2eb08f3c0ed314ed54'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:50.691792 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-56206496-0205-47ef-be7d-0311e06667df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39cb953bacad4b2eb08f3c0ed314ed54'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:50.699657 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1263/2507] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:39:50 2022] DELETE /identity/v3/users/39cb953bacad4b2eb08f3c0ed314ed54 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:39:50.709322 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90de95-725b-433c-a62b-57d84fea4bd9 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:50.709322 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90de95-725b-433c-a62b-57d84fea4bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:50.709322 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90de95-725b-433c-a62b-57d84fea4bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:50.725251 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-3c90de95-725b-433c-a62b-57d84fea4bd9 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:39:50.726464 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-3c90de95-725b-433c-a62b-57d84fea4bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:50.791281 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1245/2508] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:39:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:39:50.806871 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56206496-0205-47ef-be7d-0311e06667df admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:50.806871 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-56206496-0205-47ef-be7d-0311e06667df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:50.869449 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56206496-0205-47ef-be7d-0311e06667df admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:50.874780 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb1171-849c-4c1d-95a5-a15170782daf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:50.875526 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb1171-849c-4c1d-95a5-a15170782daf service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:50.875795 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb1171-849c-4c1d-95a5-a15170782daf service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:50.876061 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb1171-849c-4c1d-95a5-a15170782daf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:50.887371 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb1171-849c-4c1d-95a5-a15170782daf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:50.889611 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb1171-849c-4c1d-95a5-a15170782daf service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:50.900298 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1264/2509] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:39:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:39:51.300710 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90de95-725b-433c-a62b-57d84fea4bd9 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:51.302203 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-3c90de95-725b-433c-a62b-57d84fea4bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:51.316488 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90de95-725b-433c-a62b-57d84fea4bd9 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:51.321496 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc53053-6398-42c7-bf30-590439eb12ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:51.323087 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc53053-6398-42c7-bf30-590439eb12ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:51.323379 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc53053-6398-42c7-bf30-590439eb12ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:51.323680 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc53053-6398-42c7-bf30-590439eb12ad admin admin] PATH_INFO: `/v3/projects/56d176bc7577424183c8f77170e90d90` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:51.324882 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc53053-6398-42c7-bf30-590439eb12ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=56d176bc7577424183c8f77170e90d90)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:51.326763 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc53053-6398-42c7-bf30-590439eb12ad admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:51.432930 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-6bc53053-6398-42c7-bf30-590439eb12ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56d176bc7577424183c8f77170e90d90', 'request_id': 'req-6bc53053-6398-42c7-bf30-590439eb12ad'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:51.492633 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-6bc53053-6398-42c7-bf30-590439eb12ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56d176bc7577424183c8f77170e90d90', 'request_id': 'req-6bc53053-6398-42c7-bf30-590439eb12ad'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:51.498672 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-6bc53053-6398-42c7-bf30-590439eb12ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56d176bc7577424183c8f77170e90d90', 'request_id': 'req-6bc53053-6398-42c7-bf30-590439eb12ad'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:51.509723 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-6bc53053-6398-42c7-bf30-590439eb12ad admin admin] The token cache is being invalidate because project 56d176bc7577424183c8f77170e90d90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:39:51.510013 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-6bc53053-6398-42c7-bf30-590439eb12ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:51.510703 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-6bc53053-6398-42c7-bf30-590439eb12ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:51.512271 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1246/2510] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:39:51 2022] DELETE /identity/v3/projects/56d176bc7577424183c8f77170e90d90 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:39:51.516931 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb1171-849c-4c1d-95a5-a15170782daf service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:51.526606 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb1171-849c-4c1d-95a5-a15170782daf service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:51.590195 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940967f4-6ccc-48b5-ad5a-927ebcb5f499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:51.591066 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940967f4-6ccc-48b5-ad5a-927ebcb5f499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:51.591350 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940967f4-6ccc-48b5-ad5a-927ebcb5f499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:51.591671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940967f4-6ccc-48b5-ad5a-927ebcb5f499 admin admin] PATH_INFO: `/v3/users/107f8374a0344fe1a99a3f55ef89b672` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:51.593477 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940967f4-6ccc-48b5-ad5a-927ebcb5f499 admin admin] RBAC: Authorizing `identity:delete_user(user_id=107f8374a0344fe1a99a3f55ef89b672)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:51.595408 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940967f4-6ccc-48b5-ad5a-927ebcb5f499 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:51.807727 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:39:51.810340 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-940967f4-6ccc-48b5-ad5a-927ebcb5f499 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '107f8374a0344fe1a99a3f55ef89b672'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:51.892611 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-940967f4-6ccc-48b5-ad5a-927ebcb5f499 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '107f8374a0344fe1a99a3f55ef89b672'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:51.893393 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-940967f4-6ccc-48b5-ad5a-927ebcb5f499 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '107f8374a0344fe1a99a3f55ef89b672'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:51.900925 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-940967f4-6ccc-48b5-ad5a-927ebcb5f499 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '107f8374a0344fe1a99a3f55ef89b672'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:51.914180 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-940967f4-6ccc-48b5-ad5a-927ebcb5f499 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '107f8374a0344fe1a99a3f55ef89b672'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:51.920173 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1265/2511] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:39:51 2022] DELETE /identity/v3/users/107f8374a0344fe1a99a3f55ef89b672 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:39:52.322604 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc53053-6398-42c7-bf30-590439eb12ad admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:52.326247 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-6bc53053-6398-42c7-bf30-590439eb12ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:52.338613 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc53053-6398-42c7-bf30-590439eb12ad admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:52.398540 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:39:52.410634 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd370624-42a2-4d80-ae33-a115ade83a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:52.411571 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd370624-42a2-4d80-ae33-a115ade83a53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:52.411860 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd370624-42a2-4d80-ae33-a115ade83a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:52.412136 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd370624-42a2-4d80-ae33-a115ade83a53 admin admin] PATH_INFO: `/v3/projects/2d44076a5bb24745ac67bf12b15d69de` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:52.413442 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd370624-42a2-4d80-ae33-a115ade83a53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d44076a5bb24745ac67bf12b15d69de)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:52.415514 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd370624-42a2-4d80-ae33-a115ade83a53 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:52.524801 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-dd370624-42a2-4d80-ae33-a115ade83a53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d44076a5bb24745ac67bf12b15d69de', 'request_id': 'req-dd370624-42a2-4d80-ae33-a115ade83a53'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:52.595560 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-dd370624-42a2-4d80-ae33-a115ade83a53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d44076a5bb24745ac67bf12b15d69de', 'request_id': 'req-dd370624-42a2-4d80-ae33-a115ade83a53'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:52.601516 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-dd370624-42a2-4d80-ae33-a115ade83a53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d44076a5bb24745ac67bf12b15d69de', 'request_id': 'req-dd370624-42a2-4d80-ae33-a115ade83a53'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:52.612917 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-dd370624-42a2-4d80-ae33-a115ade83a53 admin admin] The token cache is being invalidate because project 2d44076a5bb24745ac67bf12b15d69de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:39:52.613204 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-dd370624-42a2-4d80-ae33-a115ade83a53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:52.613832 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-dd370624-42a2-4d80-ae33-a115ade83a53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:52.615361 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1247/2512] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:39:52 2022] DELETE /identity/v3/projects/2d44076a5bb24745ac67bf12b15d69de => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:39:52.620401 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de956f-8403-49ca-b2aa-95ad34ab719e None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:52.620858 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de956f-8403-49ca-b2aa-95ad34ab719e None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:52.620974 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de956f-8403-49ca-b2aa-95ad34ab719e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:52.638946 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-36de956f-8403-49ca-b2aa-95ad34ab719e None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:39:52.641409 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-36de956f-8403-49ca-b2aa-95ad34ab719e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:52.702153 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1266/2513] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:39:52.709956 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb361a-31fa-477d-8676-ad3137fffb70 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:52.710251 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb361a-31fa-477d-8676-ad3137fffb70 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:52.710529 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb361a-31fa-477d-8676-ad3137fffb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:52.730984 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-47eb361a-31fa-477d-8676-ad3137fffb70 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:39:52.732387 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-47eb361a-31fa-477d-8676-ad3137fffb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:52.741301 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1248/2514] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:39:52.745548 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de956f-8403-49ca-b2aa-95ad34ab719e None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:52.755513 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de956f-8403-49ca-b2aa-95ad34ab719e None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:52.762037 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c50056-93c5-4423-a6ef-2f2918993fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:52.762698 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c50056-93c5-4423-a6ef-2f2918993fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:52.762979 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c50056-93c5-4423-a6ef-2f2918993fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:52.763257 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c50056-93c5-4423-a6ef-2f2918993fb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:52.764024 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c50056-93c5-4423-a6ef-2f2918993fb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:39:52.764351 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c50056-93c5-4423-a6ef-2f2918993fb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:52.766052 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c50056-93c5-4423-a6ef-2f2918993fb1 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:52.779466 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1267/2515] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:39:52.783935 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb361a-31fa-477d-8676-ad3137fffb70 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:52.793614 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb361a-31fa-477d-8676-ad3137fffb70 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:52.799235 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940054f-ac37-467e-bbd8-b36ba764d675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:52.799948 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940054f-ac37-467e-bbd8-b36ba764d675 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:52.803503 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940054f-ac37-467e-bbd8-b36ba764d675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:52.803503 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940054f-ac37-467e-bbd8-b36ba764d675 admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:52.803503 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940054f-ac37-467e-bbd8-b36ba764d675 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:52.803503 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940054f-ac37-467e-bbd8-b36ba764d675 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:52.912437 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1249/2516] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:39:52 2022] POST /identity/v3/projects => generated 377 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:39:52.916712 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c50056-93c5-4423-a6ef-2f2918993fb1 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:52.927034 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c50056-93c5-4423-a6ef-2f2918993fb1 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:52.984626 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799d994-40cd-43b1-8069-1c8a8c02c53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:52.985329 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799d994-40cd-43b1-8069-1c8a8c02c53f admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:52.985619 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799d994-40cd-43b1-8069-1c8a8c02c53f admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:52.986102 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799d994-40cd-43b1-8069-1c8a8c02c53f admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:52.986592 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6799d994-40cd-43b1-8069-1c8a8c02c53f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:52.988608 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6799d994-40cd-43b1-8069-1c8a8c02c53f admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:53.070364 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1268/2517] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:39:52 2022] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:39:53.074694 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940054f-ac37-467e-bbd8-b36ba764d675 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:53.085633 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940054f-ac37-467e-bbd8-b36ba764d675 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:53.090414 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba7b3d-0da2-469b-8b54-8e9be5502893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:53.091077 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba7b3d-0da2-469b-8b54-8e9be5502893 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:53.091364 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba7b3d-0da2-469b-8b54-8e9be5502893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:53.091670 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba7b3d-0da2-469b-8b54-8e9be5502893 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:53.092392 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba7b3d-0da2-469b-8b54-8e9be5502893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:53.094644 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba7b3d-0da2-469b-8b54-8e9be5502893 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:53.104790 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1250/2518] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:39:53.108561 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799d994-40cd-43b1-8069-1c8a8c02c53f admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:53.118595 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799d994-40cd-43b1-8069-1c8a8c02c53f admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:53.123135 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6925a85-7d3a-489a-9675-63da59b85cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:53.123824 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6925a85-7d3a-489a-9675-63da59b85cfe admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:53.124148 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6925a85-7d3a-489a-9675-63da59b85cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:53.124536 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6925a85-7d3a-489a-9675-63da59b85cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:53.125259 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6925a85-7d3a-489a-9675-63da59b85cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:53.126865 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6925a85-7d3a-489a-9675-63da59b85cfe admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:53.136595 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1269/2519] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:39:53.140962 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba7b3d-0da2-469b-8b54-8e9be5502893 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:53.150541 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba7b3d-0da2-469b-8b54-8e9be5502893 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:53.155000 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bd72ef-cf3d-4c89-9e01-ebdfbf15745b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:53.156542 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd72ef-cf3d-4c89-9e01-ebdfbf15745b admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:53.156821 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd72ef-cf3d-4c89-9e01-ebdfbf15745b admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:53.157094 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd72ef-cf3d-4c89-9e01-ebdfbf15745b admin admin] PATH_INFO: `/v3/projects/127d387b45a9497a952cdbd7e2e8cdb4/users/c3787a64087148048b4c7d4089fa1891/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:53.171003 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bd72ef-cf3d-4c89-9e01-ebdfbf15745b admin admin] RBAC: Authorizing `identity:create_grant(project_id=127d387b45a9497a952cdbd7e2e8cdb4, user_id=c3787a64087148048b4c7d4089fa1891, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:53.173629 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bd72ef-cf3d-4c89-9e01-ebdfbf15745b admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:53.241216 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1251/2520] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:39:53 2022] PUT /identity/v3/projects/127d387b45a9497a952cdbd7e2e8cdb4/users/c3787a64087148048b4c7d4089fa1891/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:39:53.251928 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113014c-83b6-4337-a650-13da1f76c40a None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:53.252220 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113014c-83b6-4337-a650-13da1f76c40a None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:53.252496 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113014c-83b6-4337-a650-13da1f76c40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:53.279018 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-7113014c-83b6-4337-a650-13da1f76c40a None None] MFA Rules not processed for user `c3787a64087148048b4c7d4089fa1891`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:39:53.280302 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-7113014c-83b6-4337-a650-13da1f76c40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:53.292674 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:39:53.346044 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1270/2521] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:39:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:39:53.350496 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bd72ef-cf3d-4c89-9e01-ebdfbf15745b admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:53.414600 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bd72ef-cf3d-4c89-9e01-ebdfbf15745b admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:53.420881 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b9f91-2349-4b51-b982-d43215d68fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:53.421841 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b9f91-2349-4b51-b982-d43215d68fce admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:53.422162 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b9f91-2349-4b51-b982-d43215d68fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:53.422434 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b9f91-2349-4b51-b982-d43215d68fce admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:53.423130 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6b9f91-2349-4b51-b982-d43215d68fce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:53.425208 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6b9f91-2349-4b51-b982-d43215d68fce admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:53.488074 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:39:53.495342 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1252/2522] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:39:53 2022] POST /identity/v3/projects => generated 379 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:39:53.500016 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113014c-83b6-4337-a650-13da1f76c40a None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:53.510888 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113014c-83b6-4337-a650-13da1f76c40a None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:53.567553 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a66a9-6d06-48fc-bc50-b0adc099d213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:53.568242 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a66a9-6d06-48fc-bc50-b0adc099d213 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:53.568878 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a66a9-6d06-48fc-bc50-b0adc099d213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:53.569187 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a66a9-6d06-48fc-bc50-b0adc099d213 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:53.569853 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a66a9-6d06-48fc-bc50-b0adc099d213 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:53.571816 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a66a9-6d06-48fc-bc50-b0adc099d213 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:53.672291 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1271/2523] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:39:53 2022] POST /identity/v3/users => generated 290 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:39:53.673466 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b9f91-2349-4b51-b982-d43215d68fce admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:53.687761 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b9f91-2349-4b51-b982-d43215d68fce admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:53.689081 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc151dee-845e-4b59-b7b5-6a9e741aeb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:53.694978 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc151dee-845e-4b59-b7b5-6a9e741aeb20 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:53.694978 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc151dee-845e-4b59-b7b5-6a9e741aeb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:53.694978 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc151dee-845e-4b59-b7b5-6a9e741aeb20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:53.694978 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc151dee-845e-4b59-b7b5-6a9e741aeb20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:53.694978 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc151dee-845e-4b59-b7b5-6a9e741aeb20 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:53.703824 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1253/2524] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:39:53.707854 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a66a9-6d06-48fc-bc50-b0adc099d213 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:53.718654 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a66a9-6d06-48fc-bc50-b0adc099d213 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:53.723485 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843497f3-e6a0-42e1-9216-9016cf1bc5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:53.724146 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843497f3-e6a0-42e1-9216-9016cf1bc5cb admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:53.724432 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843497f3-e6a0-42e1-9216-9016cf1bc5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:53.724709 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843497f3-e6a0-42e1-9216-9016cf1bc5cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:53.725477 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843497f3-e6a0-42e1-9216-9016cf1bc5cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:53.727128 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843497f3-e6a0-42e1-9216-9016cf1bc5cb admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:53.738157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1272/2525] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:39:53.742484 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc151dee-845e-4b59-b7b5-6a9e741aeb20 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:53.753982 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc151dee-845e-4b59-b7b5-6a9e741aeb20 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:53.758890 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851d476-0e77-47d7-a5b8-db5c3644945b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:53.759799 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851d476-0e77-47d7-a5b8-db5c3644945b admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:53.760088 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851d476-0e77-47d7-a5b8-db5c3644945b admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:53.760369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851d476-0e77-47d7-a5b8-db5c3644945b admin admin] PATH_INFO: `/v3/projects/ddb35c2ef5af460d8de1bc95e70d6cff/users/b6c6873a15534d0c879ab5e89ee2fbfe/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:53.774824 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d851d476-0e77-47d7-a5b8-db5c3644945b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddb35c2ef5af460d8de1bc95e70d6cff, user_id=b6c6873a15534d0c879ab5e89ee2fbfe, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:53.777681 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d851d476-0e77-47d7-a5b8-db5c3644945b admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:53.834383 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1254/2526] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:39:53 2022] PUT /identity/v3/projects/ddb35c2ef5af460d8de1bc95e70d6cff/users/b6c6873a15534d0c879ab5e89ee2fbfe/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:39:53.851696 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48400d04-e8a5-4078-bf7b-0c1653cdd558 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:53.851990 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48400d04-e8a5-4078-bf7b-0c1653cdd558 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:53.852274 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48400d04-e8a5-4078-bf7b-0c1653cdd558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:53.879935 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-48400d04-e8a5-4078-bf7b-0c1653cdd558 None None] MFA Rules not processed for user `b6c6873a15534d0c879ab5e89ee2fbfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:39:53.881146 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-48400d04-e8a5-4078-bf7b-0c1653cdd558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:53.955941 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1273/2527] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:39:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:39:53.957029 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851d476-0e77-47d7-a5b8-db5c3644945b admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:54.017163 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851d476-0e77-47d7-a5b8-db5c3644945b admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:54.021683 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9966f-eb07-4072-8eb8-ccf6be871346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:54.022335 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9966f-eb07-4072-8eb8-ccf6be871346 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:54.022619 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9966f-eb07-4072-8eb8-ccf6be871346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:54.022894 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9966f-eb07-4072-8eb8-ccf6be871346 admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:54.023604 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea9966f-eb07-4072-8eb8-ccf6be871346 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:54.025481 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea9966f-eb07-4072-8eb8-ccf6be871346 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:54.126270 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1255/2528] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:39:53 2022] POST /identity/v3/projects => generated 377 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:39:54.130356 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48400d04-e8a5-4078-bf7b-0c1653cdd558 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:54.141517 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48400d04-e8a5-4078-bf7b-0c1653cdd558 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:54.161501 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:39:54.198296 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96834e2-53d3-4e97-b298-90748309c702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:54.198963 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96834e2-53d3-4e97-b298-90748309c702 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:54.199246 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96834e2-53d3-4e97-b298-90748309c702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:54.199549 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96834e2-53d3-4e97-b298-90748309c702 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:54.200241 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96834e2-53d3-4e97-b298-90748309c702 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:54.202179 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96834e2-53d3-4e97-b298-90748309c702 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:54.314229 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1274/2529] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:39:54 2022] POST /identity/v3/users => generated 295 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:39:54.318186 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9966f-eb07-4072-8eb8-ccf6be871346 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:54.329571 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9966f-eb07-4072-8eb8-ccf6be871346 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:54.334144 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2da41-8b8c-4693-b719-b52f459e5222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:54.334828 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2da41-8b8c-4693-b719-b52f459e5222 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:54.335113 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2da41-8b8c-4693-b719-b52f459e5222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:54.335390 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2da41-8b8c-4693-b719-b52f459e5222 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:54.336145 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2da41-8b8c-4693-b719-b52f459e5222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:54.337722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2da41-8b8c-4693-b719-b52f459e5222 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:54.348285 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1256/2530] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:39:54.352342 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96834e2-53d3-4e97-b298-90748309c702 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:54.362995 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96834e2-53d3-4e97-b298-90748309c702 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:54.367639 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8afa61-1b58-44ce-be33-73d10b8a8e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:54.368527 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8afa61-1b58-44ce-be33-73d10b8a8e4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:54.368811 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8afa61-1b58-44ce-be33-73d10b8a8e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:54.369089 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8afa61-1b58-44ce-be33-73d10b8a8e4b admin admin] PATH_INFO: `/v3/projects/bf11864af90c4cef957dc8465bd86c6b/users/1c56a79af7774d42b3ac10e8292755d7/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:54.384596 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8afa61-1b58-44ce-be33-73d10b8a8e4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf11864af90c4cef957dc8465bd86c6b, user_id=1c56a79af7774d42b3ac10e8292755d7, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:54.387223 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8afa61-1b58-44ce-be33-73d10b8a8e4b admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:54.479582 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1275/2531] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:39:54 2022] PUT /identity/v3/projects/bf11864af90c4cef957dc8465bd86c6b/users/1c56a79af7774d42b3ac10e8292755d7/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:39:54.484474 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2da41-8b8c-4693-b719-b52f459e5222 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:54.494411 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2da41-8b8c-4693-b719-b52f459e5222 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:54.549582 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36adc64c-bc97-475f-be4d-609def921cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:54.550244 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36adc64c-bc97-475f-be4d-609def921cce admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:54.550526 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36adc64c-bc97-475f-be4d-609def921cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:54.550806 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36adc64c-bc97-475f-be4d-609def921cce admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:54.551550 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36adc64c-bc97-475f-be4d-609def921cce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:54.553127 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36adc64c-bc97-475f-be4d-609def921cce admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:54.563142 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1257/2532] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:39:54.567572 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8afa61-1b58-44ce-be33-73d10b8a8e4b admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:54.578437 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8afa61-1b58-44ce-be33-73d10b8a8e4b admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:54.583340 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f18b1-59e8-42a5-8d09-ecd0963a9c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:54.584238 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f18b1-59e8-42a5-8d09-ecd0963a9c21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:54.584524 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f18b1-59e8-42a5-8d09-ecd0963a9c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:54.584800 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f18b1-59e8-42a5-8d09-ecd0963a9c21 admin admin] PATH_INFO: `/v3/projects/bf11864af90c4cef957dc8465bd86c6b/users/1c56a79af7774d42b3ac10e8292755d7/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:54.586761 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f18b1-59e8-42a5-8d09-ecd0963a9c21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf11864af90c4cef957dc8465bd86c6b, user_id=1c56a79af7774d42b3ac10e8292755d7, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:54.589426 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f18b1-59e8-42a5-8d09-ecd0963a9c21 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:54.600151 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1276/2533] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:39:54 2022] PUT /identity/v3/projects/bf11864af90c4cef957dc8465bd86c6b/users/1c56a79af7774d42b3ac10e8292755d7/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:39:54.612721 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f312740-27e9-446d-84c0-feed2786df4c None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:54.613018 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f312740-27e9-446d-84c0-feed2786df4c None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:54.613294 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f312740-27e9-446d-84c0-feed2786df4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:54.639712 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-3f312740-27e9-446d-84c0-feed2786df4c None None] MFA Rules not processed for user `1c56a79af7774d42b3ac10e8292755d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:39:54.641085 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-3f312740-27e9-446d-84c0-feed2786df4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:54.664152 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:39:54.707106 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1258/2534] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:39:54 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:39:54.718890 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f18b1-59e8-42a5-8d09-ecd0963a9c21 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:54.720515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-749f18b1-59e8-42a5-8d09-ecd0963a9c21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:54.787514 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f18b1-59e8-42a5-8d09-ecd0963a9c21 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:54.792275 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7ef35-ab3e-49dd-8591-c62ef82f0cf1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:54.792275 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7ef35-ab3e-49dd-8591-c62ef82f0cf1 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:54.792569 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f312740-27e9-446d-84c0-feed2786df4c None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:54.792668 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7ef35-ab3e-49dd-8591-c62ef82f0cf1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:54.792668 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7ef35-ab3e-49dd-8591-c62ef82f0cf1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:54.793546 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-3f312740-27e9-446d-84c0-feed2786df4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:54.803300 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa7ef35-ab3e-49dd-8591-c62ef82f0cf1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:54.804755 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa7ef35-ab3e-49dd-8591-c62ef82f0cf1 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:54.814514 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1277/2535] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:39:54 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:39:54.853758 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f312740-27e9-446d-84c0-feed2786df4c None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:54.857506 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60249fe6-60c5-49b1-969d-b64753fd64bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:54.858222 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60249fe6-60c5-49b1-969d-b64753fd64bb service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:54.859201 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60249fe6-60c5-49b1-969d-b64753fd64bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:54.859511 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60249fe6-60c5-49b1-969d-b64753fd64bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:54.861363 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-60249fe6-60c5-49b1-969d-b64753fd64bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:54.924061 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60249fe6-60c5-49b1-969d-b64753fd64bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:54.925499 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60249fe6-60c5-49b1-969d-b64753fd64bb service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:54.933402 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7ef35-ab3e-49dd-8591-c62ef82f0cf1 service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:54.934777 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-caa7ef35-ab3e-49dd-8591-c62ef82f0cf1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:54.935519 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1259/2536] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:39:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 19:39:54.946849 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7ef35-ab3e-49dd-8591-c62ef82f0cf1 service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:54.950625 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a08c6-66f2-446c-bc4b-442077b1fcf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:54.951271 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a08c6-66f2-446c-bc4b-442077b1fcf2 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:54.951596 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a08c6-66f2-446c-bc4b-442077b1fcf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:54.951873 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a08c6-66f2-446c-bc4b-442077b1fcf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:55.010710 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a08c6-66f2-446c-bc4b-442077b1fcf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:55.012211 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a08c6-66f2-446c-bc4b-442077b1fcf2 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:55.021781 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1278/2537] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:39:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:39:58.587889 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60249fe6-60c5-49b1-969d-b64753fd64bb service neutron] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:58.589462 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-60249fe6-60c5-49b1-969d-b64753fd64bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:58.660413 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60249fe6-60c5-49b1-969d-b64753fd64bb service neutron] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:58.665377 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e9e52-c66b-44ed-a257-9422fb84b9fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcc5eefc2f7c419190e96b46b163fedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:58.666021 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e9e52-c66b-44ed-a257-9422fb84b9fe service placement] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:58.666309 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e9e52-c66b-44ed-a257-9422fb84b9fe service placement] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:58.666587 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e9e52-c66b-44ed-a257-9422fb84b9fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:58.669888 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-dd9e9e52-c66b-44ed-a257-9422fb84b9fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:58.680527 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9e9e52-c66b-44ed-a257-9422fb84b9fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:58.682088 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9e9e52-c66b-44ed-a257-9422fb84b9fe service placement] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:58.687551 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:39:58.692361 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1260/2538] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:39:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:39:58.735236 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a08c6-66f2-446c-bc4b-442077b1fcf2 service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:58.736859 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-864a08c6-66f2-446c-bc4b-442077b1fcf2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:58.753374 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a08c6-66f2-446c-bc4b-442077b1fcf2 service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:58.760287 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837a763-1558-4701-92a6-7e696e0e6834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:58.760287 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837a763-1558-4701-92a6-7e696e0e6834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:58.760287 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837a763-1558-4701-92a6-7e696e0e6834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:58.760287 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837a763-1558-4701-92a6-7e696e0e6834 admin admin] PATH_INFO: `/v3/users/42b8bcddb4a24befbad0a5f4ac7ad925` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:58.760809 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9837a763-1558-4701-92a6-7e696e0e6834 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42b8bcddb4a24befbad0a5f4ac7ad925)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:58.763252 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9837a763-1558-4701-92a6-7e696e0e6834 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:58.777539 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:39:58.958730 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-9837a763-1558-4701-92a6-7e696e0e6834 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42b8bcddb4a24befbad0a5f4ac7ad925'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:59.029347 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-9837a763-1558-4701-92a6-7e696e0e6834 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42b8bcddb4a24befbad0a5f4ac7ad925'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:59.029955 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-9837a763-1558-4701-92a6-7e696e0e6834 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42b8bcddb4a24befbad0a5f4ac7ad925'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:59.037585 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-9837a763-1558-4701-92a6-7e696e0e6834 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42b8bcddb4a24befbad0a5f4ac7ad925'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:59.050250 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-9837a763-1558-4701-92a6-7e696e0e6834 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42b8bcddb4a24befbad0a5f4ac7ad925'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:59.056204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1279/2539] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:39:58 2022] DELETE /identity/v3/users/42b8bcddb4a24befbad0a5f4ac7ad925 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:39:59.106888 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e9e52-c66b-44ed-a257-9422fb84b9fe service placement] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:59.118002 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e9e52-c66b-44ed-a257-9422fb84b9fe service placement] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:59.176501 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b13c1-92fd-42ac-8f02-92afca89d963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:59.177512 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b13c1-92fd-42ac-8f02-92afca89d963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:59.177804 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b13c1-92fd-42ac-8f02-92afca89d963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:59.178090 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b13c1-92fd-42ac-8f02-92afca89d963 admin admin] PATH_INFO: `/v3/users/c3787a64087148048b4c7d4089fa1891` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:59.179277 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b13c1-92fd-42ac-8f02-92afca89d963 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3787a64087148048b4c7d4089fa1891)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:59.181229 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b13c1-92fd-42ac-8f02-92afca89d963 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:59.340413 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837a763-1558-4701-92a6-7e696e0e6834 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:59.341997 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-9837a763-1558-4701-92a6-7e696e0e6834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:59.359284 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837a763-1558-4701-92a6-7e696e0e6834 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:59.364035 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97a6c0-64dd-4254-9ceb-1ce052de836a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:59.365154 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97a6c0-64dd-4254-9ceb-1ce052de836a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:59.365520 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97a6c0-64dd-4254-9ceb-1ce052de836a admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:59.365976 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97a6c0-64dd-4254-9ceb-1ce052de836a admin admin] PATH_INFO: `/v3/projects/10cd5ec162104cf7aed88c015a3db767` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:59.367639 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad97a6c0-64dd-4254-9ceb-1ce052de836a admin admin] RBAC: Authorizing `identity:delete_project(project_id=10cd5ec162104cf7aed88c015a3db767)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:59.370124 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad97a6c0-64dd-4254-9ceb-1ce052de836a admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:59.392205 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-2e6b13c1-92fd-42ac-8f02-92afca89d963 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3787a64087148048b4c7d4089fa1891'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:59.469854 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-2e6b13c1-92fd-42ac-8f02-92afca89d963 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3787a64087148048b4c7d4089fa1891'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:59.482564 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-2e6b13c1-92fd-42ac-8f02-92afca89d963 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3787a64087148048b4c7d4089fa1891'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:59.483190 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-2e6b13c1-92fd-42ac-8f02-92afca89d963 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3787a64087148048b4c7d4089fa1891'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:59.490268 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-2e6b13c1-92fd-42ac-8f02-92afca89d963 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3787a64087148048b4c7d4089fa1891'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:59.496457 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1261/2540] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:39:59 2022] DELETE /identity/v3/users/c3787a64087148048b4c7d4089fa1891 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:39:59.501303 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f5d91-c317-4893-896e-939d48a622e7 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:59.507832 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f5d91-c317-4893-896e-939d48a622e7 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:59.507832 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f5d91-c317-4893-896e-939d48a622e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:59.512384 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ad97a6c0-64dd-4254-9ceb-1ce052de836a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10cd5ec162104cf7aed88c015a3db767', 'request_id': 'req-ad97a6c0-64dd-4254-9ceb-1ce052de836a'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:59.519372 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ad97a6c0-64dd-4254-9ceb-1ce052de836a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10cd5ec162104cf7aed88c015a3db767', 'request_id': 'req-ad97a6c0-64dd-4254-9ceb-1ce052de836a'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:59.520879 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-c83f5d91-c317-4893-896e-939d48a622e7 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:39:59.522119 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-c83f5d91-c317-4893-896e-939d48a622e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:59.572371 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ad97a6c0-64dd-4254-9ceb-1ce052de836a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10cd5ec162104cf7aed88c015a3db767', 'request_id': 'req-ad97a6c0-64dd-4254-9ceb-1ce052de836a'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:59.580791 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1262/2541] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:39:59.584484 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ad97a6c0-64dd-4254-9ceb-1ce052de836a admin admin] The token cache is being invalidate because project 10cd5ec162104cf7aed88c015a3db767 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:39:59.584902 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ad97a6c0-64dd-4254-9ceb-1ce052de836a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:59.585567 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ad97a6c0-64dd-4254-9ceb-1ce052de836a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:39:59.587125 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1280/2542] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:39:59 2022] DELETE /identity/v3/projects/10cd5ec162104cf7aed88c015a3db767 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:39:59.590429 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f5d91-c317-4893-896e-939d48a622e7 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:59.591598 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-c83f5d91-c317-4893-896e-939d48a622e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:59.591737 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4abc6-541e-457e-9189-ca8f3b910dc2 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:59.592008 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4abc6-541e-457e-9189-ca8f3b910dc2 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:59.592292 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4abc6-541e-457e-9189-ca8f3b910dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:59.611759 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-b5e4abc6-541e-457e-9189-ca8f3b910dc2 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:39:59.612999 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-b5e4abc6-541e-457e-9189-ca8f3b910dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:59.614488 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:39:59.621060 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1281/2543] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:39:59.629282 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43377ffd-4082-4163-9101-7bb71d9508c7 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:59.629571 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43377ffd-4082-4163-9101-7bb71d9508c7 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:59.629851 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43377ffd-4082-4163-9101-7bb71d9508c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:59.648246 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-43377ffd-4082-4163-9101-7bb71d9508c7 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:39:59.649443 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-43377ffd-4082-4163-9101-7bb71d9508c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:59.656788 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f5d91-c317-4893-896e-939d48a622e7 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:59.661310 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1282/2544] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:39:59.662467 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43377ffd-4082-4163-9101-7bb71d9508c7 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:59.664812 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c3c45-0fba-441a-b30b-ab9eee46c3d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:59.665472 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c3c45-0fba-441a-b30b-ab9eee46c3d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:59.665754 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c3c45-0fba-441a-b30b-ab9eee46c3d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:59.666029 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c3c45-0fba-441a-b30b-ab9eee46c3d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:59.668759 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-199c3c45-0fba-441a-b30b-ab9eee46c3d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:39:59.671901 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43377ffd-4082-4163-9101-7bb71d9508c7 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:59.677158 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f78e503-8448-4cde-9f70-a24381d2df94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:59.677863 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78e503-8448-4cde-9f70-a24381d2df94 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:59.678140 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78e503-8448-4cde-9f70-a24381d2df94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:59.678417 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78e503-8448-4cde-9f70-a24381d2df94 admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:59.679145 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f78e503-8448-4cde-9f70-a24381d2df94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:39:59.679474 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f78e503-8448-4cde-9f70-a24381d2df94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:59.680864 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c3c45-0fba-441a-b30b-ab9eee46c3d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:59.681091 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f78e503-8448-4cde-9f70-a24381d2df94 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:59.682277 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c3c45-0fba-441a-b30b-ab9eee46c3d4 service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:59.692202 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1263/2545] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:39:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 19:39:59.694382 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1283/2546] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:39:59.698592 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c3c45-0fba-441a-b30b-ab9eee46c3d4 service neutron] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:59.708655 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c3c45-0fba-441a-b30b-ab9eee46c3d4 service neutron] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:59.713640 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9f82a-fd22-4e02-9bb2-35934f640a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:59.714647 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9f82a-fd22-4e02-9bb2-35934f640a72 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:59.714932 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9f82a-fd22-4e02-9bb2-35934f640a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:59.715221 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9f82a-fd22-4e02-9bb2-35934f640a72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:59.715945 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e9f82a-fd22-4e02-9bb2-35934f640a72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:59.717892 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e9f82a-fd22-4e02-9bb2-35934f640a72 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:39:59.830215 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1264/2547] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:39:59 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:39:59.834526 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f78e503-8448-4cde-9f70-a24381d2df94 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:39:59.845527 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f78e503-8448-4cde-9f70-a24381d2df94 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:39:59.892910 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:39:59.906984 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b428b9d-ba8a-48b4-a561-82c2a6d7c1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:39:59.908340 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b428b9d-ba8a-48b4-a561-82c2a6d7c1c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:39:59.908730 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b428b9d-ba8a-48b4-a561-82c2a6d7c1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:39:59.911760 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b428b9d-ba8a-48b4-a561-82c2a6d7c1c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:39:59.911760 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b428b9d-ba8a-48b4-a561-82c2a6d7c1c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:39:59.912936 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b428b9d-ba8a-48b4-a561-82c2a6d7c1c0 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:00.016280 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1284/2548] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:39:59 2022] POST /identity/v3/users => generated 287 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:40:00.017514 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9f82a-fd22-4e02-9bb2-35934f640a72 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:00.027666 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9f82a-fd22-4e02-9bb2-35934f640a72 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:00.032382 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f864d-9ae4-4523-9103-7f796abf189c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:00.033039 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f864d-9ae4-4523-9103-7f796abf189c admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:00.033320 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f864d-9ae4-4523-9103-7f796abf189c admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:00.033596 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f864d-9ae4-4523-9103-7f796abf189c admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:00.034366 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f864d-9ae4-4523-9103-7f796abf189c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:00.035941 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f864d-9ae4-4523-9103-7f796abf189c admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:00.046194 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1265/2549] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:40:00.050375 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b428b9d-ba8a-48b4-a561-82c2a6d7c1c0 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:00.060586 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b428b9d-ba8a-48b4-a561-82c2a6d7c1c0 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:00.065654 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819984c4-5735-4ae4-bb10-3bda15839b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:00.066327 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819984c4-5735-4ae4-bb10-3bda15839b9f admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:00.066591 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819984c4-5735-4ae4-bb10-3bda15839b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:00.071005 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819984c4-5735-4ae4-bb10-3bda15839b9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:00.071005 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819984c4-5735-4ae4-bb10-3bda15839b9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:00.071005 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819984c4-5735-4ae4-bb10-3bda15839b9f admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:00.080571 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1285/2550] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:40:00.084668 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f864d-9ae4-4523-9103-7f796abf189c admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:00.094651 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f864d-9ae4-4523-9103-7f796abf189c admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:00.099226 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f3ac6-6261-486c-b0a6-be9e58d5bbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:00.100140 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f3ac6-6261-486c-b0a6-be9e58d5bbdb admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:00.100413 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f3ac6-6261-486c-b0a6-be9e58d5bbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:00.100690 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f3ac6-6261-486c-b0a6-be9e58d5bbdb admin admin] PATH_INFO: `/v3/projects/440b8b25a6a2461a92751b34c155b2c0/users/7d6cf7577d78496daa2f1ffe742906a5/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:00.115277 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f3ac6-6261-486c-b0a6-be9e58d5bbdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=440b8b25a6a2461a92751b34c155b2c0, user_id=7d6cf7577d78496daa2f1ffe742906a5, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:00.118091 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f3ac6-6261-486c-b0a6-be9e58d5bbdb admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:00.128424 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819984c4-5735-4ae4-bb10-3bda15839b9f admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:00.129919 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-819984c4-5735-4ae4-bb10-3bda15839b9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:00.143777 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819984c4-5735-4ae4-bb10-3bda15839b9f admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:00.148590 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fecec7-cc5d-4e23-b2d7-e5a7022ffaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:00.149453 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fecec7-cc5d-4e23-b2d7-e5a7022ffaa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:00.149735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fecec7-cc5d-4e23-b2d7-e5a7022ffaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:00.150010 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fecec7-cc5d-4e23-b2d7-e5a7022ffaa1 admin admin] PATH_INFO: `/v3/projects/127d387b45a9497a952cdbd7e2e8cdb4` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:00.151214 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fecec7-cc5d-4e23-b2d7-e5a7022ffaa1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=127d387b45a9497a952cdbd7e2e8cdb4)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:00.153183 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fecec7-cc5d-4e23-b2d7-e5a7022ffaa1 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:00.218922 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1266/2551] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:40:00 2022] PUT /identity/v3/projects/440b8b25a6a2461a92751b34c155b2c0/users/7d6cf7577d78496daa2f1ffe742906a5/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:40:00.229012 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9cb710-e75a-4fde-aab2-9c47ebcb7bd1 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:00.229309 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9cb710-e75a-4fde-aab2-9c47ebcb7bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:00.229594 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9cb710-e75a-4fde-aab2-9c47ebcb7bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:00.255512 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-fd9cb710-e75a-4fde-aab2-9c47ebcb7bd1 None None] MFA Rules not processed for user `7d6cf7577d78496daa2f1ffe742906a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:40:00.256720 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-fd9cb710-e75a-4fde-aab2-9c47ebcb7bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:00.301846 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-43fecec7-cc5d-4e23-b2d7-e5a7022ffaa1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '127d387b45a9497a952cdbd7e2e8cdb4', 'request_id': 'req-43fecec7-cc5d-4e23-b2d7-e5a7022ffaa1'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:00.308236 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-43fecec7-cc5d-4e23-b2d7-e5a7022ffaa1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '127d387b45a9497a952cdbd7e2e8cdb4', 'request_id': 'req-43fecec7-cc5d-4e23-b2d7-e5a7022ffaa1'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:00.323322 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1267/2552] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:40:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:40:00.328163 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9cb710-e75a-4fde-aab2-9c47ebcb7bd1 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:00.385163 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:40:00.390970 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9cb710-e75a-4fde-aab2-9c47ebcb7bd1 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:00.393307 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-43fecec7-cc5d-4e23-b2d7-e5a7022ffaa1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '127d387b45a9497a952cdbd7e2e8cdb4', 'request_id': 'req-43fecec7-cc5d-4e23-b2d7-e5a7022ffaa1'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:00.404491 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-43fecec7-cc5d-4e23-b2d7-e5a7022ffaa1 admin admin] The token cache is being invalidate because project 127d387b45a9497a952cdbd7e2e8cdb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:40:00.404781 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-43fecec7-cc5d-4e23-b2d7-e5a7022ffaa1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:00.406830 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-43fecec7-cc5d-4e23-b2d7-e5a7022ffaa1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:00.408446 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1286/2553] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:40:00 2022] DELETE /identity/v3/projects/127d387b45a9497a952cdbd7e2e8cdb4 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:40:00.412432 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fecec7-cc5d-4e23-b2d7-e5a7022ffaa1 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:00.413801 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-43fecec7-cc5d-4e23-b2d7-e5a7022ffaa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:00.450494 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5e0b2-7903-4e8a-9473-e06a92aaf7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:00.451165 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5e0b2-7903-4e8a-9473-e06a92aaf7cd admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:00.451478 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5e0b2-7903-4e8a-9473-e06a92aaf7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:00.451766 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5e0b2-7903-4e8a-9473-e06a92aaf7cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:00.453080 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d5e0b2-7903-4e8a-9473-e06a92aaf7cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:00.455283 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d5e0b2-7903-4e8a-9473-e06a92aaf7cd admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:00.483938 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fecec7-cc5d-4e23-b2d7-e5a7022ffaa1 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:00.488574 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfecc51-eef0-482e-9e72-c06ffd179d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:00.489446 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfecc51-eef0-482e-9e72-c06ffd179d55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:00.489724 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfecc51-eef0-482e-9e72-c06ffd179d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:00.494816 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfecc51-eef0-482e-9e72-c06ffd179d55 admin admin] PATH_INFO: `/v3/users/b6c6873a15534d0c879ab5e89ee2fbfe` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:00.494816 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfecc51-eef0-482e-9e72-c06ffd179d55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6c6873a15534d0c879ab5e89ee2fbfe)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:00.494816 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfecc51-eef0-482e-9e72-c06ffd179d55 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:00.549445 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1268/2554] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:40:00 2022] POST /identity/v3/projects => generated 371 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 19:40:00.553410 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5e0b2-7903-4e8a-9473-e06a92aaf7cd admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:00.554989 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-f9d5e0b2-7903-4e8a-9473-e06a92aaf7cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:00.616207 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5e0b2-7903-4e8a-9473-e06a92aaf7cd admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:00.621138 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa3998-e0a5-41d9-8c4c-2c8cb62e18e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:00.621915 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa3998-e0a5-41d9-8c4c-2c8cb62e18e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:00.622197 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa3998-e0a5-41d9-8c4c-2c8cb62e18e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:00.622471 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa3998-e0a5-41d9-8c4c-2c8cb62e18e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:00.623145 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfa3998-e0a5-41d9-8c4c-2c8cb62e18e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:00.625245 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfa3998-e0a5-41d9-8c4c-2c8cb62e18e1 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:00.721960 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1269/2555] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:40:00 2022] POST /identity/v3/users => generated 292 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 19:40:00.724061 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-bbfecc51-eef0-482e-9e72-c06ffd179d55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6c6873a15534d0c879ab5e89ee2fbfe'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:00.725865 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa3998-e0a5-41d9-8c4c-2c8cb62e18e1 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:00.726697 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=81,keystone:INSERT=5,keystone:DELETE=14 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:40:00.735497 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa3998-e0a5-41d9-8c4c-2c8cb62e18e1 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:00.740088 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5d6e9-3593-40ff-9a8c-19714ed2a6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:00.740771 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5d6e9-3593-40ff-9a8c-19714ed2a6a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:00.741056 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5d6e9-3593-40ff-9a8c-19714ed2a6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:00.741335 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5d6e9-3593-40ff-9a8c-19714ed2a6a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:00.742086 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5d6e9-3593-40ff-9a8c-19714ed2a6a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:00.743704 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5d6e9-3593-40ff-9a8c-19714ed2a6a7 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:00.753960 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1270/2556] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:40:00.758008 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5d6e9-3593-40ff-9a8c-19714ed2a6a7 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:00.768009 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5d6e9-3593-40ff-9a8c-19714ed2a6a7 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:00.772790 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b227845-2e1a-468d-954c-cb467fb6caa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:00.773668 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b227845-2e1a-468d-954c-cb467fb6caa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:00.773953 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b227845-2e1a-468d-954c-cb467fb6caa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:00.774231 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b227845-2e1a-468d-954c-cb467fb6caa2 admin admin] PATH_INFO: `/v3/projects/be439e9f679245fcb999f176c91d1161/users/16a38a188e94408388dd0a33ee4edfb4/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:00.788670 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b227845-2e1a-468d-954c-cb467fb6caa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be439e9f679245fcb999f176c91d1161, user_id=16a38a188e94408388dd0a33ee4edfb4, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:00.791272 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b227845-2e1a-468d-954c-cb467fb6caa2 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:00.810761 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-bbfecc51-eef0-482e-9e72-c06ffd179d55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6c6873a15534d0c879ab5e89ee2fbfe'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:00.811313 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-bbfecc51-eef0-482e-9e72-c06ffd179d55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6c6873a15534d0c879ab5e89ee2fbfe'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:00.819666 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-bbfecc51-eef0-482e-9e72-c06ffd179d55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6c6873a15534d0c879ab5e89ee2fbfe'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:00.832663 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-bbfecc51-eef0-482e-9e72-c06ffd179d55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6c6873a15534d0c879ab5e89ee2fbfe'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:00.838880 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1287/2557] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:40:00 2022] DELETE /identity/v3/users/b6c6873a15534d0c879ab5e89ee2fbfe => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:40:00.908853 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1271/2558] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:40:00 2022] PUT /identity/v3/projects/be439e9f679245fcb999f176c91d1161/users/16a38a188e94408388dd0a33ee4edfb4/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:40:00.912868 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfecc51-eef0-482e-9e72-c06ffd179d55 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:00.914359 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-bbfecc51-eef0-482e-9e72-c06ffd179d55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:00.981027 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfecc51-eef0-482e-9e72-c06ffd179d55 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:01.043301 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd70eb64-41ab-4332-80dc-1a1651243e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:01.044079 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd70eb64-41ab-4332-80dc-1a1651243e34 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:01.044363 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd70eb64-41ab-4332-80dc-1a1651243e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:01.044638 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd70eb64-41ab-4332-80dc-1a1651243e34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:01.045366 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd70eb64-41ab-4332-80dc-1a1651243e34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:01.047276 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd70eb64-41ab-4332-80dc-1a1651243e34 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:01.057508 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1288/2559] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:40:01.065306 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b227845-2e1a-468d-954c-cb467fb6caa2 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:01.072846 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b227845-2e1a-468d-954c-cb467fb6caa2 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:01.078962 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b895955-c9d3-4842-8c1f-427ace034de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:01.079888 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b895955-c9d3-4842-8c1f-427ace034de3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:01.080171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b895955-c9d3-4842-8c1f-427ace034de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:01.080447 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b895955-c9d3-4842-8c1f-427ace034de3 admin admin] PATH_INFO: `/v3/projects/be439e9f679245fcb999f176c91d1161/users/16a38a188e94408388dd0a33ee4edfb4/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:01.082520 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b895955-c9d3-4842-8c1f-427ace034de3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be439e9f679245fcb999f176c91d1161, user_id=16a38a188e94408388dd0a33ee4edfb4, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:01.085670 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b895955-c9d3-4842-8c1f-427ace034de3 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:01.096458 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1272/2560] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:40:01 2022] PUT /identity/v3/projects/be439e9f679245fcb999f176c91d1161/users/16a38a188e94408388dd0a33ee4edfb4/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:40:01.111752 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3b33b-ed36-45d7-a852-1445afa46d20 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:01.112044 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3b33b-ed36-45d7-a852-1445afa46d20 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:01.112326 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3b33b-ed36-45d7-a852-1445afa46d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:01.139874 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-34f3b33b-ed36-45d7-a852-1445afa46d20 None None] MFA Rules not processed for user `16a38a188e94408388dd0a33ee4edfb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:40:01.141116 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-34f3b33b-ed36-45d7-a852-1445afa46d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:01.211991 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1289/2561] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:40:01 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:40:01.223538 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b895955-c9d3-4842-8c1f-427ace034de3 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:01.225202 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-4b895955-c9d3-4842-8c1f-427ace034de3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:01.257585 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:40:01.282812 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b895955-c9d3-4842-8c1f-427ace034de3 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:01.286620 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d106e-3df8-48c8-b04b-ff131fc3ae07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:01.287291 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d106e-3df8-48c8-b04b-ff131fc3ae07 service cinder] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:01.287672 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d106e-3df8-48c8-b04b-ff131fc3ae07 service cinder] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:01.292953 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d106e-3df8-48c8-b04b-ff131fc3ae07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:01.293179 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3b33b-ed36-45d7-a852-1445afa46d20 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:01.294111 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-34f3b33b-ed36-45d7-a852-1445afa46d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:01.300721 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338d106e-3df8-48c8-b04b-ff131fc3ae07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:01.302191 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338d106e-3df8-48c8-b04b-ff131fc3ae07 service cinder] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:01.313703 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1273/2562] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:40:01 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:40:01.372764 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3b33b-ed36-45d7-a852-1445afa46d20 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:01.378009 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe68108-3758-4dc5-8c73-051f87a7aafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:01.378902 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe68108-3758-4dc5-8c73-051f87a7aafa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:01.379190 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe68108-3758-4dc5-8c73-051f87a7aafa admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:01.379504 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe68108-3758-4dc5-8c73-051f87a7aafa admin admin] PATH_INFO: `/v3/projects/ddb35c2ef5af460d8de1bc95e70d6cff` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:01.380789 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe68108-3758-4dc5-8c73-051f87a7aafa admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddb35c2ef5af460d8de1bc95e70d6cff)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:01.382719 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe68108-3758-4dc5-8c73-051f87a7aafa admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:01.491397 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-cfe68108-3758-4dc5-8c73-051f87a7aafa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddb35c2ef5af460d8de1bc95e70d6cff', 'request_id': 'req-cfe68108-3758-4dc5-8c73-051f87a7aafa'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:01.497457 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-cfe68108-3758-4dc5-8c73-051f87a7aafa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddb35c2ef5af460d8de1bc95e70d6cff', 'request_id': 'req-cfe68108-3758-4dc5-8c73-051f87a7aafa'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:01.534428 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d106e-3df8-48c8-b04b-ff131fc3ae07 service cinder] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:01.542935 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d106e-3df8-48c8-b04b-ff131fc3ae07 service cinder] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:01.572488 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-cfe68108-3758-4dc5-8c73-051f87a7aafa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddb35c2ef5af460d8de1bc95e70d6cff', 'request_id': 'req-cfe68108-3758-4dc5-8c73-051f87a7aafa'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:01.583948 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-cfe68108-3758-4dc5-8c73-051f87a7aafa admin admin] The token cache is being invalidate because project ddb35c2ef5af460d8de1bc95e70d6cff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:40:01.584241 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-cfe68108-3758-4dc5-8c73-051f87a7aafa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:01.584906 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-cfe68108-3758-4dc5-8c73-051f87a7aafa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:01.586468 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1290/2563] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:40:01 2022] DELETE /identity/v3/projects/ddb35c2ef5af460d8de1bc95e70d6cff => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:40:01.590570 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe68108-3758-4dc5-8c73-051f87a7aafa admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:01.591917 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-cfe68108-3758-4dc5-8c73-051f87a7aafa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:01.593974 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781167eb-7c35-467b-ab3f-56e5d941bc2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:01.594779 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781167eb-7c35-467b-ab3f-56e5d941bc2b service cinder] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:01.595095 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781167eb-7c35-467b-ab3f-56e5d941bc2b service cinder] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:01.595401 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781167eb-7c35-467b-ab3f-56e5d941bc2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:01.599029 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-781167eb-7c35-467b-ab3f-56e5d941bc2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:01.621303 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:40:01.656762 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781167eb-7c35-467b-ab3f-56e5d941bc2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:01.658194 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781167eb-7c35-467b-ab3f-56e5d941bc2b service cinder] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:01.660320 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe68108-3758-4dc5-8c73-051f87a7aafa admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:01.665041 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87034f-9b92-4acd-a66f-48c734b123e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:01.665907 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87034f-9b92-4acd-a66f-48c734b123e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:01.666191 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87034f-9b92-4acd-a66f-48c734b123e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:01.666468 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87034f-9b92-4acd-a66f-48c734b123e3 admin admin] PATH_INFO: `/v3/users/1c56a79af7774d42b3ac10e8292755d7` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:01.667136 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1274/2564] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:40:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 19:40:01.669471 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87034f-9b92-4acd-a66f-48c734b123e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c56a79af7774d42b3ac10e8292755d7)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:01.672116 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87034f-9b92-4acd-a66f-48c734b123e3 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:01.898730 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-1a87034f-9b92-4acd-a66f-48c734b123e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c56a79af7774d42b3ac10e8292755d7'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:01.981942 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-1a87034f-9b92-4acd-a66f-48c734b123e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c56a79af7774d42b3ac10e8292755d7'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:01.982565 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-1a87034f-9b92-4acd-a66f-48c734b123e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c56a79af7774d42b3ac10e8292755d7'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:01.990058 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-1a87034f-9b92-4acd-a66f-48c734b123e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c56a79af7774d42b3ac10e8292755d7'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:02.001900 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-1a87034f-9b92-4acd-a66f-48c734b123e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c56a79af7774d42b3ac10e8292755d7'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:02.007787 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1291/2565] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:40:01 2022] DELETE /identity/v3/users/1c56a79af7774d42b3ac10e8292755d7 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:40:02.161753 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:40:02.493230 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781167eb-7c35-467b-ab3f-56e5d941bc2b service cinder] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:02.505451 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781167eb-7c35-467b-ab3f-56e5d941bc2b service cinder] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:02.563547 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3e64e-ec00-41ee-893e-fb62d3939677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:02.564433 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3e64e-ec00-41ee-893e-fb62d3939677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:02.564718 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3e64e-ec00-41ee-893e-fb62d3939677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:02.565097 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3e64e-ec00-41ee-893e-fb62d3939677 admin admin] PATH_INFO: `/v3/projects/bf11864af90c4cef957dc8465bd86c6b` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:02.566271 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3e64e-ec00-41ee-893e-fb62d3939677 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf11864af90c4cef957dc8465bd86c6b)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:02.568205 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3e64e-ec00-41ee-893e-fb62d3939677 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:02.666416 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:40:02.681357 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-d1b3e64e-ec00-41ee-893e-fb62d3939677 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf11864af90c4cef957dc8465bd86c6b', 'request_id': 'req-d1b3e64e-ec00-41ee-893e-fb62d3939677'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:02.771949 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-d1b3e64e-ec00-41ee-893e-fb62d3939677 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf11864af90c4cef957dc8465bd86c6b', 'request_id': 'req-d1b3e64e-ec00-41ee-893e-fb62d3939677'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:02.777905 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-d1b3e64e-ec00-41ee-893e-fb62d3939677 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf11864af90c4cef957dc8465bd86c6b', 'request_id': 'req-d1b3e64e-ec00-41ee-893e-fb62d3939677'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:02.789680 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-d1b3e64e-ec00-41ee-893e-fb62d3939677 admin admin] The token cache is being invalidate because project bf11864af90c4cef957dc8465bd86c6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:40:02.789977 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-d1b3e64e-ec00-41ee-893e-fb62d3939677 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:02.790644 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-d1b3e64e-ec00-41ee-893e-fb62d3939677 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:02.792522 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1275/2566] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:40:02 2022] DELETE /identity/v3/projects/bf11864af90c4cef957dc8465bd86c6b => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:40:02.798264 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109af1d8-1368-4942-a5a9-f53db50aba66 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:02.798557 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109af1d8-1368-4942-a5a9-f53db50aba66 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:02.798841 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109af1d8-1368-4942-a5a9-f53db50aba66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:02.816601 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-109af1d8-1368-4942-a5a9-f53db50aba66 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:40:02.817806 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-109af1d8-1368-4942-a5a9-f53db50aba66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:02.878240 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1292/2567] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:40:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:40:02.886507 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225b533-ce98-4b0f-b744-c613dcd48c5c None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:02.886803 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225b533-ce98-4b0f-b744-c613dcd48c5c None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:02.887088 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225b533-ce98-4b0f-b744-c613dcd48c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:02.905917 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-b225b533-ce98-4b0f-b744-c613dcd48c5c None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:40:02.907804 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-b225b533-ce98-4b0f-b744-c613dcd48c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:02.916060 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1276/2568] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:40:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:40:02.920178 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109af1d8-1368-4942-a5a9-f53db50aba66 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:02.930240 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109af1d8-1368-4942-a5a9-f53db50aba66 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:02.935009 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17593ee5-c633-4f09-b70b-5db6705db614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:02.935707 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17593ee5-c633-4f09-b70b-5db6705db614 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:02.935997 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17593ee5-c633-4f09-b70b-5db6705db614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:02.936276 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17593ee5-c633-4f09-b70b-5db6705db614 admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:02.937013 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17593ee5-c633-4f09-b70b-5db6705db614 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:40:02.937323 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17593ee5-c633-4f09-b70b-5db6705db614 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:02.939580 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17593ee5-c633-4f09-b70b-5db6705db614 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:02.952025 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1293/2569] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:40:02.957025 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225b533-ce98-4b0f-b744-c613dcd48c5c None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:02.966474 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225b533-ce98-4b0f-b744-c613dcd48c5c None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:02.971325 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90dfef-6100-4160-a13c-4aae993c03f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:02.972007 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90dfef-6100-4160-a13c-4aae993c03f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:02.972290 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90dfef-6100-4160-a13c-4aae993c03f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:02.972565 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90dfef-6100-4160-a13c-4aae993c03f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:02.973251 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b90dfef-6100-4160-a13c-4aae993c03f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:02.975159 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b90dfef-6100-4160-a13c-4aae993c03f6 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:03.057020 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1277/2570] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:40:02 2022] POST /identity/v3/projects => generated 367 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:40:03.061189 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17593ee5-c633-4f09-b70b-5db6705db614 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:03.072561 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17593ee5-c633-4f09-b70b-5db6705db614 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:03.129165 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a523eb-c470-4fa0-a2a6-db2da79794f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:03.130188 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a523eb-c470-4fa0-a2a6-db2da79794f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:03.130704 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a523eb-c470-4fa0-a2a6-db2da79794f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:03.131191 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a523eb-c470-4fa0-a2a6-db2da79794f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:03.131932 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a523eb-c470-4fa0-a2a6-db2da79794f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:03.133844 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a523eb-c470-4fa0-a2a6-db2da79794f0 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:03.229850 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1294/2571] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:40:03 2022] POST /identity/v3/users => generated 284 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 19:40:03.235119 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90dfef-6100-4160-a13c-4aae993c03f6 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:03.246908 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90dfef-6100-4160-a13c-4aae993c03f6 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:03.252051 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e84c7-cefe-43d7-8ea4-58ed94276220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:03.253109 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e84c7-cefe-43d7-8ea4-58ed94276220 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:03.253109 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e84c7-cefe-43d7-8ea4-58ed94276220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:03.253327 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e84c7-cefe-43d7-8ea4-58ed94276220 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:03.253973 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e84c7-cefe-43d7-8ea4-58ed94276220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:03.255589 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e84c7-cefe-43d7-8ea4-58ed94276220 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:03.266956 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1278/2572] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:40:03.271149 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a523eb-c470-4fa0-a2a6-db2da79794f0 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:03.281736 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a523eb-c470-4fa0-a2a6-db2da79794f0 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:03.286788 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb8ee03-06ae-447c-911d-dfc9e4eb13fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:03.287511 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8ee03-06ae-447c-911d-dfc9e4eb13fc admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:03.287844 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8ee03-06ae-447c-911d-dfc9e4eb13fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:03.288127 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8ee03-06ae-447c-911d-dfc9e4eb13fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:03.288858 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb8ee03-06ae-447c-911d-dfc9e4eb13fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:03.290451 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb8ee03-06ae-447c-911d-dfc9e4eb13fc admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:03.302002 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1295/2573] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:40:03.306235 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e84c7-cefe-43d7-8ea4-58ed94276220 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:03.317123 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e84c7-cefe-43d7-8ea4-58ed94276220 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:03.322815 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61fab85-ba19-4b83-be68-226a760d95b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:03.323739 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fab85-ba19-4b83-be68-226a760d95b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:03.324054 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fab85-ba19-4b83-be68-226a760d95b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:03.324332 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fab85-ba19-4b83-be68-226a760d95b4 admin admin] PATH_INFO: `/v3/projects/d2c5fec52549498ba8dbb5780532edf3/users/a380f0db19144716b70e9ac414defef5/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:03.339855 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61fab85-ba19-4b83-be68-226a760d95b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2c5fec52549498ba8dbb5780532edf3, user_id=a380f0db19144716b70e9ac414defef5, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:03.342546 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61fab85-ba19-4b83-be68-226a760d95b4 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:03.442435 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1279/2574] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:40:03 2022] PUT /identity/v3/projects/d2c5fec52549498ba8dbb5780532edf3/users/a380f0db19144716b70e9ac414defef5/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:40:03.454872 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140fd1d-069c-45a0-b50a-c1466d10a908 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:03.455166 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140fd1d-069c-45a0-b50a-c1466d10a908 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:03.455503 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140fd1d-069c-45a0-b50a-c1466d10a908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:03.475982 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:40:03.482580 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-c140fd1d-069c-45a0-b50a-c1466d10a908 None None] MFA Rules not processed for user `a380f0db19144716b70e9ac414defef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:40:03.483840 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-c140fd1d-069c-45a0-b50a-c1466d10a908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:03.547706 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1296/2575] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:40:03 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:40:03.552354 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61fab85-ba19-4b83-be68-226a760d95b4 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:03.617051 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61fab85-ba19-4b83-be68-226a760d95b4 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:03.621935 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3df5fd-1035-47fa-82c4-f022938785d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:03.622666 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3df5fd-1035-47fa-82c4-f022938785d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:03.622973 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3df5fd-1035-47fa-82c4-f022938785d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:03.623252 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3df5fd-1035-47fa-82c4-f022938785d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:03.623962 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3df5fd-1035-47fa-82c4-f022938785d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:03.626535 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3df5fd-1035-47fa-82c4-f022938785d9 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:03.728732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1280/2576] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:40:03 2022] POST /identity/v3/projects => generated 367 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:40:03.732581 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140fd1d-069c-45a0-b50a-c1466d10a908 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:03.744018 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140fd1d-069c-45a0-b50a-c1466d10a908 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:03.802493 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de16ce3-ff29-4f4c-8c52-3f90be4ec58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:03.803166 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de16ce3-ff29-4f4c-8c52-3f90be4ec58b admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:03.803472 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de16ce3-ff29-4f4c-8c52-3f90be4ec58b admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:03.803765 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de16ce3-ff29-4f4c-8c52-3f90be4ec58b admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:03.804458 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de16ce3-ff29-4f4c-8c52-3f90be4ec58b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:03.806367 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de16ce3-ff29-4f4c-8c52-3f90be4ec58b admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:03.897152 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1297/2577] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:40:03 2022] POST /identity/v3/users => generated 290 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:40:03.900999 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3df5fd-1035-47fa-82c4-f022938785d9 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:03.913860 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3df5fd-1035-47fa-82c4-f022938785d9 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:03.919077 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233746f-e606-4b4d-8fc2-04fe8d6b113f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:03.927577 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233746f-e606-4b4d-8fc2-04fe8d6b113f admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:03.927577 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233746f-e606-4b4d-8fc2-04fe8d6b113f admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:03.927577 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233746f-e606-4b4d-8fc2-04fe8d6b113f admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:03.927577 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7233746f-e606-4b4d-8fc2-04fe8d6b113f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:03.927577 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7233746f-e606-4b4d-8fc2-04fe8d6b113f admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:03.934888 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1281/2578] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:40:03.939046 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de16ce3-ff29-4f4c-8c52-3f90be4ec58b admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:03.951189 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de16ce3-ff29-4f4c-8c52-3f90be4ec58b admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:03.956622 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dda295-adb6-42e3-a608-9ca57fed5a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:03.957666 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dda295-adb6-42e3-a608-9ca57fed5a8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:03.957953 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dda295-adb6-42e3-a608-9ca57fed5a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:03.958228 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dda295-adb6-42e3-a608-9ca57fed5a8f admin admin] PATH_INFO: `/v3/projects/7c27899d4a6a4348af676f7d435ab7e3/users/1c96f089adc8441d81cbbfea584c297e/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:03.974337 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dda295-adb6-42e3-a608-9ca57fed5a8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c27899d4a6a4348af676f7d435ab7e3, user_id=1c96f089adc8441d81cbbfea584c297e, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:03.976973 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dda295-adb6-42e3-a608-9ca57fed5a8f admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:04.075882 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1298/2579] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:40:03 2022] PUT /identity/v3/projects/7c27899d4a6a4348af676f7d435ab7e3/users/1c96f089adc8441d81cbbfea584c297e/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:40:04.080435 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233746f-e606-4b4d-8fc2-04fe8d6b113f admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:04.090480 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233746f-e606-4b4d-8fc2-04fe8d6b113f admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:04.114156 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:40:04.145741 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41be0f-caf7-4453-b29c-0196b8832f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:04.146422 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41be0f-caf7-4453-b29c-0196b8832f40 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:04.146687 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41be0f-caf7-4453-b29c-0196b8832f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:04.146967 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41be0f-caf7-4453-b29c-0196b8832f40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:04.147706 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac41be0f-caf7-4453-b29c-0196b8832f40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:04.150061 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac41be0f-caf7-4453-b29c-0196b8832f40 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:04.161297 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1282/2580] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 19:40:04.167414 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dda295-adb6-42e3-a608-9ca57fed5a8f admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:04.178313 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dda295-adb6-42e3-a608-9ca57fed5a8f admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:04.182918 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b484d-51de-4a11-897b-d518b2f3e9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:04.183833 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b484d-51de-4a11-897b-d518b2f3e9f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:04.184113 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b484d-51de-4a11-897b-d518b2f3e9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:04.184511 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b484d-51de-4a11-897b-d518b2f3e9f8 admin admin] PATH_INFO: `/v3/projects/7c27899d4a6a4348af676f7d435ab7e3/users/1c96f089adc8441d81cbbfea584c297e/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:04.186444 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b484d-51de-4a11-897b-d518b2f3e9f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c27899d4a6a4348af676f7d435ab7e3, user_id=1c96f089adc8441d81cbbfea584c297e, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:04.189089 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b484d-51de-4a11-897b-d518b2f3e9f8 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:04.199982 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1299/2581] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:40:04 2022] PUT /identity/v3/projects/7c27899d4a6a4348af676f7d435ab7e3/users/1c96f089adc8441d81cbbfea584c297e/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:40:04.210335 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64f07f-83eb-491a-87dd-d2177a926eb2 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:04.210627 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64f07f-83eb-491a-87dd-d2177a926eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:04.210931 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64f07f-83eb-491a-87dd-d2177a926eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:04.238711 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-2a64f07f-83eb-491a-87dd-d2177a926eb2 None None] MFA Rules not processed for user `1c96f089adc8441d81cbbfea584c297e`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:40:04.239965 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-2a64f07f-83eb-491a-87dd-d2177a926eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:04.308123 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1283/2582] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:40:04 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:40:04.319929 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b484d-51de-4a11-897b-d518b2f3e9f8 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:04.321633 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f90b484d-51de-4a11-897b-d518b2f3e9f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:04.378652 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b484d-51de-4a11-897b-d518b2f3e9f8 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:04.382330 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0228535-035f-46bf-940f-c06db5f2780e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:04.382966 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0228535-035f-46bf-940f-c06db5f2780e service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:04.383249 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0228535-035f-46bf-940f-c06db5f2780e service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:04.383569 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0228535-035f-46bf-940f-c06db5f2780e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:04.390483 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:40:04.393392 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0228535-035f-46bf-940f-c06db5f2780e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:04.394857 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0228535-035f-46bf-940f-c06db5f2780e service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:04.404542 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1300/2583] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:40:04 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:40:04.659205 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a64f07f-83eb-491a-87dd-d2177a926eb2 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:04.669516 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a64f07f-83eb-491a-87dd-d2177a926eb2 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:04.673325 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4770a146-5995-44d8-8bd0-8e224639819e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:04.673954 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770a146-5995-44d8-8bd0-8e224639819e service cinder] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:04.674236 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770a146-5995-44d8-8bd0-8e224639819e service cinder] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:04.678689 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770a146-5995-44d8-8bd0-8e224639819e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:04.730500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4770a146-5995-44d8-8bd0-8e224639819e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:04.731960 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4770a146-5995-44d8-8bd0-8e224639819e service cinder] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:04.740730 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1284/2584] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:40:04 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:40:11.260563 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0228535-035f-46bf-940f-c06db5f2780e service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:11.326467 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0228535-035f-46bf-940f-c06db5f2780e service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:11.331520 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bbf94d-5a3c-47ca-9758-03ca2c2fb167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:11.332413 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbf94d-5a3c-47ca-9758-03ca2c2fb167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:11.336148 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbf94d-5a3c-47ca-9758-03ca2c2fb167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:11.336148 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbf94d-5a3c-47ca-9758-03ca2c2fb167 admin admin] PATH_INFO: `/v3/users/a380f0db19144716b70e9ac414defef5` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:11.336148 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bbf94d-5a3c-47ca-9758-03ca2c2fb167 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a380f0db19144716b70e9ac414defef5)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:11.336148 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bbf94d-5a3c-47ca-9758-03ca2c2fb167 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:11.558682 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-72bbf94d-5a3c-47ca-9758-03ca2c2fb167 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a380f0db19144716b70e9ac414defef5'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:11.624940 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-72bbf94d-5a3c-47ca-9758-03ca2c2fb167 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a380f0db19144716b70e9ac414defef5'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:11.625450 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-72bbf94d-5a3c-47ca-9758-03ca2c2fb167 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a380f0db19144716b70e9ac414defef5'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:11.634076 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-72bbf94d-5a3c-47ca-9758-03ca2c2fb167 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a380f0db19144716b70e9ac414defef5'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:11.647099 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-72bbf94d-5a3c-47ca-9758-03ca2c2fb167 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a380f0db19144716b70e9ac414defef5'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:11.653325 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1301/2585] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:40:11 2022] DELETE /identity/v3/users/a380f0db19144716b70e9ac414defef5 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:40:11.659056 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485ddb3-9310-4628-bc25-fd3660b9a998 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:11.659738 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485ddb3-9310-4628-bc25-fd3660b9a998 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:11.660044 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485ddb3-9310-4628-bc25-fd3660b9a998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:11.679660 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-4485ddb3-9310-4628-bc25-fd3660b9a998 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:40:11.681077 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-4485ddb3-9310-4628-bc25-fd3660b9a998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:11.724409 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:40:11.742195 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1285/2586] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:40:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:40:11.753016 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bbf94d-5a3c-47ca-9758-03ca2c2fb167 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:11.754524 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-72bbf94d-5a3c-47ca-9758-03ca2c2fb167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:11.811557 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bbf94d-5a3c-47ca-9758-03ca2c2fb167 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:11.815766 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591f020-b257-4a06-a761-e0da554601bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:11.816420 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591f020-b257-4a06-a761-e0da554601bb service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:11.816705 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591f020-b257-4a06-a761-e0da554601bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:11.816985 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591f020-b257-4a06-a761-e0da554601bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:11.826220 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e591f020-b257-4a06-a761-e0da554601bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:11.827688 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e591f020-b257-4a06-a761-e0da554601bb service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:11.837473 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1302/2587] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:40:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:40:12.293470 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485ddb3-9310-4628-bc25-fd3660b9a998 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:12.293727 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-4485ddb3-9310-4628-bc25-fd3660b9a998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:12.306297 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485ddb3-9310-4628-bc25-fd3660b9a998 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:12.312552 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0963d-492f-4a97-a739-8c0df6329aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:12.316253 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0963d-492f-4a97-a739-8c0df6329aec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:12.316253 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0963d-492f-4a97-a739-8c0df6329aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:12.316253 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0963d-492f-4a97-a739-8c0df6329aec admin admin] PATH_INFO: `/v3/projects/d2c5fec52549498ba8dbb5780532edf3` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:12.316253 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d0963d-492f-4a97-a739-8c0df6329aec admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2c5fec52549498ba8dbb5780532edf3)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:12.317174 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d0963d-492f-4a97-a739-8c0df6329aec admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:12.445735 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-a3d0963d-492f-4a97-a739-8c0df6329aec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2c5fec52549498ba8dbb5780532edf3', 'request_id': 'req-a3d0963d-492f-4a97-a739-8c0df6329aec'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:12.548071 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-a3d0963d-492f-4a97-a739-8c0df6329aec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2c5fec52549498ba8dbb5780532edf3', 'request_id': 'req-a3d0963d-492f-4a97-a739-8c0df6329aec'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:12.554202 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-a3d0963d-492f-4a97-a739-8c0df6329aec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2c5fec52549498ba8dbb5780532edf3', 'request_id': 'req-a3d0963d-492f-4a97-a739-8c0df6329aec'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:12.565260 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-a3d0963d-492f-4a97-a739-8c0df6329aec admin admin] The token cache is being invalidate because project d2c5fec52549498ba8dbb5780532edf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:40:12.565557 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-a3d0963d-492f-4a97-a739-8c0df6329aec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:12.566178 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-a3d0963d-492f-4a97-a739-8c0df6329aec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:12.567756 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1286/2588] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:40:12 2022] DELETE /identity/v3/projects/d2c5fec52549498ba8dbb5780532edf3 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:40:12.572058 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591f020-b257-4a06-a761-e0da554601bb service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:12.584504 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591f020-b257-4a06-a761-e0da554601bb service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:12.597692 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:40:12.640267 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9cafc1-2cac-4021-b77e-8516503255cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:12.641140 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9cafc1-2cac-4021-b77e-8516503255cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:12.641452 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9cafc1-2cac-4021-b77e-8516503255cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:12.641731 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9cafc1-2cac-4021-b77e-8516503255cf admin admin] PATH_INFO: `/v3/users/1c96f089adc8441d81cbbfea584c297e` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:12.643562 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9cafc1-2cac-4021-b77e-8516503255cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c96f089adc8441d81cbbfea584c297e)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:12.645469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9cafc1-2cac-4021-b77e-8516503255cf admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:12.832634 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-9e9cafc1-2cac-4021-b77e-8516503255cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c96f089adc8441d81cbbfea584c297e'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:12.909473 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-9e9cafc1-2cac-4021-b77e-8516503255cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c96f089adc8441d81cbbfea584c297e'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:12.910170 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-9e9cafc1-2cac-4021-b77e-8516503255cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c96f089adc8441d81cbbfea584c297e'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:12.918148 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-9e9cafc1-2cac-4021-b77e-8516503255cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c96f089adc8441d81cbbfea584c297e'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:12.932388 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-9e9cafc1-2cac-4021-b77e-8516503255cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c96f089adc8441d81cbbfea584c297e'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:12.938645 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1303/2589] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:40:12 2022] DELETE /identity/v3/users/1c96f089adc8441d81cbbfea584c297e => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:40:13.339309 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0963d-492f-4a97-a739-8c0df6329aec admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:13.344461 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-a3d0963d-492f-4a97-a739-8c0df6329aec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:13.354320 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0963d-492f-4a97-a739-8c0df6329aec admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:13.412061 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1908c1d-c7a4-42a3-aeb3-87094cf39036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:13.412982 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1908c1d-c7a4-42a3-aeb3-87094cf39036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:13.413249 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1908c1d-c7a4-42a3-aeb3-87094cf39036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:13.413526 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1908c1d-c7a4-42a3-aeb3-87094cf39036 admin admin] PATH_INFO: `/v3/projects/7c27899d4a6a4348af676f7d435ab7e3` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:13.414703 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1908c1d-c7a4-42a3-aeb3-87094cf39036 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c27899d4a6a4348af676f7d435ab7e3)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:13.416635 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1908c1d-c7a4-42a3-aeb3-87094cf39036 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:13.550936 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-f1908c1d-c7a4-42a3-aeb3-87094cf39036 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c27899d4a6a4348af676f7d435ab7e3', 'request_id': 'req-f1908c1d-c7a4-42a3-aeb3-87094cf39036'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:13.629244 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-f1908c1d-c7a4-42a3-aeb3-87094cf39036 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c27899d4a6a4348af676f7d435ab7e3', 'request_id': 'req-f1908c1d-c7a4-42a3-aeb3-87094cf39036'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:13.635342 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-f1908c1d-c7a4-42a3-aeb3-87094cf39036 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c27899d4a6a4348af676f7d435ab7e3', 'request_id': 'req-f1908c1d-c7a4-42a3-aeb3-87094cf39036'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:13.643270 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:40:13.647010 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-f1908c1d-c7a4-42a3-aeb3-87094cf39036 admin admin] The token cache is being invalidate because project 7c27899d4a6a4348af676f7d435ab7e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:40:13.647300 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-f1908c1d-c7a4-42a3-aeb3-87094cf39036 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:13.647954 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-f1908c1d-c7a4-42a3-aeb3-87094cf39036 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:13.649485 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1287/2590] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:40:13 2022] DELETE /identity/v3/projects/7c27899d4a6a4348af676f7d435ab7e3 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:40:13.654439 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebb760-c72e-41ed-8ef6-90bce50db350 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:13.654929 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebb760-c72e-41ed-8ef6-90bce50db350 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:13.655043 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebb760-c72e-41ed-8ef6-90bce50db350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:13.674599 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-b0ebb760-c72e-41ed-8ef6-90bce50db350 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:40:13.675841 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-b0ebb760-c72e-41ed-8ef6-90bce50db350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:13.738086 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1304/2591] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:40:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:40:13.746764 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0e41b-9cc8-4066-b2c3-76b72d38ae45 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:13.747054 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0e41b-9cc8-4066-b2c3-76b72d38ae45 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:13.747339 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0e41b-9cc8-4066-b2c3-76b72d38ae45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:13.768640 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-c3e0e41b-9cc8-4066-b2c3-76b72d38ae45 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:40:13.768640 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-c3e0e41b-9cc8-4066-b2c3-76b72d38ae45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:13.775946 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1288/2592] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:40:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:40:13.780212 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ebb760-c72e-41ed-8ef6-90bce50db350 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:13.799323 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ebb760-c72e-41ed-8ef6-90bce50db350 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:13.799323 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f46a7-2725-4bc9-9207-561c583c351f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:13.799323 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f46a7-2725-4bc9-9207-561c583c351f admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:13.799323 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f46a7-2725-4bc9-9207-561c583c351f admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:13.799746 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f46a7-2725-4bc9-9207-561c583c351f admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:13.799746 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911f46a7-2725-4bc9-9207-561c583c351f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:40:13.799746 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911f46a7-2725-4bc9-9207-561c583c351f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:13.800148 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911f46a7-2725-4bc9-9207-561c583c351f admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:13.812845 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1305/2593] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:40:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:40:13.817195 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e0e41b-9cc8-4066-b2c3-76b72d38ae45 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:13.826909 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e0e41b-9cc8-4066-b2c3-76b72d38ae45 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:13.832452 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe3bf2-1694-4c0d-8771-56d99c0f3055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:13.833099 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe3bf2-1694-4c0d-8771-56d99c0f3055 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:13.833386 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe3bf2-1694-4c0d-8771-56d99c0f3055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:13.833693 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe3bf2-1694-4c0d-8771-56d99c0f3055 admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:13.834372 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe3bf2-1694-4c0d-8771-56d99c0f3055 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:13.836291 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe3bf2-1694-4c0d-8771-56d99c0f3055 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:13.957171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1289/2594] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:40:13 2022] POST /identity/v3/projects => generated 381 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:40:13.961269 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f46a7-2725-4bc9-9207-561c583c351f admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:13.972046 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f46a7-2725-4bc9-9207-561c583c351f admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:13.993941 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:40:14.029871 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6adcff-2e08-4526-b2f1-05e2c04fa69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:14.030543 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6adcff-2e08-4526-b2f1-05e2c04fa69f admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:14.030827 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6adcff-2e08-4526-b2f1-05e2c04fa69f admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:14.031106 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6adcff-2e08-4526-b2f1-05e2c04fa69f admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:14.031846 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6adcff-2e08-4526-b2f1-05e2c04fa69f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:14.034680 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6adcff-2e08-4526-b2f1-05e2c04fa69f admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:14.131000 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1306/2595] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:40:13 2022] POST /identity/v3/users => generated 291 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:40:14.135011 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe3bf2-1694-4c0d-8771-56d99c0f3055 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:14.145954 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe3bf2-1694-4c0d-8771-56d99c0f3055 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:14.150631 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e07f8-70f6-436a-a0aa-c5bd4b051582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:14.151325 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e07f8-70f6-436a-a0aa-c5bd4b051582 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:14.151640 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e07f8-70f6-436a-a0aa-c5bd4b051582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:14.151945 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e07f8-70f6-436a-a0aa-c5bd4b051582 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:14.152670 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40e07f8-70f6-436a-a0aa-c5bd4b051582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:14.154310 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40e07f8-70f6-436a-a0aa-c5bd4b051582 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:14.165179 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1290/2596] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:40:14.169183 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6adcff-2e08-4526-b2f1-05e2c04fa69f admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:14.179643 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6adcff-2e08-4526-b2f1-05e2c04fa69f admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:14.184383 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40268dff-32cf-4090-960e-68043ad69398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:14.185038 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40268dff-32cf-4090-960e-68043ad69398 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:14.185325 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40268dff-32cf-4090-960e-68043ad69398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:14.185604 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40268dff-32cf-4090-960e-68043ad69398 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:14.186327 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40268dff-32cf-4090-960e-68043ad69398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:14.187994 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40268dff-32cf-4090-960e-68043ad69398 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:14.199776 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1307/2597] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 19:40:14.203858 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e07f8-70f6-436a-a0aa-c5bd4b051582 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:14.217413 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e07f8-70f6-436a-a0aa-c5bd4b051582 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:14.219062 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714f96e-1b62-4092-85b2-fb6425b9d4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:14.219974 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714f96e-1b62-4092-85b2-fb6425b9d4e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:14.220277 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714f96e-1b62-4092-85b2-fb6425b9d4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:14.220558 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714f96e-1b62-4092-85b2-fb6425b9d4e6 admin admin] PATH_INFO: `/v3/projects/0dcbdb3ce0ac4f8fb41903b02b5931cd/users/348257963e444659a740efaf74761fc0/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:14.234821 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b714f96e-1b62-4092-85b2-fb6425b9d4e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dcbdb3ce0ac4f8fb41903b02b5931cd, user_id=348257963e444659a740efaf74761fc0, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:14.237506 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b714f96e-1b62-4092-85b2-fb6425b9d4e6 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:14.343629 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1291/2598] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:40:14 2022] PUT /identity/v3/projects/0dcbdb3ce0ac4f8fb41903b02b5931cd/users/348257963e444659a740efaf74761fc0/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:40:14.354140 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c980898-83b6-4e2a-ba61-67a4e56cb817 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:14.354435 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c980898-83b6-4e2a-ba61-67a4e56cb817 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:14.355037 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c980898-83b6-4e2a-ba61-67a4e56cb817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:14.381105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-0c980898-83b6-4e2a-ba61-67a4e56cb817 None None] MFA Rules not processed for user `348257963e444659a740efaf74761fc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:40:14.382318 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-0c980898-83b6-4e2a-ba61-67a4e56cb817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:14.446308 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1308/2599] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:40:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:40:14.450896 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714f96e-1b62-4092-85b2-fb6425b9d4e6 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:14.511768 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714f96e-1b62-4092-85b2-fb6425b9d4e6 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:14.516354 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26758394-5056-4fa4-80e9-cb6c54cb74f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:14.517606 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26758394-5056-4fa4-80e9-cb6c54cb74f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:14.517904 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26758394-5056-4fa4-80e9-cb6c54cb74f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:14.518184 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26758394-5056-4fa4-80e9-cb6c54cb74f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:14.518882 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26758394-5056-4fa4-80e9-cb6c54cb74f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:14.520790 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26758394-5056-4fa4-80e9-cb6c54cb74f6 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:14.614404 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1292/2600] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:40:14 2022] POST /identity/v3/projects => generated 383 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:40:14.618520 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c980898-83b6-4e2a-ba61-67a4e56cb817 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:14.630208 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c980898-83b6-4e2a-ba61-67a4e56cb817 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:14.685798 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee46e9fb-0359-417f-ab75-69eee8b07150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:14.686463 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46e9fb-0359-417f-ab75-69eee8b07150 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:14.686749 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46e9fb-0359-417f-ab75-69eee8b07150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:14.687049 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46e9fb-0359-417f-ab75-69eee8b07150 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:14.687780 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee46e9fb-0359-417f-ab75-69eee8b07150 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:14.690451 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee46e9fb-0359-417f-ab75-69eee8b07150 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:14.776435 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1309/2601] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:40:14 2022] POST /identity/v3/users => generated 298 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:40:14.780207 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26758394-5056-4fa4-80e9-cb6c54cb74f6 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:14.790557 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26758394-5056-4fa4-80e9-cb6c54cb74f6 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:14.795123 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e529aba-c1a6-44d9-a85b-29625bcaa495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:14.795801 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e529aba-c1a6-44d9-a85b-29625bcaa495 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:14.796085 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e529aba-c1a6-44d9-a85b-29625bcaa495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:14.796356 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e529aba-c1a6-44d9-a85b-29625bcaa495 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:14.797067 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e529aba-c1a6-44d9-a85b-29625bcaa495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:14.799272 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e529aba-c1a6-44d9-a85b-29625bcaa495 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:14.809535 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1293/2602] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:40:14.813668 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee46e9fb-0359-417f-ab75-69eee8b07150 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:14.824877 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee46e9fb-0359-417f-ab75-69eee8b07150 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:14.829696 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae4014-b870-42ac-8a33-b45f15fd1626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:14.830677 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae4014-b870-42ac-8a33-b45f15fd1626 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:14.830964 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae4014-b870-42ac-8a33-b45f15fd1626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:14.831242 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae4014-b870-42ac-8a33-b45f15fd1626 admin admin] PATH_INFO: `/v3/projects/a67c1a89deab4a5a952301593bda4444/users/8213cf2097b54fd9aa33659f7f398c89/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:14.846766 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae4014-b870-42ac-8a33-b45f15fd1626 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a67c1a89deab4a5a952301593bda4444, user_id=8213cf2097b54fd9aa33659f7f398c89, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:14.849476 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae4014-b870-42ac-8a33-b45f15fd1626 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:14.950416 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:40:14.956018 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1310/2603] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:40:14 2022] PUT /identity/v3/projects/a67c1a89deab4a5a952301593bda4444/users/8213cf2097b54fd9aa33659f7f398c89/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:40:14.960031 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e529aba-c1a6-44d9-a85b-29625bcaa495 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:14.970826 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e529aba-c1a6-44d9-a85b-29625bcaa495 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:15.025804 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52755db9-16d0-4515-bcd8-24f91f27d935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:15.026548 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52755db9-16d0-4515-bcd8-24f91f27d935 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:15.026791 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52755db9-16d0-4515-bcd8-24f91f27d935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:15.027073 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52755db9-16d0-4515-bcd8-24f91f27d935 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:15.027829 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52755db9-16d0-4515-bcd8-24f91f27d935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:15.029409 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52755db9-16d0-4515-bcd8-24f91f27d935 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:15.039820 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1294/2604] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:40:15.043930 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae4014-b870-42ac-8a33-b45f15fd1626 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:15.054896 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae4014-b870-42ac-8a33-b45f15fd1626 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:15.059537 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f98c2f-4525-4751-808f-ed7d94e523cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:15.060415 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f98c2f-4525-4751-808f-ed7d94e523cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:15.060703 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f98c2f-4525-4751-808f-ed7d94e523cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:15.060980 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f98c2f-4525-4751-808f-ed7d94e523cb admin admin] PATH_INFO: `/v3/projects/a67c1a89deab4a5a952301593bda4444/users/8213cf2097b54fd9aa33659f7f398c89/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:15.062976 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f98c2f-4525-4751-808f-ed7d94e523cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a67c1a89deab4a5a952301593bda4444, user_id=8213cf2097b54fd9aa33659f7f398c89, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:15.065803 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f98c2f-4525-4751-808f-ed7d94e523cb admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:15.076409 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1311/2605] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:40:15 2022] PUT /identity/v3/projects/a67c1a89deab4a5a952301593bda4444/users/8213cf2097b54fd9aa33659f7f398c89/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:40:15.089879 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e52b4f-67b7-4587-8c87-ba50961f1b9f None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:15.090176 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e52b4f-67b7-4587-8c87-ba50961f1b9f None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:15.090459 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e52b4f-67b7-4587-8c87-ba50961f1b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:15.103706 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:40:15.119970 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-25e52b4f-67b7-4587-8c87-ba50961f1b9f None None] MFA Rules not processed for user `8213cf2097b54fd9aa33659f7f398c89`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:40:15.119970 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-25e52b4f-67b7-4587-8c87-ba50961f1b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:15.189707 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1295/2606] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:40:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:40:15.201379 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f98c2f-4525-4751-808f-ed7d94e523cb admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:15.203201 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-16f98c2f-4525-4751-808f-ed7d94e523cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:15.264765 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f98c2f-4525-4751-808f-ed7d94e523cb admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:15.268473 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd42db7-ffd1-4ad1-b91a-e71aefb2d5b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:15.269117 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd42db7-ffd1-4ad1-b91a-e71aefb2d5b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:15.269402 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd42db7-ffd1-4ad1-b91a-e71aefb2d5b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:15.269675 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd42db7-ffd1-4ad1-b91a-e71aefb2d5b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:15.278970 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd42db7-ffd1-4ad1-b91a-e71aefb2d5b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:15.280448 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd42db7-ffd1-4ad1-b91a-e71aefb2d5b1 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:15.290987 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1312/2607] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:40:15 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:40:15.465536 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e52b4f-67b7-4587-8c87-ba50961f1b9f None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:15.475958 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e52b4f-67b7-4587-8c87-ba50961f1b9f None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:15.479523 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a66dba-e208-4df2-a45c-9be661155394 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:15.480281 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a66dba-e208-4df2-a45c-9be661155394 service cinder] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:15.480436 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a66dba-e208-4df2-a45c-9be661155394 service cinder] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:15.480715 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a66dba-e208-4df2-a45c-9be661155394 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:15.539044 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a66dba-e208-4df2-a45c-9be661155394 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:15.540436 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a66dba-e208-4df2-a45c-9be661155394 service cinder] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:15.549464 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1296/2608] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:40:15 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:40:16.038959 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd42db7-ffd1-4ad1-b91a-e71aefb2d5b1 service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:16.103666 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd42db7-ffd1-4ad1-b91a-e71aefb2d5b1 service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:16.108307 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ed214-cdd8-4d66-911b-fcc51c34f0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:16.109273 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ed214-cdd8-4d66-911b-fcc51c34f0e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:16.109560 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ed214-cdd8-4d66-911b-fcc51c34f0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:16.109837 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ed214-cdd8-4d66-911b-fcc51c34f0e4 admin admin] PATH_INFO: `/v3/users/348257963e444659a740efaf74761fc0` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:16.111546 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ed214-cdd8-4d66-911b-fcc51c34f0e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=348257963e444659a740efaf74761fc0)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:16.113480 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ed214-cdd8-4d66-911b-fcc51c34f0e4 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:16.328904 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-bf6ed214-cdd8-4d66-911b-fcc51c34f0e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '348257963e444659a740efaf74761fc0'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:16.412573 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-bf6ed214-cdd8-4d66-911b-fcc51c34f0e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '348257963e444659a740efaf74761fc0'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:16.413197 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-bf6ed214-cdd8-4d66-911b-fcc51c34f0e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '348257963e444659a740efaf74761fc0'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:16.421452 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-bf6ed214-cdd8-4d66-911b-fcc51c34f0e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '348257963e444659a740efaf74761fc0'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:16.436666 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-bf6ed214-cdd8-4d66-911b-fcc51c34f0e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '348257963e444659a740efaf74761fc0'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:16.442977 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1313/2609] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:40:16 2022] DELETE /identity/v3/users/348257963e444659a740efaf74761fc0 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:40:16.447824 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9a1de-3114-4e9b-8dad-1c05583080ad None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:16.448127 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9a1de-3114-4e9b-8dad-1c05583080ad None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:16.448411 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9a1de-3114-4e9b-8dad-1c05583080ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:16.466277 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-ffb9a1de-3114-4e9b-8dad-1c05583080ad None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:40:16.467557 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-ffb9a1de-3114-4e9b-8dad-1c05583080ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:16.527230 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1297/2610] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:40:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:40:16.537542 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ed214-cdd8-4d66-911b-fcc51c34f0e4 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:16.538974 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-bf6ed214-cdd8-4d66-911b-fcc51c34f0e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:16.549647 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:40:16.598065 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ed214-cdd8-4d66-911b-fcc51c34f0e4 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:16.601909 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11992fe6-0b3a-4c54-b3c8-a9d42f2e589b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:16.602578 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11992fe6-0b3a-4c54-b3c8-a9d42f2e589b service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:16.602898 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11992fe6-0b3a-4c54-b3c8-a9d42f2e589b service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:16.603271 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11992fe6-0b3a-4c54-b3c8-a9d42f2e589b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:16.614575 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11992fe6-0b3a-4c54-b3c8-a9d42f2e589b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:16.616093 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11992fe6-0b3a-4c54-b3c8-a9d42f2e589b service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:16.625583 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1314/2611] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:40:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:40:17.145796 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9a1de-3114-4e9b-8dad-1c05583080ad None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:17.147205 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-ffb9a1de-3114-4e9b-8dad-1c05583080ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:17.160113 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9a1de-3114-4e9b-8dad-1c05583080ad None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:17.170483 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3667c-3a8b-4299-82cc-5db32251ebf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:17.170483 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3667c-3a8b-4299-82cc-5db32251ebf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:17.170483 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3667c-3a8b-4299-82cc-5db32251ebf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:17.170483 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3667c-3a8b-4299-82cc-5db32251ebf2 admin admin] PATH_INFO: `/v3/projects/0dcbdb3ce0ac4f8fb41903b02b5931cd` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:17.170948 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece3667c-3a8b-4299-82cc-5db32251ebf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dcbdb3ce0ac4f8fb41903b02b5931cd)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:17.170948 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece3667c-3a8b-4299-82cc-5db32251ebf2 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:17.259515 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:40:17.275582 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-ece3667c-3a8b-4299-82cc-5db32251ebf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dcbdb3ce0ac4f8fb41903b02b5931cd', 'request_id': 'req-ece3667c-3a8b-4299-82cc-5db32251ebf2'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:17.349585 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-ece3667c-3a8b-4299-82cc-5db32251ebf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dcbdb3ce0ac4f8fb41903b02b5931cd', 'request_id': 'req-ece3667c-3a8b-4299-82cc-5db32251ebf2'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:17.355530 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-ece3667c-3a8b-4299-82cc-5db32251ebf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dcbdb3ce0ac4f8fb41903b02b5931cd', 'request_id': 'req-ece3667c-3a8b-4299-82cc-5db32251ebf2'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:17.366553 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-ece3667c-3a8b-4299-82cc-5db32251ebf2 admin admin] The token cache is being invalidate because project 0dcbdb3ce0ac4f8fb41903b02b5931cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:40:17.366843 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-ece3667c-3a8b-4299-82cc-5db32251ebf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:17.367558 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-ece3667c-3a8b-4299-82cc-5db32251ebf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:17.369108 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1298/2612] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:40:17 2022] DELETE /identity/v3/projects/0dcbdb3ce0ac4f8fb41903b02b5931cd => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:40:17.373198 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11992fe6-0b3a-4c54-b3c8-a9d42f2e589b service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:17.383842 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11992fe6-0b3a-4c54-b3c8-a9d42f2e589b service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:17.446322 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4dfba4-b4b6-4dd8-a6ce-d9aca2cd2bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:17.447303 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4dfba4-b4b6-4dd8-a6ce-d9aca2cd2bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:17.447674 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4dfba4-b4b6-4dd8-a6ce-d9aca2cd2bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:17.448028 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4dfba4-b4b6-4dd8-a6ce-d9aca2cd2bc9 admin admin] PATH_INFO: `/v3/users/8213cf2097b54fd9aa33659f7f398c89` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:17.449352 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4dfba4-b4b6-4dd8-a6ce-d9aca2cd2bc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8213cf2097b54fd9aa33659f7f398c89)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:17.451534 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4dfba4-b4b6-4dd8-a6ce-d9aca2cd2bc9 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:17.660552 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-2b4dfba4-b4b6-4dd8-a6ce-d9aca2cd2bc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8213cf2097b54fd9aa33659f7f398c89'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:17.730231 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-2b4dfba4-b4b6-4dd8-a6ce-d9aca2cd2bc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8213cf2097b54fd9aa33659f7f398c89'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:17.730866 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-2b4dfba4-b4b6-4dd8-a6ce-d9aca2cd2bc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8213cf2097b54fd9aa33659f7f398c89'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:17.739214 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-2b4dfba4-b4b6-4dd8-a6ce-d9aca2cd2bc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8213cf2097b54fd9aa33659f7f398c89'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:17.752437 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-2b4dfba4-b4b6-4dd8-a6ce-d9aca2cd2bc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8213cf2097b54fd9aa33659f7f398c89'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:17.759002 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1315/2613] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:40:17 2022] DELETE /identity/v3/users/8213cf2097b54fd9aa33659f7f398c89 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:40:18.189773 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3667c-3a8b-4299-82cc-5db32251ebf2 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:18.192182 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-ece3667c-3a8b-4299-82cc-5db32251ebf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:18.212155 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3667c-3a8b-4299-82cc-5db32251ebf2 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:18.271670 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c52a6-e0e1-453e-992b-e7c2e9339191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:18.272471 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c52a6-e0e1-453e-992b-e7c2e9339191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:18.272759 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c52a6-e0e1-453e-992b-e7c2e9339191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:18.273039 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c52a6-e0e1-453e-992b-e7c2e9339191 admin admin] PATH_INFO: `/v3/projects/a67c1a89deab4a5a952301593bda4444` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:18.274356 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c52a6-e0e1-453e-992b-e7c2e9339191 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a67c1a89deab4a5a952301593bda4444)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:18.276315 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c52a6-e0e1-453e-992b-e7c2e9339191 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:18.417710 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-258c52a6-e0e1-453e-992b-e7c2e9339191 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a67c1a89deab4a5a952301593bda4444', 'request_id': 'req-258c52a6-e0e1-453e-992b-e7c2e9339191'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:18.508037 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-258c52a6-e0e1-453e-992b-e7c2e9339191 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a67c1a89deab4a5a952301593bda4444', 'request_id': 'req-258c52a6-e0e1-453e-992b-e7c2e9339191'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:18.514027 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-258c52a6-e0e1-453e-992b-e7c2e9339191 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a67c1a89deab4a5a952301593bda4444', 'request_id': 'req-258c52a6-e0e1-453e-992b-e7c2e9339191'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:18.525698 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-258c52a6-e0e1-453e-992b-e7c2e9339191 admin admin] The token cache is being invalidate because project a67c1a89deab4a5a952301593bda4444 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:40:18.525914 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-258c52a6-e0e1-453e-992b-e7c2e9339191 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:18.526541 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-258c52a6-e0e1-453e-992b-e7c2e9339191 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:18.528091 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1299/2614] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:40:18 2022] DELETE /identity/v3/projects/a67c1a89deab4a5a952301593bda4444 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:40:18.533694 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ecf2fa-b3f8-47cf-9ca8-db4b20861ef7 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:18.534184 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ecf2fa-b3f8-47cf-9ca8-db4b20861ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:18.534315 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ecf2fa-b3f8-47cf-9ca8-db4b20861ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:18.552064 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-38ecf2fa-b3f8-47cf-9ca8-db4b20861ef7 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:40:18.553327 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-38ecf2fa-b3f8-47cf-9ca8-db4b20861ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:18.580853 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:40:18.626075 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1316/2615] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:40:18.696550 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e3b10-1a55-43a0-8e5b-4fa3fc49ed6b None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:18.696550 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e3b10-1a55-43a0-8e5b-4fa3fc49ed6b None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:18.697117 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e3b10-1a55-43a0-8e5b-4fa3fc49ed6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:18.718607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-9e0e3b10-1a55-43a0-8e5b-4fa3fc49ed6b None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:40:18.721640 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-9e0e3b10-1a55-43a0-8e5b-4fa3fc49ed6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:18.728590 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1300/2616] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:40:18.732796 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ecf2fa-b3f8-47cf-9ca8-db4b20861ef7 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:18.745781 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ecf2fa-b3f8-47cf-9ca8-db4b20861ef7 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:18.750921 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee4f51-2223-4ce1-9d3d-d95e80278997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:18.752405 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee4f51-2223-4ce1-9d3d-d95e80278997 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:18.752776 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee4f51-2223-4ce1-9d3d-d95e80278997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:18.753061 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee4f51-2223-4ce1-9d3d-d95e80278997 admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:18.753804 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee4f51-2223-4ce1-9d3d-d95e80278997 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:40:18.754116 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee4f51-2223-4ce1-9d3d-d95e80278997 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:18.755792 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee4f51-2223-4ce1-9d3d-d95e80278997 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:18.769459 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1317/2617] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:40:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:40:18.773482 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e3b10-1a55-43a0-8e5b-4fa3fc49ed6b None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:18.784681 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e3b10-1a55-43a0-8e5b-4fa3fc49ed6b None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:18.788126 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14ed79-d95c-45fd-b7ca-c2f603c024b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:18.788785 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14ed79-d95c-45fd-b7ca-c2f603c024b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:18.789075 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14ed79-d95c-45fd-b7ca-c2f603c024b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:18.789353 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14ed79-d95c-45fd-b7ca-c2f603c024b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:18.790041 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b14ed79-d95c-45fd-b7ca-c2f603c024b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:18.791986 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b14ed79-d95c-45fd-b7ca-c2f603c024b2 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:18.900431 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1301/2618] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:40:18 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 19:40:18.901872 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee4f51-2223-4ce1-9d3d-d95e80278997 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:18.912987 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee4f51-2223-4ce1-9d3d-d95e80278997 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:18.982707 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a5bbb-c9da-40fc-83a3-9ec3ee7e90ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:18.983392 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a5bbb-c9da-40fc-83a3-9ec3ee7e90ae admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:18.983721 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a5bbb-c9da-40fc-83a3-9ec3ee7e90ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:18.984002 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a5bbb-c9da-40fc-83a3-9ec3ee7e90ae admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:18.984711 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62a5bbb-c9da-40fc-83a3-9ec3ee7e90ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:18.986891 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62a5bbb-c9da-40fc-83a3-9ec3ee7e90ae admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:19.066747 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1318/2619] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:40:18 2022] POST /identity/v3/users => generated 292 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:40:19.070848 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14ed79-d95c-45fd-b7ca-c2f603c024b2 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:19.085251 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14ed79-d95c-45fd-b7ca-c2f603c024b2 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:19.091738 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5cbb88-6b93-4132-81e0-115056f6e724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:19.092794 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5cbb88-6b93-4132-81e0-115056f6e724 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:19.093388 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5cbb88-6b93-4132-81e0-115056f6e724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:19.093821 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5cbb88-6b93-4132-81e0-115056f6e724 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:19.094731 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5cbb88-6b93-4132-81e0-115056f6e724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:19.096924 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5cbb88-6b93-4132-81e0-115056f6e724 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:19.109179 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1302/2620] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:40:19.113668 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a5bbb-c9da-40fc-83a3-9ec3ee7e90ae admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:19.130412 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a5bbb-c9da-40fc-83a3-9ec3ee7e90ae admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:19.136481 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4ffaa-a6c6-487e-9a91-e51c21657769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:19.137332 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4ffaa-a6c6-487e-9a91-e51c21657769 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:19.137650 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4ffaa-a6c6-487e-9a91-e51c21657769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:19.137937 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4ffaa-a6c6-487e-9a91-e51c21657769 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:19.139219 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e4ffaa-a6c6-487e-9a91-e51c21657769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:19.140390 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e4ffaa-a6c6-487e-9a91-e51c21657769 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:19.160661 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1319/2621] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:40:19.164345 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5cbb88-6b93-4132-81e0-115056f6e724 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:19.173695 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:40:19.180043 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5cbb88-6b93-4132-81e0-115056f6e724 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:19.185714 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393edcc-f964-4b46-87fc-c2d3a2c6563a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:19.186791 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393edcc-f964-4b46-87fc-c2d3a2c6563a admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:19.187142 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393edcc-f964-4b46-87fc-c2d3a2c6563a admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:19.192747 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393edcc-f964-4b46-87fc-c2d3a2c6563a admin admin] PATH_INFO: `/v3/projects/15f4e554b3d14bb79b3b138e70a2ff69/users/f5ef8896f87b42cb8ebddf9523ed2252/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:19.206911 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393edcc-f964-4b46-87fc-c2d3a2c6563a admin admin] RBAC: Authorizing `identity:create_grant(project_id=15f4e554b3d14bb79b3b138e70a2ff69, user_id=f5ef8896f87b42cb8ebddf9523ed2252, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:19.209751 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393edcc-f964-4b46-87fc-c2d3a2c6563a admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:19.287699 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1303/2622] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:40:19 2022] PUT /identity/v3/projects/15f4e554b3d14bb79b3b138e70a2ff69/users/f5ef8896f87b42cb8ebddf9523ed2252/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:40:19.298508 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc048c-7515-44fa-a5b7-370d1bc74c18 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:19.298672 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc048c-7515-44fa-a5b7-370d1bc74c18 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:19.298930 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc048c-7515-44fa-a5b7-370d1bc74c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:19.328476 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-6bbc048c-7515-44fa-a5b7-370d1bc74c18 None None] MFA Rules not processed for user `f5ef8896f87b42cb8ebddf9523ed2252`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:40:19.330351 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-6bbc048c-7515-44fa-a5b7-370d1bc74c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:19.396916 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1320/2623] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:40:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:40:19.409142 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393edcc-f964-4b46-87fc-c2d3a2c6563a admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:19.414010 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-f393edcc-f964-4b46-87fc-c2d3a2c6563a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:19.468934 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393edcc-f964-4b46-87fc-c2d3a2c6563a admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:19.472809 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc43e26-c2a2-4098-815a-a9d47c1c2cae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:19.473479 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc43e26-c2a2-4098-815a-a9d47c1c2cae service cinder] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:19.473759 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc43e26-c2a2-4098-815a-a9d47c1c2cae service cinder] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:19.474030 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc43e26-c2a2-4098-815a-a9d47c1c2cae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:19.482451 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc43e26-c2a2-4098-815a-a9d47c1c2cae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:19.483913 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc43e26-c2a2-4098-815a-a9d47c1c2cae service cinder] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:19.492951 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1304/2624] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:40:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:40:26.279958 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc048c-7515-44fa-a5b7-370d1bc74c18 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:26.314259 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:40:26.355177 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc048c-7515-44fa-a5b7-370d1bc74c18 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:26.359862 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863645a-61d3-4318-9b51-1b766a5d4648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:26.360750 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863645a-61d3-4318-9b51-1b766a5d4648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:26.361032 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863645a-61d3-4318-9b51-1b766a5d4648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:26.361311 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863645a-61d3-4318-9b51-1b766a5d4648 admin admin] PATH_INFO: `/v3/users/f5ef8896f87b42cb8ebddf9523ed2252` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:26.363493 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5863645a-61d3-4318-9b51-1b766a5d4648 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5ef8896f87b42cb8ebddf9523ed2252)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:26.365364 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5863645a-61d3-4318-9b51-1b766a5d4648 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:26.536630 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-5863645a-61d3-4318-9b51-1b766a5d4648 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5ef8896f87b42cb8ebddf9523ed2252'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:26.634663 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-5863645a-61d3-4318-9b51-1b766a5d4648 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5ef8896f87b42cb8ebddf9523ed2252'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:26.635317 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-5863645a-61d3-4318-9b51-1b766a5d4648 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5ef8896f87b42cb8ebddf9523ed2252'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:26.642881 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-5863645a-61d3-4318-9b51-1b766a5d4648 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5ef8896f87b42cb8ebddf9523ed2252'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:26.656060 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-5863645a-61d3-4318-9b51-1b766a5d4648 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5ef8896f87b42cb8ebddf9523ed2252'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:26.663005 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1321/2625] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:40:26 2022] DELETE /identity/v3/users/f5ef8896f87b42cb8ebddf9523ed2252 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:40:26.667797 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434265c5-8f25-435b-a406-c3fb70b07f52 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:26.668240 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434265c5-8f25-435b-a406-c3fb70b07f52 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:26.668240 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434265c5-8f25-435b-a406-c3fb70b07f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:26.686524 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-434265c5-8f25-435b-a406-c3fb70b07f52 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:40:26.687791 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-434265c5-8f25-435b-a406-c3fb70b07f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:26.749240 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1305/2626] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:40:26.758858 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863645a-61d3-4318-9b51-1b766a5d4648 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:26.760318 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-5863645a-61d3-4318-9b51-1b766a5d4648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:26.823419 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863645a-61d3-4318-9b51-1b766a5d4648 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:26.827283 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee4e72-f85d-4f31-962a-e745f13f827f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:26.828044 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee4e72-f85d-4f31-962a-e745f13f827f service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:26.828376 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee4e72-f85d-4f31-962a-e745f13f827f service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:26.828660 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee4e72-f85d-4f31-962a-e745f13f827f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:26.838870 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fee4e72-f85d-4f31-962a-e745f13f827f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:26.840346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fee4e72-f85d-4f31-962a-e745f13f827f service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:26.850640 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1322/2627] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:40:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:40:27.270099 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434265c5-8f25-435b-a406-c3fb70b07f52 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:27.271560 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-434265c5-8f25-435b-a406-c3fb70b07f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:27.284878 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434265c5-8f25-435b-a406-c3fb70b07f52 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:27.289175 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8084ac6-665d-4acd-a941-d35e180ed978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:27.290081 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8084ac6-665d-4acd-a941-d35e180ed978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:27.290370 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8084ac6-665d-4acd-a941-d35e180ed978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:27.290650 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8084ac6-665d-4acd-a941-d35e180ed978 admin admin] PATH_INFO: `/v3/projects/15f4e554b3d14bb79b3b138e70a2ff69` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:27.291900 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8084ac6-665d-4acd-a941-d35e180ed978 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15f4e554b3d14bb79b3b138e70a2ff69)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:27.293795 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8084ac6-665d-4acd-a941-d35e180ed978 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:27.406707 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-b8084ac6-665d-4acd-a941-d35e180ed978 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15f4e554b3d14bb79b3b138e70a2ff69', 'request_id': 'req-b8084ac6-665d-4acd-a941-d35e180ed978'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:27.496035 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-b8084ac6-665d-4acd-a941-d35e180ed978 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15f4e554b3d14bb79b3b138e70a2ff69', 'request_id': 'req-b8084ac6-665d-4acd-a941-d35e180ed978'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:27.503327 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-b8084ac6-665d-4acd-a941-d35e180ed978 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15f4e554b3d14bb79b3b138e70a2ff69', 'request_id': 'req-b8084ac6-665d-4acd-a941-d35e180ed978'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:27.518196 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-b8084ac6-665d-4acd-a941-d35e180ed978 admin admin] The token cache is being invalidate because project 15f4e554b3d14bb79b3b138e70a2ff69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:40:27.518196 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-b8084ac6-665d-4acd-a941-d35e180ed978 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:27.518196 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-b8084ac6-665d-4acd-a941-d35e180ed978 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:27.520899 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1306/2628] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:40:27 2022] DELETE /identity/v3/projects/15f4e554b3d14bb79b3b138e70a2ff69 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:40:27.522449 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e37897-0eaf-456e-9c1a-71537e04f930 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:27.530605 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e37897-0eaf-456e-9c1a-71537e04f930 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:27.530605 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e37897-0eaf-456e-9c1a-71537e04f930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:27.542140 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-24e37897-0eaf-456e-9c1a-71537e04f930 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:40:27.543364 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-24e37897-0eaf-456e-9c1a-71537e04f930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:27.588539 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:40:27.607249 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1323/2629] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:40:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:40:27.617558 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086cc43-85d0-4994-a420-6760ff5f5b57 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:27.617974 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086cc43-85d0-4994-a420-6760ff5f5b57 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:27.618350 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086cc43-85d0-4994-a420-6760ff5f5b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:27.633798 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:40:27.639718 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-c086cc43-85d0-4994-a420-6760ff5f5b57 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:40:27.640978 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-c086cc43-85d0-4994-a420-6760ff5f5b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:27.649559 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1307/2630] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:40:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:40:27.654172 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e37897-0eaf-456e-9c1a-71537e04f930 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:27.664340 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e37897-0eaf-456e-9c1a-71537e04f930 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:27.668938 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d08fa-3ecb-4702-a46b-98fa53c9e85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:27.669604 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d08fa-3ecb-4702-a46b-98fa53c9e85c admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:27.669890 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d08fa-3ecb-4702-a46b-98fa53c9e85c admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:27.670171 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d08fa-3ecb-4702-a46b-98fa53c9e85c admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:27.670913 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d08fa-3ecb-4702-a46b-98fa53c9e85c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:40:27.671225 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d08fa-3ecb-4702-a46b-98fa53c9e85c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:27.673171 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d08fa-3ecb-4702-a46b-98fa53c9e85c admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:27.686836 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1324/2631] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:40:27.691079 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086cc43-85d0-4994-a420-6760ff5f5b57 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:27.700577 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086cc43-85d0-4994-a420-6760ff5f5b57 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:27.708015 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae60266-2989-412f-8156-fba388bf53b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:27.708682 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae60266-2989-412f-8156-fba388bf53b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:27.708971 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae60266-2989-412f-8156-fba388bf53b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:27.709251 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae60266-2989-412f-8156-fba388bf53b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:27.709966 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae60266-2989-412f-8156-fba388bf53b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:27.711927 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae60266-2989-412f-8156-fba388bf53b1 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:27.828309 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1308/2632] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:40:27 2022] POST /identity/v3/projects => generated 377 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:40:27.829437 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d08fa-3ecb-4702-a46b-98fa53c9e85c admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:27.842242 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d08fa-3ecb-4702-a46b-98fa53c9e85c admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:27.914892 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46457da4-1346-4f54-8d1b-0c5f1d27b5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:27.915812 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46457da4-1346-4f54-8d1b-0c5f1d27b5bc admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:27.916158 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46457da4-1346-4f54-8d1b-0c5f1d27b5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:27.916447 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46457da4-1346-4f54-8d1b-0c5f1d27b5bc admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:27.917150 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46457da4-1346-4f54-8d1b-0c5f1d27b5bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:27.919403 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46457da4-1346-4f54-8d1b-0c5f1d27b5bc admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:28.025024 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1325/2633] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:40:27 2022] POST /identity/v3/users => generated 289 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:40:28.029528 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae60266-2989-412f-8156-fba388bf53b1 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:28.040407 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae60266-2989-412f-8156-fba388bf53b1 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:28.045422 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe542ec7-1100-4a54-ae96-76f22bb54500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:28.046091 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe542ec7-1100-4a54-ae96-76f22bb54500 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:28.046379 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe542ec7-1100-4a54-ae96-76f22bb54500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:28.046657 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe542ec7-1100-4a54-ae96-76f22bb54500 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:28.047560 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe542ec7-1100-4a54-ae96-76f22bb54500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:28.049170 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe542ec7-1100-4a54-ae96-76f22bb54500 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:28.060202 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1309/2634] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:40:28.070461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46457da4-1346-4f54-8d1b-0c5f1d27b5bc admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:28.081064 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46457da4-1346-4f54-8d1b-0c5f1d27b5bc admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:28.086011 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ac98b-4ff3-4e9d-be99-85847bf8af24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:28.086679 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ac98b-4ff3-4e9d-be99-85847bf8af24 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:28.086966 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ac98b-4ff3-4e9d-be99-85847bf8af24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:28.087261 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ac98b-4ff3-4e9d-be99-85847bf8af24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:28.088019 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ac98b-4ff3-4e9d-be99-85847bf8af24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:28.089692 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ac98b-4ff3-4e9d-be99-85847bf8af24 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:28.100967 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1326/2635] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 19:40:28.106020 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe542ec7-1100-4a54-ae96-76f22bb54500 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:28.116367 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe542ec7-1100-4a54-ae96-76f22bb54500 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:28.120934 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884c8f8-4d4f-4eea-9662-3a8b38c9fd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:28.121822 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884c8f8-4d4f-4eea-9662-3a8b38c9fd86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:28.122110 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884c8f8-4d4f-4eea-9662-3a8b38c9fd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:28.122388 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884c8f8-4d4f-4eea-9662-3a8b38c9fd86 admin admin] PATH_INFO: `/v3/projects/0b3166e898dc4cb585c3ba1231294e6a/users/e634e8408f95484aa40d7428b43744d1/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:28.137771 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d884c8f8-4d4f-4eea-9662-3a8b38c9fd86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b3166e898dc4cb585c3ba1231294e6a, user_id=e634e8408f95484aa40d7428b43744d1, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:28.140946 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d884c8f8-4d4f-4eea-9662-3a8b38c9fd86 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:28.204981 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1310/2636] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:40:28 2022] PUT /identity/v3/projects/0b3166e898dc4cb585c3ba1231294e6a/users/e634e8408f95484aa40d7428b43744d1/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:40:28.216220 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc615e1e-1ae0-43cd-8abe-4194ee132732 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:28.216513 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc615e1e-1ae0-43cd-8abe-4194ee132732 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:28.216792 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc615e1e-1ae0-43cd-8abe-4194ee132732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:28.243355 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-bc615e1e-1ae0-43cd-8abe-4194ee132732 None None] MFA Rules not processed for user `e634e8408f95484aa40d7428b43744d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:40:28.244648 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-bc615e1e-1ae0-43cd-8abe-4194ee132732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:28.324216 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1327/2637] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:40:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:40:28.337573 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884c8f8-4d4f-4eea-9662-3a8b38c9fd86 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:28.339350 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-d884c8f8-4d4f-4eea-9662-3a8b38c9fd86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:28.415997 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884c8f8-4d4f-4eea-9662-3a8b38c9fd86 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:28.419024 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2eba02-e741-404a-8c9f-810806297e01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:28.422991 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2eba02-e741-404a-8c9f-810806297e01 service cinder] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:28.422991 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2eba02-e741-404a-8c9f-810806297e01 service cinder] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:28.422991 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2eba02-e741-404a-8c9f-810806297e01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:28.430379 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2eba02-e741-404a-8c9f-810806297e01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:28.432044 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2eba02-e741-404a-8c9f-810806297e01 service cinder] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:28.444505 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1311/2638] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:40:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:40:31.105272 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41572ea2-bae2-4b1d-9605-f7edd21f0e9b None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:31.105831 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41572ea2-bae2-4b1d-9605-f7edd21f0e9b None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:31.105831 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41572ea2-bae2-4b1d-9605-f7edd21f0e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:31.123740 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-41572ea2-bae2-4b1d-9605-f7edd21f0e9b None None] MFA Rules not processed for user `87f021ceaea34306a44761f4e984bf9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:40:31.130956 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-41572ea2-bae2-4b1d-9605-f7edd21f0e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:31.165563 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:40:31.182518 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1328/2639] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:40:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:40:31.488899 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2eba02-e741-404a-8c9f-810806297e01 service cinder] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:31.490549 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-bf2eba02-e741-404a-8c9f-810806297e01 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:31.548989 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2eba02-e741-404a-8c9f-810806297e01 service cinder] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:31.552732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5807f-9c41-40da-8583-3d62a5d3e111 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:31.553418 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5807f-9c41-40da-8583-3d62a5d3e111 service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:31.553700 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5807f-9c41-40da-8583-3d62a5d3e111 service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:31.554034 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5807f-9c41-40da-8583-3d62a5d3e111 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:31.555847 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-65b5807f-9c41-40da-8583-3d62a5d3e111 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:31.565247 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5807f-9c41-40da-8583-3d62a5d3e111 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:31.566650 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5807f-9c41-40da-8583-3d62a5d3e111 service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:31.575449 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1312/2640] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:40:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:40:37.320780 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41572ea2-bae2-4b1d-9605-f7edd21f0e9b None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:37.322189 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-41572ea2-bae2-4b1d-9605-f7edd21f0e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:37.386996 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41572ea2-bae2-4b1d-9605-f7edd21f0e9b None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:37.391639 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9c18c-911f-4caf-abfb-fb5211ec63c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:37.392459 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9c18c-911f-4caf-abfb-fb5211ec63c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:37.392743 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9c18c-911f-4caf-abfb-fb5211ec63c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:37.393041 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9c18c-911f-4caf-abfb-fb5211ec63c3 admin admin] PATH_INFO: `/v3/users/7d6cf7577d78496daa2f1ffe742906a5` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:37.394250 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc9c18c-911f-4caf-abfb-fb5211ec63c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d6cf7577d78496daa2f1ffe742906a5)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:37.396212 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc9c18c-911f-4caf-abfb-fb5211ec63c3 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:37.533170 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-9bc9c18c-911f-4caf-abfb-fb5211ec63c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d6cf7577d78496daa2f1ffe742906a5'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:37.577708 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-9bc9c18c-911f-4caf-abfb-fb5211ec63c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d6cf7577d78496daa2f1ffe742906a5'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:37.578347 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-9bc9c18c-911f-4caf-abfb-fb5211ec63c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d6cf7577d78496daa2f1ffe742906a5'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:37.585857 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-9bc9c18c-911f-4caf-abfb-fb5211ec63c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d6cf7577d78496daa2f1ffe742906a5'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:37.598350 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-9bc9c18c-911f-4caf-abfb-fb5211ec63c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d6cf7577d78496daa2f1ffe742906a5'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:37.605135 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1329/2641] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:40:37 2022] DELETE /identity/v3/users/7d6cf7577d78496daa2f1ffe742906a5 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:40:37.609645 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961c82c-da71-4d2c-8bc4-4b7af3ea5d5c None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:37.610143 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961c82c-da71-4d2c-8bc4-4b7af3ea5d5c None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:37.610260 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961c82c-da71-4d2c-8bc4-4b7af3ea5d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:37.628070 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-e961c82c-da71-4d2c-8bc4-4b7af3ea5d5c None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:40:37.630061 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-e961c82c-da71-4d2c-8bc4-4b7af3ea5d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:37.673788 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:40:37.688614 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1313/2642] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:40:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:40:37.698888 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9c18c-911f-4caf-abfb-fb5211ec63c3 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:37.700341 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-9bc9c18c-911f-4caf-abfb-fb5211ec63c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:37.758149 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9c18c-911f-4caf-abfb-fb5211ec63c3 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:37.762096 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19845f-f2b8-433f-a327-3dba817bb25d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:37.762757 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19845f-f2b8-433f-a327-3dba817bb25d service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:37.763047 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19845f-f2b8-433f-a327-3dba817bb25d service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:37.763327 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19845f-f2b8-433f-a327-3dba817bb25d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:37.774466 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d19845f-f2b8-433f-a327-3dba817bb25d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:37.775978 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d19845f-f2b8-433f-a327-3dba817bb25d service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:37.786974 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1330/2643] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:40:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:40:38.218864 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961c82c-da71-4d2c-8bc4-4b7af3ea5d5c None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:38.220337 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-e961c82c-da71-4d2c-8bc4-4b7af3ea5d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:38.233215 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961c82c-da71-4d2c-8bc4-4b7af3ea5d5c None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:38.238018 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ebe583-789e-4974-b5d7-238ac957e290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:38.238898 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ebe583-789e-4974-b5d7-238ac957e290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:38.239183 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ebe583-789e-4974-b5d7-238ac957e290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:38.239488 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ebe583-789e-4974-b5d7-238ac957e290 admin admin] PATH_INFO: `/v3/projects/440b8b25a6a2461a92751b34c155b2c0` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:38.240692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ebe583-789e-4974-b5d7-238ac957e290 admin admin] RBAC: Authorizing `identity:delete_project(project_id=440b8b25a6a2461a92751b34c155b2c0)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:38.243485 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ebe583-789e-4974-b5d7-238ac957e290 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:38.358759 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-87ebe583-789e-4974-b5d7-238ac957e290 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '440b8b25a6a2461a92751b34c155b2c0', 'request_id': 'req-87ebe583-789e-4974-b5d7-238ac957e290'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:38.417547 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-87ebe583-789e-4974-b5d7-238ac957e290 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '440b8b25a6a2461a92751b34c155b2c0', 'request_id': 'req-87ebe583-789e-4974-b5d7-238ac957e290'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:38.423836 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-87ebe583-789e-4974-b5d7-238ac957e290 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '440b8b25a6a2461a92751b34c155b2c0', 'request_id': 'req-87ebe583-789e-4974-b5d7-238ac957e290'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:38.437193 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-87ebe583-789e-4974-b5d7-238ac957e290 admin admin] The token cache is being invalidate because project 440b8b25a6a2461a92751b34c155b2c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:40:38.437484 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-87ebe583-789e-4974-b5d7-238ac957e290 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:38.438152 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-87ebe583-789e-4974-b5d7-238ac957e290 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:38.439750 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1314/2644] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:40:38 2022] DELETE /identity/v3/projects/440b8b25a6a2461a92751b34c155b2c0 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:40:38.444869 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19845f-f2b8-433f-a327-3dba817bb25d service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:38.454673 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19845f-f2b8-433f-a327-3dba817bb25d service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:38.459358 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:40:38.511523 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e74b3-c374-4cce-943e-6cdcd2f30795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:38.512347 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e74b3-c374-4cce-943e-6cdcd2f30795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:38.512635 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e74b3-c374-4cce-943e-6cdcd2f30795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:38.512936 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e74b3-c374-4cce-943e-6cdcd2f30795 admin admin] PATH_INFO: `/v3/users/16a38a188e94408388dd0a33ee4edfb4` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:38.514123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e74b3-c374-4cce-943e-6cdcd2f30795 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16a38a188e94408388dd0a33ee4edfb4)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:38.516929 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e74b3-c374-4cce-943e-6cdcd2f30795 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:38.699610 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c90e74b3-c374-4cce-943e-6cdcd2f30795 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16a38a188e94408388dd0a33ee4edfb4'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:38.794735 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c90e74b3-c374-4cce-943e-6cdcd2f30795 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16a38a188e94408388dd0a33ee4edfb4'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:38.795286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c90e74b3-c374-4cce-943e-6cdcd2f30795 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16a38a188e94408388dd0a33ee4edfb4'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:38.802742 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c90e74b3-c374-4cce-943e-6cdcd2f30795 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16a38a188e94408388dd0a33ee4edfb4'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:38.815057 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c90e74b3-c374-4cce-943e-6cdcd2f30795 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16a38a188e94408388dd0a33ee4edfb4'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:38.821491 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1331/2645] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:40:38 2022] DELETE /identity/v3/users/16a38a188e94408388dd0a33ee4edfb4 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:40:39.291741 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ebe583-789e-4974-b5d7-238ac957e290 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:39.293693 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-87ebe583-789e-4974-b5d7-238ac957e290 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:39.307849 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ebe583-789e-4974-b5d7-238ac957e290 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:39.366355 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051bb370-2e9e-4c2e-9d1e-5c807da63e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:39.367308 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bb370-2e9e-4c2e-9d1e-5c807da63e63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:39.367748 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bb370-2e9e-4c2e-9d1e-5c807da63e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:39.367898 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bb370-2e9e-4c2e-9d1e-5c807da63e63 admin admin] PATH_INFO: `/v3/projects/be439e9f679245fcb999f176c91d1161` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:39.369087 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051bb370-2e9e-4c2e-9d1e-5c807da63e63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be439e9f679245fcb999f176c91d1161)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:39.371013 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051bb370-2e9e-4c2e-9d1e-5c807da63e63 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:39.504893 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-051bb370-2e9e-4c2e-9d1e-5c807da63e63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be439e9f679245fcb999f176c91d1161', 'request_id': 'req-051bb370-2e9e-4c2e-9d1e-5c807da63e63'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:39.593427 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-051bb370-2e9e-4c2e-9d1e-5c807da63e63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be439e9f679245fcb999f176c91d1161', 'request_id': 'req-051bb370-2e9e-4c2e-9d1e-5c807da63e63'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:39.599654 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-051bb370-2e9e-4c2e-9d1e-5c807da63e63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be439e9f679245fcb999f176c91d1161', 'request_id': 'req-051bb370-2e9e-4c2e-9d1e-5c807da63e63'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:39.614250 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-051bb370-2e9e-4c2e-9d1e-5c807da63e63 admin admin] The token cache is being invalidate because project be439e9f679245fcb999f176c91d1161 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:40:39.614675 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-051bb370-2e9e-4c2e-9d1e-5c807da63e63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:39.616195 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-051bb370-2e9e-4c2e-9d1e-5c807da63e63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:39.617977 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1315/2646] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:40:39 2022] DELETE /identity/v3/projects/be439e9f679245fcb999f176c91d1161 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:40:39.623042 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc233702-6820-4961-ba12-6aeb6f90e7c7 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:39.628315 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc233702-6820-4961-ba12-6aeb6f90e7c7 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:39.628315 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc233702-6820-4961-ba12-6aeb6f90e7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:39.641526 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-cc233702-6820-4961-ba12-6aeb6f90e7c7 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:40:39.642756 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-cc233702-6820-4961-ba12-6aeb6f90e7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:39.704884 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1332/2647] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:40:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:40:39.712985 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf8cbb-b6ec-4714-92ca-de03f20b8074 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:39.713278 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf8cbb-b6ec-4714-92ca-de03f20b8074 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:39.713556 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf8cbb-b6ec-4714-92ca-de03f20b8074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:39.720122 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:40:39.732950 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-e0bf8cbb-b6ec-4714-92ca-de03f20b8074 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:40:39.734156 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-e0bf8cbb-b6ec-4714-92ca-de03f20b8074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:39.742816 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1316/2648] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:40:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:40:39.747098 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc233702-6820-4961-ba12-6aeb6f90e7c7 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:39.757241 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc233702-6820-4961-ba12-6aeb6f90e7c7 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:39.762057 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18babcc2-66d3-440d-951a-cfcfc2322ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:39.762726 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18babcc2-66d3-440d-951a-cfcfc2322ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:39.763012 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18babcc2-66d3-440d-951a-cfcfc2322ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:39.763350 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18babcc2-66d3-440d-951a-cfcfc2322ca4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:39.772078 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18babcc2-66d3-440d-951a-cfcfc2322ca4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:40:39.772078 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18babcc2-66d3-440d-951a-cfcfc2322ca4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:39.772078 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18babcc2-66d3-440d-951a-cfcfc2322ca4 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:39.778385 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1333/2649] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:40:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:40:39.782680 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf8cbb-b6ec-4714-92ca-de03f20b8074 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:39.793046 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf8cbb-b6ec-4714-92ca-de03f20b8074 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:39.800666 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6125b16b-485b-4cb9-83ec-b1e62f0224f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:39.800666 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125b16b-485b-4cb9-83ec-b1e62f0224f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:39.800666 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125b16b-485b-4cb9-83ec-b1e62f0224f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:39.800666 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125b16b-485b-4cb9-83ec-b1e62f0224f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:39.801034 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6125b16b-485b-4cb9-83ec-b1e62f0224f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:39.801966 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6125b16b-485b-4cb9-83ec-b1e62f0224f4 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:39.897759 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1317/2650] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:40:39 2022] POST /identity/v3/projects => generated 369 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:40:39.901923 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18babcc2-66d3-440d-951a-cfcfc2322ca4 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:39.912038 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18babcc2-66d3-440d-951a-cfcfc2322ca4 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:39.924322 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:40:39.973597 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88978cf-ebc3-4ff0-b0ea-f3f1ec0645d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:39.974274 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88978cf-ebc3-4ff0-b0ea-f3f1ec0645d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:39.974558 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88978cf-ebc3-4ff0-b0ea-f3f1ec0645d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:39.974850 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88978cf-ebc3-4ff0-b0ea-f3f1ec0645d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:39.976204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88978cf-ebc3-4ff0-b0ea-f3f1ec0645d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:39.978103 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88978cf-ebc3-4ff0-b0ea-f3f1ec0645d7 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:40.069714 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1334/2651] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:40:39 2022] POST /identity/v3/users => generated 285 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:40:40.074025 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6125b16b-485b-4cb9-83ec-b1e62f0224f4 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:40.085694 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6125b16b-485b-4cb9-83ec-b1e62f0224f4 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:40.090753 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca76024a-a319-4612-b23f-098ff65bcd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:40.091449 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76024a-a319-4612-b23f-098ff65bcd83 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:40.091774 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76024a-a319-4612-b23f-098ff65bcd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:40.092056 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76024a-a319-4612-b23f-098ff65bcd83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:40.092788 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca76024a-a319-4612-b23f-098ff65bcd83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:40.094453 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca76024a-a319-4612-b23f-098ff65bcd83 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:40.105968 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1318/2652] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:40:40.110172 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88978cf-ebc3-4ff0-b0ea-f3f1ec0645d7 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:40.120957 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88978cf-ebc3-4ff0-b0ea-f3f1ec0645d7 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:40.126135 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526630c5-59be-41f3-9686-3f5e385fc8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:40.126821 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526630c5-59be-41f3-9686-3f5e385fc8cf admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:40.127108 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526630c5-59be-41f3-9686-3f5e385fc8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:40.127388 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526630c5-59be-41f3-9686-3f5e385fc8cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:40.128144 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526630c5-59be-41f3-9686-3f5e385fc8cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:40.129751 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526630c5-59be-41f3-9686-3f5e385fc8cf admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:40.140371 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1335/2653] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 19:40:40.144624 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca76024a-a319-4612-b23f-098ff65bcd83 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:40.155225 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca76024a-a319-4612-b23f-098ff65bcd83 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:40.159810 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51bf24-3d5e-4e68-8677-d947cefcaf90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:40.160692 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51bf24-3d5e-4e68-8677-d947cefcaf90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:40.160979 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51bf24-3d5e-4e68-8677-d947cefcaf90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:40.161261 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51bf24-3d5e-4e68-8677-d947cefcaf90 admin admin] PATH_INFO: `/v3/projects/7cea4ac9b873469298be141a015b7253/users/813fed4b01be4b98b42fb2fa0d8fbc8c/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:40.176730 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51bf24-3d5e-4e68-8677-d947cefcaf90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cea4ac9b873469298be141a015b7253, user_id=813fed4b01be4b98b42fb2fa0d8fbc8c, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:40.179085 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51bf24-3d5e-4e68-8677-d947cefcaf90 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:40.253235 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1319/2654] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:40:40 2022] PUT /identity/v3/projects/7cea4ac9b873469298be141a015b7253/users/813fed4b01be4b98b42fb2fa0d8fbc8c/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:40:40.265192 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fd1e4-0459-4025-9af9-8abef1332e39 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:40.265491 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fd1e4-0459-4025-9af9-8abef1332e39 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:40.265789 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fd1e4-0459-4025-9af9-8abef1332e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:40.302917 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-b96fd1e4-0459-4025-9af9-8abef1332e39 None None] MFA Rules not processed for user `813fed4b01be4b98b42fb2fa0d8fbc8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:40:40.305108 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-b96fd1e4-0459-4025-9af9-8abef1332e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:40.378081 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1336/2655] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:40:40 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:40:40.383308 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51bf24-3d5e-4e68-8677-d947cefcaf90 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:40.448861 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51bf24-3d5e-4e68-8677-d947cefcaf90 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:40.454067 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ca288-2d4b-418c-adf5-f596e8b028cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:40.454733 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ca288-2d4b-418c-adf5-f596e8b028cd admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:40.455026 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ca288-2d4b-418c-adf5-f596e8b028cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:40.455303 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ca288-2d4b-418c-adf5-f596e8b028cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:40.456081 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ca288-2d4b-418c-adf5-f596e8b028cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:40.457987 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ca288-2d4b-418c-adf5-f596e8b028cd admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:40.541956 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1320/2656] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:40:40 2022] POST /identity/v3/projects => generated 367 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:40:40.543232 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96fd1e4-0459-4025-9af9-8abef1332e39 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:40.557455 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96fd1e4-0459-4025-9af9-8abef1332e39 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:40.616650 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d490534-a552-4b6e-bf97-f1772e378aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:40.617354 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d490534-a552-4b6e-bf97-f1772e378aae admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:40.617663 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d490534-a552-4b6e-bf97-f1772e378aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:40.617939 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d490534-a552-4b6e-bf97-f1772e378aae admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:40.618634 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d490534-a552-4b6e-bf97-f1772e378aae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:40.620551 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d490534-a552-4b6e-bf97-f1772e378aae admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:40.715864 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1337/2657] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:40:40 2022] POST /identity/v3/users => generated 290 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:40:40.719651 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ca288-2d4b-418c-adf5-f596e8b028cd admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:40.729908 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ca288-2d4b-418c-adf5-f596e8b028cd admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:40.734711 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6a974-970f-467c-bd11-21cc88db1d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:40.735367 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6a974-970f-467c-bd11-21cc88db1d50 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:40.735714 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6a974-970f-467c-bd11-21cc88db1d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:40.736208 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6a974-970f-467c-bd11-21cc88db1d50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:40.736806 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb6a974-970f-467c-bd11-21cc88db1d50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:40.738612 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb6a974-970f-467c-bd11-21cc88db1d50 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:40.750358 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1321/2658] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 19:40:40.754397 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d490534-a552-4b6e-bf97-f1772e378aae admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:40.765217 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d490534-a552-4b6e-bf97-f1772e378aae admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:40.769842 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce346a2b-4b2e-49f1-a424-7eb8f5a6afb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:40.770719 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce346a2b-4b2e-49f1-a424-7eb8f5a6afb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:40.771004 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce346a2b-4b2e-49f1-a424-7eb8f5a6afb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:40.771284 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce346a2b-4b2e-49f1-a424-7eb8f5a6afb9 admin admin] PATH_INFO: `/v3/projects/da0dde5843974d5fbf58a5096f65c159/users/1bb2e170042649aaa04844f974a9fa3f/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:40.782742 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:40:40.786792 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce346a2b-4b2e-49f1-a424-7eb8f5a6afb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da0dde5843974d5fbf58a5096f65c159, user_id=1bb2e170042649aaa04844f974a9fa3f, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:40.790077 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce346a2b-4b2e-49f1-a424-7eb8f5a6afb9 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:40.851767 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1338/2659] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:40:40 2022] PUT /identity/v3/projects/da0dde5843974d5fbf58a5096f65c159/users/1bb2e170042649aaa04844f974a9fa3f/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:40:40.855704 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6a974-970f-467c-bd11-21cc88db1d50 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:40.866345 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6a974-970f-467c-bd11-21cc88db1d50 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:40.929417 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caff727-e7d8-477d-adc1-5c5ce2580003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:40.929417 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caff727-e7d8-477d-adc1-5c5ce2580003 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:40.929417 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caff727-e7d8-477d-adc1-5c5ce2580003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:40.929417 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caff727-e7d8-477d-adc1-5c5ce2580003 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:40.930061 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caff727-e7d8-477d-adc1-5c5ce2580003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:40.931714 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caff727-e7d8-477d-adc1-5c5ce2580003 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:40.945252 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1322/2660] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:40:40.946711 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce346a2b-4b2e-49f1-a424-7eb8f5a6afb9 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:40.957132 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce346a2b-4b2e-49f1-a424-7eb8f5a6afb9 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:40.961931 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb6c30-c68d-470e-b586-64b1329744c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:40.962810 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb6c30-c68d-470e-b586-64b1329744c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:40.963097 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb6c30-c68d-470e-b586-64b1329744c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:40.963462 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb6c30-c68d-470e-b586-64b1329744c6 admin admin] PATH_INFO: `/v3/projects/da0dde5843974d5fbf58a5096f65c159/users/1bb2e170042649aaa04844f974a9fa3f/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:40.965464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb6c30-c68d-470e-b586-64b1329744c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da0dde5843974d5fbf58a5096f65c159, user_id=1bb2e170042649aaa04844f974a9fa3f, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:40.968171 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb6c30-c68d-470e-b586-64b1329744c6 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:40.978283 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1339/2661] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:40:40 2022] PUT /identity/v3/projects/da0dde5843974d5fbf58a5096f65c159/users/1bb2e170042649aaa04844f974a9fa3f/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:40:40.988730 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3aa11e-abd0-4d1e-8642-f558625ff701 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:40.989104 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3aa11e-abd0-4d1e-8642-f558625ff701 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:40.989470 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3aa11e-abd0-4d1e-8642-f558625ff701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:41.010116 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:40:41.019177 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-cd3aa11e-abd0-4d1e-8642-f558625ff701 None None] MFA Rules not processed for user `1bb2e170042649aaa04844f974a9fa3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:40:41.020477 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-cd3aa11e-abd0-4d1e-8642-f558625ff701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:41.087969 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1323/2662] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:40:40 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:40:41.099477 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb6c30-c68d-470e-b586-64b1329744c6 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:41.101830 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-5dcb6c30-c68d-470e-b586-64b1329744c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:41.161616 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb6c30-c68d-470e-b586-64b1329744c6 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:41.166107 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08458c9-18e8-4552-ab9b-9a93d2616d7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:41.171171 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08458c9-18e8-4552-ab9b-9a93d2616d7f service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:41.171171 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08458c9-18e8-4552-ab9b-9a93d2616d7f service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:41.171171 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08458c9-18e8-4552-ab9b-9a93d2616d7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:41.177197 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08458c9-18e8-4552-ab9b-9a93d2616d7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:41.179656 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08458c9-18e8-4552-ab9b-9a93d2616d7f service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:41.190810 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1340/2663] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:40:41 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:40:41.460858 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3aa11e-abd0-4d1e-8642-f558625ff701 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:41.462281 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-cd3aa11e-abd0-4d1e-8642-f558625ff701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:41.474282 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3aa11e-abd0-4d1e-8642-f558625ff701 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:41.478883 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3505c-0151-4afc-b172-9c20da70d022 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:41.479568 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3505c-0151-4afc-b172-9c20da70d022 service cinder] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:41.479856 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3505c-0151-4afc-b172-9c20da70d022 service cinder] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:41.480136 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3505c-0151-4afc-b172-9c20da70d022 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:41.539327 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe3505c-0151-4afc-b172-9c20da70d022 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:41.540730 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe3505c-0151-4afc-b172-9c20da70d022 service cinder] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:41.550053 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1324/2664] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:40:41 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:40:43.455335 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08458c9-18e8-4552-ab9b-9a93d2616d7f service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:43.456719 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-b08458c9-18e8-4552-ab9b-9a93d2616d7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:43.523535 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08458c9-18e8-4552-ab9b-9a93d2616d7f service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:43.528242 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ed71a-6e09-4119-82be-5f7b4bd00fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:43.529110 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ed71a-6e09-4119-82be-5f7b4bd00fc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:43.529397 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ed71a-6e09-4119-82be-5f7b4bd00fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:43.529671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ed71a-6e09-4119-82be-5f7b4bd00fc0 admin admin] PATH_INFO: `/v3/users/e634e8408f95484aa40d7428b43744d1` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:43.531210 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4ed71a-6e09-4119-82be-5f7b4bd00fc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e634e8408f95484aa40d7428b43744d1)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:43.532868 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4ed71a-6e09-4119-82be-5f7b4bd00fc0 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:43.735231 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ba4ed71a-6e09-4119-82be-5f7b4bd00fc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e634e8408f95484aa40d7428b43744d1'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:43.805853 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ba4ed71a-6e09-4119-82be-5f7b4bd00fc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e634e8408f95484aa40d7428b43744d1'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:43.806551 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ba4ed71a-6e09-4119-82be-5f7b4bd00fc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e634e8408f95484aa40d7428b43744d1'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:43.814662 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ba4ed71a-6e09-4119-82be-5f7b4bd00fc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e634e8408f95484aa40d7428b43744d1'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:43.827696 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ba4ed71a-6e09-4119-82be-5f7b4bd00fc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e634e8408f95484aa40d7428b43744d1'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:43.829199 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:40:43.835773 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1341/2665] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:40:43 2022] DELETE /identity/v3/users/e634e8408f95484aa40d7428b43744d1 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:40:43.840630 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88352d35-87ff-4c5a-a8ac-fc5b70f6d249 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:43.853918 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88352d35-87ff-4c5a-a8ac-fc5b70f6d249 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:43.853918 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88352d35-87ff-4c5a-a8ac-fc5b70f6d249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:43.860207 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-88352d35-87ff-4c5a-a8ac-fc5b70f6d249 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:40:43.861545 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-88352d35-87ff-4c5a-a8ac-fc5b70f6d249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:43.925242 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1325/2666] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:40:43.935745 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ed71a-6e09-4119-82be-5f7b4bd00fc0 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:43.937334 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ba4ed71a-6e09-4119-82be-5f7b4bd00fc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:44.012025 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ed71a-6e09-4119-82be-5f7b4bd00fc0 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:44.016025 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd9ae6-497f-4e98-855c-93bd17083a56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:44.016732 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd9ae6-497f-4e98-855c-93bd17083a56 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:44.017019 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd9ae6-497f-4e98-855c-93bd17083a56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:44.018255 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd9ae6-497f-4e98-855c-93bd17083a56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:44.033163 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd9ae6-497f-4e98-855c-93bd17083a56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:44.034649 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd9ae6-497f-4e98-855c-93bd17083a56 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:44.066462 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1342/2667] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:40:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:40:44.487997 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88352d35-87ff-4c5a-a8ac-fc5b70f6d249 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:44.490747 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-88352d35-87ff-4c5a-a8ac-fc5b70f6d249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:44.501467 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88352d35-87ff-4c5a-a8ac-fc5b70f6d249 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:44.506132 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038f292-da2b-400e-bb1f-3f9cdc7de9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:44.507091 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038f292-da2b-400e-bb1f-3f9cdc7de9a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:44.507408 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038f292-da2b-400e-bb1f-3f9cdc7de9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:44.507717 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038f292-da2b-400e-bb1f-3f9cdc7de9a4 admin admin] PATH_INFO: `/v3/projects/0b3166e898dc4cb585c3ba1231294e6a` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:44.508920 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e038f292-da2b-400e-bb1f-3f9cdc7de9a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b3166e898dc4cb585c3ba1231294e6a)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:44.510829 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e038f292-da2b-400e-bb1f-3f9cdc7de9a4 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:44.608757 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:40:44.623354 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-e038f292-da2b-400e-bb1f-3f9cdc7de9a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b3166e898dc4cb585c3ba1231294e6a', 'request_id': 'req-e038f292-da2b-400e-bb1f-3f9cdc7de9a4'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:44.720784 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-e038f292-da2b-400e-bb1f-3f9cdc7de9a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b3166e898dc4cb585c3ba1231294e6a', 'request_id': 'req-e038f292-da2b-400e-bb1f-3f9cdc7de9a4'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:44.727673 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-e038f292-da2b-400e-bb1f-3f9cdc7de9a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b3166e898dc4cb585c3ba1231294e6a', 'request_id': 'req-e038f292-da2b-400e-bb1f-3f9cdc7de9a4'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:44.738605 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-e038f292-da2b-400e-bb1f-3f9cdc7de9a4 admin admin] The token cache is being invalidate because project 0b3166e898dc4cb585c3ba1231294e6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:40:44.738832 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-e038f292-da2b-400e-bb1f-3f9cdc7de9a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:44.739478 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-e038f292-da2b-400e-bb1f-3f9cdc7de9a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:44.741378 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1326/2668] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:40:44 2022] DELETE /identity/v3/projects/0b3166e898dc4cb585c3ba1231294e6a => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:40:44.746506 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60befb-71ce-4fd2-a1bc-358ff44ce53a None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:44.746995 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60befb-71ce-4fd2-a1bc-358ff44ce53a None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:44.747105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60befb-71ce-4fd2-a1bc-358ff44ce53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:44.764521 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-ec60befb-71ce-4fd2-a1bc-358ff44ce53a None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:40:44.765719 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ec60befb-71ce-4fd2-a1bc-358ff44ce53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:44.828936 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1343/2669] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:40:44.837699 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c5a435-773e-455f-8889-5da5122edcb7 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:44.837995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c5a435-773e-455f-8889-5da5122edcb7 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:44.838283 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c5a435-773e-455f-8889-5da5122edcb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:44.856842 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-89c5a435-773e-455f-8889-5da5122edcb7 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:40:44.858055 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-89c5a435-773e-455f-8889-5da5122edcb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:44.866193 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1327/2670] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:40:44.870433 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60befb-71ce-4fd2-a1bc-358ff44ce53a None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:44.880345 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60befb-71ce-4fd2-a1bc-358ff44ce53a None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:44.887035 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552147ef-79ce-4fa5-8376-03090643c9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:44.887035 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552147ef-79ce-4fa5-8376-03090643c9eb admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:44.887035 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552147ef-79ce-4fa5-8376-03090643c9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:44.887356 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552147ef-79ce-4fa5-8376-03090643c9eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:44.888156 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552147ef-79ce-4fa5-8376-03090643c9eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:40:44.888470 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552147ef-79ce-4fa5-8376-03090643c9eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:44.890287 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552147ef-79ce-4fa5-8376-03090643c9eb admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:44.903176 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1344/2671] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:40:44.907567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c5a435-773e-455f-8889-5da5122edcb7 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:44.917638 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c5a435-773e-455f-8889-5da5122edcb7 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:44.922481 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395709f-8ea5-45bb-bc64-2369b40016b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:44.923136 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395709f-8ea5-45bb-bc64-2369b40016b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:44.923428 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395709f-8ea5-45bb-bc64-2369b40016b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:44.923739 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395709f-8ea5-45bb-bc64-2369b40016b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:44.924431 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d395709f-8ea5-45bb-bc64-2369b40016b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:44.926317 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d395709f-8ea5-45bb-bc64-2369b40016b2 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:45.000770 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1328/2672] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:40:44 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:40:45.004597 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552147ef-79ce-4fa5-8376-03090643c9eb admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:45.016031 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552147ef-79ce-4fa5-8376-03090643c9eb admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:45.076412 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6fb38-b472-46f5-8777-a175bc795c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:45.077088 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6fb38-b472-46f5-8777-a175bc795c82 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:45.077378 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6fb38-b472-46f5-8777-a175bc795c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:45.077662 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6fb38-b472-46f5-8777-a175bc795c82 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:45.078355 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6fb38-b472-46f5-8777-a175bc795c82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:45.080315 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6fb38-b472-46f5-8777-a175bc795c82 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:45.161630 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1345/2673] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:40:45 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:40:45.169497 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395709f-8ea5-45bb-bc64-2369b40016b2 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:45.181581 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395709f-8ea5-45bb-bc64-2369b40016b2 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:45.186343 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef3def0-3ef2-4912-91c2-b65b7652444b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:45.187008 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3def0-3ef2-4912-91c2-b65b7652444b admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:45.187294 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3def0-3ef2-4912-91c2-b65b7652444b admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:45.187605 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3def0-3ef2-4912-91c2-b65b7652444b admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:45.188854 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef3def0-3ef2-4912-91c2-b65b7652444b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:45.190428 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef3def0-3ef2-4912-91c2-b65b7652444b admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:45.205261 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1329/2674] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:40:45.206324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6fb38-b472-46f5-8777-a175bc795c82 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:45.216495 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6fb38-b472-46f5-8777-a175bc795c82 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:45.221199 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcdcfc6-c89e-4063-8093-09c3c562d01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:45.221900 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcdcfc6-c89e-4063-8093-09c3c562d01e admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:45.222165 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcdcfc6-c89e-4063-8093-09c3c562d01e admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:45.222579 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcdcfc6-c89e-4063-8093-09c3c562d01e admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:45.223152 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcdcfc6-c89e-4063-8093-09c3c562d01e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:45.224852 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcdcfc6-c89e-4063-8093-09c3c562d01e admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:45.235908 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1346/2675] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:40:45.240131 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef3def0-3ef2-4912-91c2-b65b7652444b admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:45.251246 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef3def0-3ef2-4912-91c2-b65b7652444b admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:45.256714 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fbe73a-aed2-4c23-a564-72a5706ba2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:45.257609 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbe73a-aed2-4c23-a564-72a5706ba2de admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:45.257919 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbe73a-aed2-4c23-a564-72a5706ba2de admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:45.258197 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbe73a-aed2-4c23-a564-72a5706ba2de admin admin] PATH_INFO: `/v3/projects/fb11b65e90a94804b50e88ad0bce8ae8/users/2b357a9f007242c2b5eeaf70ae972907/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:45.273455 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fbe73a-aed2-4c23-a564-72a5706ba2de admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb11b65e90a94804b50e88ad0bce8ae8, user_id=2b357a9f007242c2b5eeaf70ae972907, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:45.276177 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fbe73a-aed2-4c23-a564-72a5706ba2de admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:45.376577 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1330/2676] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:40:45 2022] PUT /identity/v3/projects/fb11b65e90a94804b50e88ad0bce8ae8/users/2b357a9f007242c2b5eeaf70ae972907/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:40:45.382722 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0491e4-afcc-4e08-b1fe-a429fcd10721 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:45.383013 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0491e4-afcc-4e08-b1fe-a429fcd10721 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:45.383293 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0491e4-afcc-4e08-b1fe-a429fcd10721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:45.396611 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:40:45.402387 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-ad0491e4-afcc-4e08-b1fe-a429fcd10721 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:40:45.403667 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ad0491e4-afcc-4e08-b1fe-a429fcd10721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:45.468681 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1347/2677] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:40:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:40:45.482587 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fbe73a-aed2-4c23-a564-72a5706ba2de admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:45.484373 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-b3fbe73a-aed2-4c23-a564-72a5706ba2de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:45.549079 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fbe73a-aed2-4c23-a564-72a5706ba2de admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:45.552806 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034c5a9-2e95-4cd2-bfd8-0f1b0eadd4c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:45.554009 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034c5a9-2e95-4cd2-bfd8-0f1b0eadd4c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:45.554333 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034c5a9-2e95-4cd2-bfd8-0f1b0eadd4c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:45.554581 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034c5a9-2e95-4cd2-bfd8-0f1b0eadd4c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:45.564012 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034c5a9-2e95-4cd2-bfd8-0f1b0eadd4c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:45.565483 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034c5a9-2e95-4cd2-bfd8-0f1b0eadd4c6 service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:45.576153 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1331/2678] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:40:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:40:46.402116 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0491e4-afcc-4e08-b1fe-a429fcd10721 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:46.404580 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ad0491e4-afcc-4e08-b1fe-a429fcd10721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:46.434633 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0491e4-afcc-4e08-b1fe-a429fcd10721 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:46.440525 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8f97c-3aec-485a-8b92-56628a4509fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:46.441585 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8f97c-3aec-485a-8b92-56628a4509fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:46.441876 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8f97c-3aec-485a-8b92-56628a4509fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:46.442154 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8f97c-3aec-485a-8b92-56628a4509fd admin admin] PATH_INFO: `/v3/users/813fed4b01be4b98b42fb2fa0d8fbc8c` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:46.443495 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8f97c-3aec-485a-8b92-56628a4509fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=813fed4b01be4b98b42fb2fa0d8fbc8c)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:46.445780 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8f97c-3aec-485a-8b92-56628a4509fd admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:46.638658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-76d8f97c-3aec-485a-8b92-56628a4509fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '813fed4b01be4b98b42fb2fa0d8fbc8c'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:46.726533 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-76d8f97c-3aec-485a-8b92-56628a4509fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '813fed4b01be4b98b42fb2fa0d8fbc8c'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:46.727251 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-76d8f97c-3aec-485a-8b92-56628a4509fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '813fed4b01be4b98b42fb2fa0d8fbc8c'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:46.735931 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-76d8f97c-3aec-485a-8b92-56628a4509fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '813fed4b01be4b98b42fb2fa0d8fbc8c'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:46.761042 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-76d8f97c-3aec-485a-8b92-56628a4509fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '813fed4b01be4b98b42fb2fa0d8fbc8c'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:46.769124 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1348/2679] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:40:46 2022] DELETE /identity/v3/users/813fed4b01be4b98b42fb2fa0d8fbc8c => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:40:46.774127 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f085f-115d-4d17-9b20-37753ad05fc1 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:46.774609 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f085f-115d-4d17-9b20-37753ad05fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:46.774715 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f085f-115d-4d17-9b20-37753ad05fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:46.793565 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-c45f085f-115d-4d17-9b20-37753ad05fc1 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:40:46.795375 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-c45f085f-115d-4d17-9b20-37753ad05fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:46.870633 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:40:46.892620 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1332/2680] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:40:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:40:46.902785 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8f97c-3aec-485a-8b92-56628a4509fd admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:46.905219 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-76d8f97c-3aec-485a-8b92-56628a4509fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:46.973632 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8f97c-3aec-485a-8b92-56628a4509fd admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:46.977995 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396974c-29fb-4fe3-8cc4-353885fef3bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:46.978688 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396974c-29fb-4fe3-8cc4-353885fef3bf service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:46.978973 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396974c-29fb-4fe3-8cc4-353885fef3bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:46.979253 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396974c-29fb-4fe3-8cc4-353885fef3bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:46.989501 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396974c-29fb-4fe3-8cc4-353885fef3bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:46.991833 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396974c-29fb-4fe3-8cc4-353885fef3bf service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:47.010176 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1349/2681] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:40:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:40:47.472042 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f085f-115d-4d17-9b20-37753ad05fc1 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:47.473482 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-c45f085f-115d-4d17-9b20-37753ad05fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:47.490934 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f085f-115d-4d17-9b20-37753ad05fc1 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:47.497821 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e358e493-ffb4-45dd-b2d6-3cf7141d4b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:47.499013 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358e493-ffb4-45dd-b2d6-3cf7141d4b93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:47.499939 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358e493-ffb4-45dd-b2d6-3cf7141d4b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:47.500310 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358e493-ffb4-45dd-b2d6-3cf7141d4b93 admin admin] PATH_INFO: `/v3/projects/7cea4ac9b873469298be141a015b7253` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:47.501586 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e358e493-ffb4-45dd-b2d6-3cf7141d4b93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cea4ac9b873469298be141a015b7253)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:47.503528 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e358e493-ffb4-45dd-b2d6-3cf7141d4b93 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:47.692486 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-e358e493-ffb4-45dd-b2d6-3cf7141d4b93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cea4ac9b873469298be141a015b7253', 'request_id': 'req-e358e493-ffb4-45dd-b2d6-3cf7141d4b93'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:47.766194 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-e358e493-ffb4-45dd-b2d6-3cf7141d4b93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cea4ac9b873469298be141a015b7253', 'request_id': 'req-e358e493-ffb4-45dd-b2d6-3cf7141d4b93'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:47.773315 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-e358e493-ffb4-45dd-b2d6-3cf7141d4b93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cea4ac9b873469298be141a015b7253', 'request_id': 'req-e358e493-ffb4-45dd-b2d6-3cf7141d4b93'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:47.785431 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-e358e493-ffb4-45dd-b2d6-3cf7141d4b93 admin admin] The token cache is being invalidate because project 7cea4ac9b873469298be141a015b7253 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:40:47.786416 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-e358e493-ffb4-45dd-b2d6-3cf7141d4b93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:47.787736 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-e358e493-ffb4-45dd-b2d6-3cf7141d4b93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:47.789609 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1333/2682] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:40:47 2022] DELETE /identity/v3/projects/7cea4ac9b873469298be141a015b7253 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:40:47.794806 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396974c-29fb-4fe3-8cc4-353885fef3bf service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:47.804162 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396974c-29fb-4fe3-8cc4-353885fef3bf service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:47.825940 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:40:47.868466 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc381d90-1c87-4f52-adff-f5c9486cae50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:47.869412 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc381d90-1c87-4f52-adff-f5c9486cae50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:47.869730 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc381d90-1c87-4f52-adff-f5c9486cae50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:47.870020 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc381d90-1c87-4f52-adff-f5c9486cae50 admin admin] PATH_INFO: `/v3/users/1bb2e170042649aaa04844f974a9fa3f` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:47.871338 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc381d90-1c87-4f52-adff-f5c9486cae50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bb2e170042649aaa04844f974a9fa3f)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:47.874979 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc381d90-1c87-4f52-adff-f5c9486cae50 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:48.088816 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-bc381d90-1c87-4f52-adff-f5c9486cae50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bb2e170042649aaa04844f974a9fa3f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:48.189476 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-bc381d90-1c87-4f52-adff-f5c9486cae50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bb2e170042649aaa04844f974a9fa3f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:48.190156 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-bc381d90-1c87-4f52-adff-f5c9486cae50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bb2e170042649aaa04844f974a9fa3f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:48.199744 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-bc381d90-1c87-4f52-adff-f5c9486cae50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bb2e170042649aaa04844f974a9fa3f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:48.214158 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-bc381d90-1c87-4f52-adff-f5c9486cae50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bb2e170042649aaa04844f974a9fa3f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:48.221304 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1350/2683] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:40:47 2022] DELETE /identity/v3/users/1bb2e170042649aaa04844f974a9fa3f => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:40:49.098285 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e358e493-ffb4-45dd-b2d6-3cf7141d4b93 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:49.100039 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-e358e493-ffb4-45dd-b2d6-3cf7141d4b93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:49.114058 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e358e493-ffb4-45dd-b2d6-3cf7141d4b93 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:49.198656 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b2efa-3f3c-46f2-ab9c-81367e3b0534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:49.199709 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b2efa-3f3c-46f2-ab9c-81367e3b0534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:49.200079 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b2efa-3f3c-46f2-ab9c-81367e3b0534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:49.200473 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b2efa-3f3c-46f2-ab9c-81367e3b0534 admin admin] PATH_INFO: `/v3/projects/da0dde5843974d5fbf58a5096f65c159` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:49.204058 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323b2efa-3f3c-46f2-ab9c-81367e3b0534 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da0dde5843974d5fbf58a5096f65c159)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:49.207815 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323b2efa-3f3c-46f2-ab9c-81367e3b0534 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:49.333705 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-323b2efa-3f3c-46f2-ab9c-81367e3b0534 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da0dde5843974d5fbf58a5096f65c159', 'request_id': 'req-323b2efa-3f3c-46f2-ab9c-81367e3b0534'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:49.406295 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-323b2efa-3f3c-46f2-ab9c-81367e3b0534 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da0dde5843974d5fbf58a5096f65c159', 'request_id': 'req-323b2efa-3f3c-46f2-ab9c-81367e3b0534'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:49.416527 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-323b2efa-3f3c-46f2-ab9c-81367e3b0534 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da0dde5843974d5fbf58a5096f65c159', 'request_id': 'req-323b2efa-3f3c-46f2-ab9c-81367e3b0534'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:49.446672 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-323b2efa-3f3c-46f2-ab9c-81367e3b0534 admin admin] The token cache is being invalidate because project da0dde5843974d5fbf58a5096f65c159 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:40:49.446968 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-323b2efa-3f3c-46f2-ab9c-81367e3b0534 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:49.447628 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-323b2efa-3f3c-46f2-ab9c-81367e3b0534 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:49.449649 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1334/2684] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:40:49 2022] DELETE /identity/v3/projects/da0dde5843974d5fbf58a5096f65c159 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:40:49.454284 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93a3f9-bcbf-4e19-ba88-116bb784eb10 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:49.454857 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93a3f9-bcbf-4e19-ba88-116bb784eb10 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:49.455131 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93a3f9-bcbf-4e19-ba88-116bb784eb10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:49.476092 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-5e93a3f9-bcbf-4e19-ba88-116bb784eb10 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:40:49.477543 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-5e93a3f9-bcbf-4e19-ba88-116bb784eb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:49.550558 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1351/2685] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:40:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:40:49.559722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4261101-c6fd-4576-b5e3-efdb4c667f5f None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:49.560593 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4261101-c6fd-4576-b5e3-efdb4c667f5f None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:49.561137 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4261101-c6fd-4576-b5e3-efdb4c667f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:49.582917 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-a4261101-c6fd-4576-b5e3-efdb4c667f5f None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:40:49.584690 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-a4261101-c6fd-4576-b5e3-efdb4c667f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:49.593863 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1335/2686] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:40:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:40:49.598160 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93a3f9-bcbf-4e19-ba88-116bb784eb10 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:49.609959 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93a3f9-bcbf-4e19-ba88-116bb784eb10 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:49.616370 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4161a1-1e1d-42f1-8741-ecb3f0584306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:49.617470 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4161a1-1e1d-42f1-8741-ecb3f0584306 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:49.617968 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4161a1-1e1d-42f1-8741-ecb3f0584306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:49.618540 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4161a1-1e1d-42f1-8741-ecb3f0584306 admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:49.619530 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4161a1-1e1d-42f1-8741-ecb3f0584306 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:40:49.620071 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4161a1-1e1d-42f1-8741-ecb3f0584306 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:49.621933 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4161a1-1e1d-42f1-8741-ecb3f0584306 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:49.638503 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1352/2687] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:40:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 19:40:49.641588 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4261101-c6fd-4576-b5e3-efdb4c667f5f None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:49.653132 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:40:49.658947 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4261101-c6fd-4576-b5e3-efdb4c667f5f None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:49.664344 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6ccdf-d107-493a-85ba-91373a5e23de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:49.666406 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6ccdf-d107-493a-85ba-91373a5e23de admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:49.666406 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6ccdf-d107-493a-85ba-91373a5e23de admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:49.666406 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6ccdf-d107-493a-85ba-91373a5e23de admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:49.666406 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa6ccdf-d107-493a-85ba-91373a5e23de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:49.668303 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa6ccdf-d107-493a-85ba-91373a5e23de admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:49.748464 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1336/2688] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:40:49 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:40:49.749694 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4161a1-1e1d-42f1-8741-ecb3f0584306 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:49.764593 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4161a1-1e1d-42f1-8741-ecb3f0584306 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:49.793756 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:40:49.825318 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a096cf1-6300-4335-add5-4ed815687dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:49.826020 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a096cf1-6300-4335-add5-4ed815687dfa admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:49.826303 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a096cf1-6300-4335-add5-4ed815687dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:49.826577 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a096cf1-6300-4335-add5-4ed815687dfa admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:49.827265 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a096cf1-6300-4335-add5-4ed815687dfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:49.829464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a096cf1-6300-4335-add5-4ed815687dfa admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:49.900746 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1353/2689] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:40:49 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:40:49.902041 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6ccdf-d107-493a-85ba-91373a5e23de admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:49.913985 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6ccdf-d107-493a-85ba-91373a5e23de admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:49.918968 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a1927-284b-459e-805c-3cefd9da4b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:49.921052 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a1927-284b-459e-805c-3cefd9da4b11 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:49.921052 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a1927-284b-459e-805c-3cefd9da4b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:49.921052 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a1927-284b-459e-805c-3cefd9da4b11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:49.921347 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a1927-284b-459e-805c-3cefd9da4b11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:49.922807 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a1927-284b-459e-805c-3cefd9da4b11 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:49.934069 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1337/2690] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:40:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:40:49.937780 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a096cf1-6300-4335-add5-4ed815687dfa admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:49.949830 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a096cf1-6300-4335-add5-4ed815687dfa admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:49.955550 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5b7bd-24fc-4457-83e8-7e6bcbb1a7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:49.955771 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5b7bd-24fc-4457-83e8-7e6bcbb1a7c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:49.956130 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5b7bd-24fc-4457-83e8-7e6bcbb1a7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:49.956476 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5b7bd-24fc-4457-83e8-7e6bcbb1a7c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:49.957268 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5b7bd-24fc-4457-83e8-7e6bcbb1a7c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:49.959020 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5b7bd-24fc-4457-83e8-7e6bcbb1a7c9 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:49.970403 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1354/2691] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:40:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 19:40:49.974802 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a1927-284b-459e-805c-3cefd9da4b11 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:49.986170 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a1927-284b-459e-805c-3cefd9da4b11 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:49.992476 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccbd6e9-0453-47e0-af5e-b5db37f2cb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:49.993479 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccbd6e9-0453-47e0-af5e-b5db37f2cb7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:49.993898 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccbd6e9-0453-47e0-af5e-b5db37f2cb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:49.994189 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccbd6e9-0453-47e0-af5e-b5db37f2cb7c admin admin] PATH_INFO: `/v3/projects/8ff6612360a74f7cb54f9d1fdf45f82c/users/0c23fe5498d14e60b8e18c7d28fb0876/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:50.011052 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccbd6e9-0453-47e0-af5e-b5db37f2cb7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ff6612360a74f7cb54f9d1fdf45f82c, user_id=0c23fe5498d14e60b8e18c7d28fb0876, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:50.014822 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccbd6e9-0453-47e0-af5e-b5db37f2cb7c admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:50.099780 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1338/2692] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:40:49 2022] PUT /identity/v3/projects/8ff6612360a74f7cb54f9d1fdf45f82c/users/0c23fe5498d14e60b8e18c7d28fb0876/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:40:50.111123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb30376-98c0-45f7-b3c8-5c8c22c5165a None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:50.111415 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb30376-98c0-45f7-b3c8-5c8c22c5165a None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:50.111764 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb30376-98c0-45f7-b3c8-5c8c22c5165a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:50.143219 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-ceb30376-98c0-45f7-b3c8-5c8c22c5165a None None] MFA Rules not processed for user `0c23fe5498d14e60b8e18c7d28fb0876`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:40:50.144593 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ceb30376-98c0-45f7-b3c8-5c8c22c5165a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:50.218178 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1355/2693] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:40:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:40:50.222648 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccbd6e9-0453-47e0-af5e-b5db37f2cb7c admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:50.293392 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccbd6e9-0453-47e0-af5e-b5db37f2cb7c admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:50.300648 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a14e68-5ae5-465c-af36-6dda35e09919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:50.301513 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a14e68-5ae5-465c-af36-6dda35e09919 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:50.302006 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a14e68-5ae5-465c-af36-6dda35e09919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:50.303703 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a14e68-5ae5-465c-af36-6dda35e09919 admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:50.304609 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a14e68-5ae5-465c-af36-6dda35e09919 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:50.307167 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a14e68-5ae5-465c-af36-6dda35e09919 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:50.425304 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1339/2694] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:40:50 2022] POST /identity/v3/projects => generated 379 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:40:50.426341 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb30376-98c0-45f7-b3c8-5c8c22c5165a None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:50.438453 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb30376-98c0-45f7-b3c8-5c8c22c5165a None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:50.498756 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e15206-58df-4de5-a3d6-580180d4ffb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:50.499509 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e15206-58df-4de5-a3d6-580180d4ffb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:50.499708 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e15206-58df-4de5-a3d6-580180d4ffb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:50.500103 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e15206-58df-4de5-a3d6-580180d4ffb0 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:50.500808 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e15206-58df-4de5-a3d6-580180d4ffb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:50.502724 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e15206-58df-4de5-a3d6-580180d4ffb0 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:50.589304 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1356/2695] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:40:50 2022] POST /identity/v3/users => generated 296 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 19:40:50.593186 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a14e68-5ae5-465c-af36-6dda35e09919 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:50.604163 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a14e68-5ae5-465c-af36-6dda35e09919 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:50.609734 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562259e-9aa9-4aef-8149-a4c0d9464a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:50.614171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562259e-9aa9-4aef-8149-a4c0d9464a7c admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:50.614171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562259e-9aa9-4aef-8149-a4c0d9464a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:50.614171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562259e-9aa9-4aef-8149-a4c0d9464a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:50.614171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0562259e-9aa9-4aef-8149-a4c0d9464a7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:50.614171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0562259e-9aa9-4aef-8149-a4c0d9464a7c admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:50.630440 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e15206-58df-4de5-a3d6-580180d4ffb0 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:50.631591 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1340/2696] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:40:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:40:50.641448 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e15206-58df-4de5-a3d6-580180d4ffb0 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:50.646235 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399a029-7ca9-45e5-bdd1-1489a0daab7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:50.647169 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399a029-7ca9-45e5-bdd1-1489a0daab7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:50.647494 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399a029-7ca9-45e5-bdd1-1489a0daab7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:50.647778 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399a029-7ca9-45e5-bdd1-1489a0daab7f admin admin] PATH_INFO: `/v3/projects/72be1b99e5c74479ba71eba9a241e758/users/5ae2946e7e1f4f20b088616b0506799d/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:50.670589 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399a029-7ca9-45e5-bdd1-1489a0daab7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=72be1b99e5c74479ba71eba9a241e758, user_id=5ae2946e7e1f4f20b088616b0506799d, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:50.673700 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399a029-7ca9-45e5-bdd1-1489a0daab7f admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:50.760282 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1357/2697] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:40:50 2022] PUT /identity/v3/projects/72be1b99e5c74479ba71eba9a241e758/users/5ae2946e7e1f4f20b088616b0506799d/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:40:50.764235 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562259e-9aa9-4aef-8149-a4c0d9464a7c admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:50.774383 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562259e-9aa9-4aef-8149-a4c0d9464a7c admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:50.845049 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9eb9f-1736-4ff6-ae38-66a5a8212b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:50.845967 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9eb9f-1736-4ff6-ae38-66a5a8212b22 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:50.846443 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9eb9f-1736-4ff6-ae38-66a5a8212b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:50.847321 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9eb9f-1736-4ff6-ae38-66a5a8212b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:50.848278 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9eb9f-1736-4ff6-ae38-66a5a8212b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:50.851610 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9eb9f-1736-4ff6-ae38-66a5a8212b22 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:50.864115 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1341/2698] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:40:50 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:40:50.868789 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399a029-7ca9-45e5-bdd1-1489a0daab7f admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:50.875645 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:40:50.882594 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399a029-7ca9-45e5-bdd1-1489a0daab7f admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:50.887852 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61039a9-ddbe-4fd9-ab36-a6a0599301a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:50.888875 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61039a9-ddbe-4fd9-ab36-a6a0599301a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:50.889166 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61039a9-ddbe-4fd9-ab36-a6a0599301a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:50.889445 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61039a9-ddbe-4fd9-ab36-a6a0599301a9 admin admin] PATH_INFO: `/v3/projects/72be1b99e5c74479ba71eba9a241e758/users/5ae2946e7e1f4f20b088616b0506799d/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:50.891917 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61039a9-ddbe-4fd9-ab36-a6a0599301a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72be1b99e5c74479ba71eba9a241e758, user_id=5ae2946e7e1f4f20b088616b0506799d, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:50.894596 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61039a9-ddbe-4fd9-ab36-a6a0599301a9 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:50.906565 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1358/2699] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:40:50 2022] PUT /identity/v3/projects/72be1b99e5c74479ba71eba9a241e758/users/5ae2946e7e1f4f20b088616b0506799d/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:40:50.917595 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1d61c-5e7b-493e-a61c-bcbd5f616244 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:50.917943 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1d61c-5e7b-493e-a61c-bcbd5f616244 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:50.918230 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1d61c-5e7b-493e-a61c-bcbd5f616244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:50.945359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-d7f1d61c-5e7b-493e-a61c-bcbd5f616244 None None] MFA Rules not processed for user `5ae2946e7e1f4f20b088616b0506799d`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:40:50.946602 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-d7f1d61c-5e7b-493e-a61c-bcbd5f616244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:50.950540 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:40:51.033492 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1342/2700] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:40:50 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:40:51.048518 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61039a9-ddbe-4fd9-ab36-a6a0599301a9 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:51.050032 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-a61039a9-ddbe-4fd9-ab36-a6a0599301a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:51.143658 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61039a9-ddbe-4fd9-ab36-a6a0599301a9 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:51.149386 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384b329-057a-47e0-a4ad-eb95280796f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:51.150206 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384b329-057a-47e0-a4ad-eb95280796f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:51.150589 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384b329-057a-47e0-a4ad-eb95280796f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:51.150987 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384b329-057a-47e0-a4ad-eb95280796f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:51.230772 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e384b329-057a-47e0-a4ad-eb95280796f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:51.232320 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e384b329-057a-47e0-a4ad-eb95280796f9 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:51.242235 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1359/2701] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:40:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:40:52.271835 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6082e-12a1-431a-9592-442768990dc5 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:52.272375 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6082e-12a1-431a-9592-442768990dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:52.272576 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6082e-12a1-431a-9592-442768990dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:52.300770 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-10d6082e-12a1-431a-9592-442768990dc5 None None] MFA Rules not processed for user `2b357a9f007242c2b5eeaf70ae972907`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:40:52.301910 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-10d6082e-12a1-431a-9592-442768990dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:52.372914 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1343/2702] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:40:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:40:52.377398 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384b329-057a-47e0-a4ad-eb95280796f9 service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:52.378936 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-e384b329-057a-47e0-a4ad-eb95280796f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:52.445986 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384b329-057a-47e0-a4ad-eb95280796f9 service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:52.450514 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf666b-a6cd-44a2-9b07-f8d77f610c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:52.451195 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf666b-a6cd-44a2-9b07-f8d77f610c42 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:52.451511 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf666b-a6cd-44a2-9b07-f8d77f610c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:52.451803 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf666b-a6cd-44a2-9b07-f8d77f610c42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:52.452510 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf666b-a6cd-44a2-9b07-f8d77f610c42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:52.454378 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf666b-a6cd-44a2-9b07-f8d77f610c42 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:52.530877 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1360/2703] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:40:52 2022] POST /identity/v3/projects => generated 383 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:40:52.534995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6082e-12a1-431a-9592-442768990dc5 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:52.546349 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6082e-12a1-431a-9592-442768990dc5 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:52.605621 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6cb83-9ae6-4957-8b3d-ae19b150564d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:52.606302 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6cb83-9ae6-4957-8b3d-ae19b150564d admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:52.606590 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6cb83-9ae6-4957-8b3d-ae19b150564d admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:52.606928 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6cb83-9ae6-4957-8b3d-ae19b150564d admin admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:52.607678 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6cb83-9ae6-4957-8b3d-ae19b150564d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:52.609588 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6cb83-9ae6-4957-8b3d-ae19b150564d admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:52.702892 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1344/2704] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:40:52 2022] POST /identity/v3/users => generated 298 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:40:52.706898 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf666b-a6cd-44a2-9b07-f8d77f610c42 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:52.718534 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf666b-a6cd-44a2-9b07-f8d77f610c42 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:52.723124 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76db6f-603d-4da6-a192-eaff09b13a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:52.723877 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76db6f-603d-4da6-a192-eaff09b13a81 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:52.725948 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76db6f-603d-4da6-a192-eaff09b13a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:52.725948 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76db6f-603d-4da6-a192-eaff09b13a81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:52.725948 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b76db6f-603d-4da6-a192-eaff09b13a81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:52.727724 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b76db6f-603d-4da6-a192-eaff09b13a81 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:52.739560 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1361/2705] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:40:52.743650 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6cb83-9ae6-4957-8b3d-ae19b150564d admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:52.754177 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6cb83-9ae6-4957-8b3d-ae19b150564d admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:52.758950 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5a8b3-7a94-4ffb-81ec-c8e3d13f0387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:52.759927 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5a8b3-7a94-4ffb-81ec-c8e3d13f0387 admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:52.760210 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5a8b3-7a94-4ffb-81ec-c8e3d13f0387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:52.760552 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5a8b3-7a94-4ffb-81ec-c8e3d13f0387 admin admin] PATH_INFO: `/v3/projects/f53956d4dce5484289008579f34652fc/users/bfc2ad8dd5e34343b488483469ba7d96/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:52.779346 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c5a8b3-7a94-4ffb-81ec-c8e3d13f0387 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f53956d4dce5484289008579f34652fc, user_id=bfc2ad8dd5e34343b488483469ba7d96, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:52.782171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c5a8b3-7a94-4ffb-81ec-c8e3d13f0387 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:52.785813 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:40:52.862408 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1345/2706] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:40:52 2022] PUT /identity/v3/projects/f53956d4dce5484289008579f34652fc/users/bfc2ad8dd5e34343b488483469ba7d96/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:40:52.866639 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76db6f-603d-4da6-a192-eaff09b13a81 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:52.876956 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76db6f-603d-4da6-a192-eaff09b13a81 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:52.890307 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:40:52.937950 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8dc6b-82ef-4b76-bebd-a0f6a950950a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:52.938618 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8dc6b-82ef-4b76-bebd-a0f6a950950a admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:52.938904 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8dc6b-82ef-4b76-bebd-a0f6a950950a admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:52.939176 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8dc6b-82ef-4b76-bebd-a0f6a950950a admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:52.939977 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8dc6b-82ef-4b76-bebd-a0f6a950950a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:52.941702 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8dc6b-82ef-4b76-bebd-a0f6a950950a admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:52.952291 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1362/2707] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 19:40:52.956500 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5a8b3-7a94-4ffb-81ec-c8e3d13f0387 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:52.968009 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5a8b3-7a94-4ffb-81ec-c8e3d13f0387 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:52.972699 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b1fea-488e-482c-bf69-7620649982d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:52.973580 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b1fea-488e-482c-bf69-7620649982d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:52.973870 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b1fea-488e-482c-bf69-7620649982d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:52.974151 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b1fea-488e-482c-bf69-7620649982d3 admin admin] PATH_INFO: `/v3/projects/f53956d4dce5484289008579f34652fc/users/bfc2ad8dd5e34343b488483469ba7d96/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:52.976794 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b1fea-488e-482c-bf69-7620649982d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f53956d4dce5484289008579f34652fc, user_id=bfc2ad8dd5e34343b488483469ba7d96, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:52.979399 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b1fea-488e-482c-bf69-7620649982d3 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:52.990231 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1346/2708] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:40:52 2022] PUT /identity/v3/projects/f53956d4dce5484289008579f34652fc/users/bfc2ad8dd5e34343b488483469ba7d96/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:40:53.042328 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8dc6b-82ef-4b76-bebd-a0f6a950950a admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:53.044964 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-acb8dc6b-82ef-4b76-bebd-a0f6a950950a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:53.119168 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8dc6b-82ef-4b76-bebd-a0f6a950950a admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:53.192071 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c31a1-64a6-4c8a-9d39-43be80761797 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:53.193086 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c31a1-64a6-4c8a-9d39-43be80761797 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:53.193392 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c31a1-64a6-4c8a-9d39-43be80761797 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:53.193678 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c31a1-64a6-4c8a-9d39-43be80761797 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:53.270337 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0c31a1-64a6-4c8a-9d39-43be80761797 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:53.272556 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0c31a1-64a6-4c8a-9d39-43be80761797 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:53.282763 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1363/2709] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:40:53 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:40:57.877764 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b1fea-488e-482c-bf69-7620649982d3 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:57.953691 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b1fea-488e-482c-bf69-7620649982d3 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:57.958381 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b7d61-8bfe-4713-b359-479abfc7fb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:57.959485 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b7d61-8bfe-4713-b359-479abfc7fb66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:57.959781 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b7d61-8bfe-4713-b359-479abfc7fb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:57.962486 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b7d61-8bfe-4713-b359-479abfc7fb66 admin admin] PATH_INFO: `/v3/users/0c23fe5498d14e60b8e18c7d28fb0876` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:57.962486 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b7d61-8bfe-4713-b359-479abfc7fb66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c23fe5498d14e60b8e18c7d28fb0876)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:57.963193 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b7d61-8bfe-4713-b359-479abfc7fb66 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:58.191041 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-a00b7d61-8bfe-4713-b359-479abfc7fb66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c23fe5498d14e60b8e18c7d28fb0876'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:58.274165 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-a00b7d61-8bfe-4713-b359-479abfc7fb66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c23fe5498d14e60b8e18c7d28fb0876'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:58.288577 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-a00b7d61-8bfe-4713-b359-479abfc7fb66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c23fe5498d14e60b8e18c7d28fb0876'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:58.289304 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-a00b7d61-8bfe-4713-b359-479abfc7fb66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c23fe5498d14e60b8e18c7d28fb0876'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:58.296673 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-a00b7d61-8bfe-4713-b359-479abfc7fb66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c23fe5498d14e60b8e18c7d28fb0876'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:58.307906 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1347/2710] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:40:57 2022] DELETE /identity/v3/users/0c23fe5498d14e60b8e18c7d28fb0876 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:40:58.309453 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df7507-8e19-477d-ab03-0ea66326d448 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:58.309932 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df7507-8e19-477d-ab03-0ea66326d448 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:58.310040 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df7507-8e19-477d-ab03-0ea66326d448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:58.329983 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-08df7507-8e19-477d-ab03-0ea66326d448 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:40:58.330354 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-08df7507-8e19-477d-ab03-0ea66326d448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:58.345016 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:40:58.406706 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1364/2711] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:40:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:40:58.418368 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b7d61-8bfe-4713-b359-479abfc7fb66 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:58.434416 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-a00b7d61-8bfe-4713-b359-479abfc7fb66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:58.505434 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b7d61-8bfe-4713-b359-479abfc7fb66 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:58.509312 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c2e99-fa62-4d21-8e39-cce2767bfc9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:58.510067 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c2e99-fa62-4d21-8e39-cce2767bfc9a service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:58.510428 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c2e99-fa62-4d21-8e39-cce2767bfc9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:58.510775 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c2e99-fa62-4d21-8e39-cce2767bfc9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:58.538941 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c2e99-fa62-4d21-8e39-cce2767bfc9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:58.540566 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c2e99-fa62-4d21-8e39-cce2767bfc9a service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:58.554844 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1348/2712] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:40:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:40:58.767573 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db798faa-b66e-498c-b1cc-f22d8326f557 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:58.767573 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db798faa-b66e-498c-b1cc-f22d8326f557 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:58.767573 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db798faa-b66e-498c-b1cc-f22d8326f557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:58.809837 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-db798faa-b66e-498c-b1cc-f22d8326f557 None None] MFA Rules not processed for user `bfc2ad8dd5e34343b488483469ba7d96`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:40:58.811080 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-db798faa-b66e-498c-b1cc-f22d8326f557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:58.910000 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1365/2713] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:40:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:40:58.923944 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c2e99-fa62-4d21-8e39-cce2767bfc9a service neutron] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:58.926647 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-c91c2e99-fa62-4d21-8e39-cce2767bfc9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:58.937432 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:40:58.996569 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c2e99-fa62-4d21-8e39-cce2767bfc9a service neutron] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:59.000280 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7695f98f-e05d-4568-83b5-9e2a212fe28f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a23a8e608f94d5d8153dcf7e79250f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:59.000944 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695f98f-e05d-4568-83b5-9e2a212fe28f service glance] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:59.001286 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695f98f-e05d-4568-83b5-9e2a212fe28f service glance] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:59.001571 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695f98f-e05d-4568-83b5-9e2a212fe28f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:59.003386 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-7695f98f-e05d-4568-83b5-9e2a212fe28f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:59.068754 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7695f98f-e05d-4568-83b5-9e2a212fe28f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:59.070464 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7695f98f-e05d-4568-83b5-9e2a212fe28f service glance] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:59.081776 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1349/2714] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:40:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:40:59.092150 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db798faa-b66e-498c-b1cc-f22d8326f557 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:59.094013 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-db798faa-b66e-498c-b1cc-f22d8326f557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:59.110153 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db798faa-b66e-498c-b1cc-f22d8326f557 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:59.115557 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649fcfe-7d97-495d-8b93-80092d450898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:59.116442 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649fcfe-7d97-495d-8b93-80092d450898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:59.116729 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649fcfe-7d97-495d-8b93-80092d450898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:59.119200 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649fcfe-7d97-495d-8b93-80092d450898 admin admin] PATH_INFO: `/v3/projects/8ff6612360a74f7cb54f9d1fdf45f82c` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:59.119200 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649fcfe-7d97-495d-8b93-80092d450898 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ff6612360a74f7cb54f9d1fdf45f82c)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:59.120240 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649fcfe-7d97-495d-8b93-80092d450898 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:59.271969 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c649fcfe-7d97-495d-8b93-80092d450898 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ff6612360a74f7cb54f9d1fdf45f82c', 'request_id': 'req-c649fcfe-7d97-495d-8b93-80092d450898'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:59.282924 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c649fcfe-7d97-495d-8b93-80092d450898 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ff6612360a74f7cb54f9d1fdf45f82c', 'request_id': 'req-c649fcfe-7d97-495d-8b93-80092d450898'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:59.313190 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd5814-ae5e-4af0-a59a-a6599d0af2dd None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:59.313674 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd5814-ae5e-4af0-a59a-a6599d0af2dd None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:59.314128 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd5814-ae5e-4af0-a59a-a6599d0af2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:59.336768 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-58cd5814-ae5e-4af0-a59a-a6599d0af2dd None None] MFA Rules not processed for user `22d11b8e390e4b9db3b84c419266c4b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:40:59.337991 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-58cd5814-ae5e-4af0-a59a-a6599d0af2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:59.342844 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c649fcfe-7d97-495d-8b93-80092d450898 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ff6612360a74f7cb54f9d1fdf45f82c', 'request_id': 'req-c649fcfe-7d97-495d-8b93-80092d450898'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:59.357358 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c649fcfe-7d97-495d-8b93-80092d450898 admin admin] The token cache is being invalidate because project 8ff6612360a74f7cb54f9d1fdf45f82c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:40:59.357922 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c649fcfe-7d97-495d-8b93-80092d450898 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:59.358822 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c649fcfe-7d97-495d-8b93-80092d450898 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:59.360985 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1366/2715] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:40:59 2022] DELETE /identity/v3/projects/8ff6612360a74f7cb54f9d1fdf45f82c => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:40:59.365422 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649fcfe-7d97-495d-8b93-80092d450898 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:59.366902 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-c649fcfe-7d97-495d-8b93-80092d450898 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:59.404512 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:40:59.419609 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1350/2716] 10.222.0.60 () {58 vars in 1009 bytes} [Thu Jul 21 19:40:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:40:59.457800 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649fcfe-7d97-495d-8b93-80092d450898 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:59.464750 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9bd73e-fb1c-490a-bce8-b265e5526e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:59.465659 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bd73e-fb1c-490a-bce8-b265e5526e72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:59.466116 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bd73e-fb1c-490a-bce8-b265e5526e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:59.466408 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bd73e-fb1c-490a-bce8-b265e5526e72 admin admin] PATH_INFO: `/v3/users/5ae2946e7e1f4f20b088616b0506799d` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:59.467714 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9bd73e-fb1c-490a-bce8-b265e5526e72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ae2946e7e1f4f20b088616b0506799d)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:59.469750 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9bd73e-fb1c-490a-bce8-b265e5526e72 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:59.610631 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd5814-ae5e-4af0-a59a-a6599d0af2dd None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:40:59.612058 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-58cd5814-ae5e-4af0-a59a-a6599d0af2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:40:59.680161 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd5814-ae5e-4af0-a59a-a6599d0af2dd None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:40:59.685324 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6ef6c-f4e4-4018-ab24-baedfd8e24a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa579af53a6441a9205cf82864a640e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:40:59.685893 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6ef6c-f4e4-4018-ab24-baedfd8e24a9 service swift] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:40:59.686173 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6ef6c-f4e4-4018-ab24-baedfd8e24a9 service swift] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:40:59.686452 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6ef6c-f4e4-4018-ab24-baedfd8e24a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:40:59.691516 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:40:59.694777 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ba9bd73e-fb1c-490a-bce8-b265e5526e72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ae2946e7e1f4f20b088616b0506799d'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:59.695317 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6ef6c-f4e4-4018-ab24-baedfd8e24a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:40:59.696929 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6ef6c-f4e4-4018-ab24-baedfd8e24a9 service swift] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:40:59.705546 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1351/2717] 10.222.0.60 () {60 vars in 1384 bytes} [Thu Jul 21 19:40:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 19:40:59.777851 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ba9bd73e-fb1c-490a-bce8-b265e5526e72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ae2946e7e1f4f20b088616b0506799d'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:59.778937 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ba9bd73e-fb1c-490a-bce8-b265e5526e72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ae2946e7e1f4f20b088616b0506799d'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:59.791271 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ba9bd73e-fb1c-490a-bce8-b265e5526e72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ae2946e7e1f4f20b088616b0506799d'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:59.807573 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ba9bd73e-fb1c-490a-bce8-b265e5526e72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ae2946e7e1f4f20b088616b0506799d'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:40:59.824781 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1367/2718] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:40:59 2022] DELETE /identity/v3/users/5ae2946e7e1f4f20b088616b0506799d => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:41:00.416619 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6ef6c-f4e4-4018-ab24-baedfd8e24a9 service swift] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:41:00.430676 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6ef6c-f4e4-4018-ab24-baedfd8e24a9 service swift] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:41:00.539268 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b0e55-7904-4a43-bd3d-76e433537cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:41:00.543815 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b0e55-7904-4a43-bd3d-76e433537cb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:41:00.544386 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b0e55-7904-4a43-bd3d-76e433537cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:41:00.544777 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b0e55-7904-4a43-bd3d-76e433537cb6 admin admin] PATH_INFO: `/v3/projects/72be1b99e5c74479ba71eba9a241e758` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:41:00.546329 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367b0e55-7904-4a43-bd3d-76e433537cb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72be1b99e5c74479ba71eba9a241e758)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:41:00.548931 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367b0e55-7904-4a43-bd3d-76e433537cb6 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:41:00.691243 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-367b0e55-7904-4a43-bd3d-76e433537cb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72be1b99e5c74479ba71eba9a241e758', 'request_id': 'req-367b0e55-7904-4a43-bd3d-76e433537cb6'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:41:00.772278 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-367b0e55-7904-4a43-bd3d-76e433537cb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72be1b99e5c74479ba71eba9a241e758', 'request_id': 'req-367b0e55-7904-4a43-bd3d-76e433537cb6'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:41:00.779032 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-367b0e55-7904-4a43-bd3d-76e433537cb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72be1b99e5c74479ba71eba9a241e758', 'request_id': 'req-367b0e55-7904-4a43-bd3d-76e433537cb6'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:41:00.807120 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-367b0e55-7904-4a43-bd3d-76e433537cb6 admin admin] The token cache is being invalidate because project 72be1b99e5c74479ba71eba9a241e758 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:41:00.807418 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-367b0e55-7904-4a43-bd3d-76e433537cb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:41:00.808329 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-367b0e55-7904-4a43-bd3d-76e433537cb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:41:00.813064 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1352/2719] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:41:00 2022] DELETE /identity/v3/projects/72be1b99e5c74479ba71eba9a241e758 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:41:00.818810 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6167bd-1678-4a0d-8214-766738a57f6c None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:41:00.819747 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6167bd-1678-4a0d-8214-766738a57f6c None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:41:00.819869 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6167bd-1678-4a0d-8214-766738a57f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:41:00.841483 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-ad6167bd-1678-4a0d-8214-766738a57f6c None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:41:00.842820 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ad6167bd-1678-4a0d-8214-766738a57f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:41:00.914684 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1368/2720] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:41:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:41:00.923766 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c73eb-ea8c-4d4c-a9c0-ec0a84f1f841 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:41:00.924376 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c73eb-ea8c-4d4c-a9c0-ec0a84f1f841 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:41:00.924912 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c73eb-ea8c-4d4c-a9c0-ec0a84f1f841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:41:00.951902 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-dc0c73eb-ea8c-4d4c-a9c0-ec0a84f1f841 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:41:00.953325 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-dc0c73eb-ea8c-4d4c-a9c0-ec0a84f1f841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:41:00.963874 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1353/2721] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:41:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:41:00.968650 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6167bd-1678-4a0d-8214-766738a57f6c None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:41:00.982730 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6167bd-1678-4a0d-8214-766738a57f6c None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:41:00.988139 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5fcc9-05e3-4c53-b2ff-b8867f877435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:41:00.989002 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5fcc9-05e3-4c53-b2ff-b8867f877435 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:41:00.989295 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5fcc9-05e3-4c53-b2ff-b8867f877435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:41:00.990828 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5fcc9-05e3-4c53-b2ff-b8867f877435 admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:41:00.991759 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab5fcc9-05e3-4c53-b2ff-b8867f877435 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:41:00.992110 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab5fcc9-05e3-4c53-b2ff-b8867f877435 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:41:00.994085 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab5fcc9-05e3-4c53-b2ff-b8867f877435 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:41:01.014270 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c73eb-ea8c-4d4c-a9c0-ec0a84f1f841 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:41:01.020968 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1369/2722] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:41:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:41:01.025792 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c73eb-ea8c-4d4c-a9c0-ec0a84f1f841 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:41:01.031651 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47ceb8-4772-446c-a73b-e57661de012e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:41:01.032373 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47ceb8-4772-446c-a73b-e57661de012e admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:41:01.032665 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47ceb8-4772-446c-a73b-e57661de012e admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:41:01.033031 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47ceb8-4772-446c-a73b-e57661de012e admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:41:01.033727 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a47ceb8-4772-446c-a73b-e57661de012e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:41:01.035925 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a47ceb8-4772-446c-a73b-e57661de012e admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:41:01.142659 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1354/2723] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:41:01 2022] POST /identity/v3/projects => generated 369 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:41:01.147447 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5fcc9-05e3-4c53-b2ff-b8867f877435 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:41:01.166706 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5fcc9-05e3-4c53-b2ff-b8867f877435 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:41:01.215631 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:41:01.248820 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045cc420-3b50-4085-a15f-2a6c1522daa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:41:01.248820 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045cc420-3b50-4085-a15f-2a6c1522daa6 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:41:01.249630 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045cc420-3b50-4085-a15f-2a6c1522daa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:41:01.249983 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045cc420-3b50-4085-a15f-2a6c1522daa6 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:41:01.250936 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045cc420-3b50-4085-a15f-2a6c1522daa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:41:01.253033 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045cc420-3b50-4085-a15f-2a6c1522daa6 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:41:01.354317 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1370/2724] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:41:01 2022] POST /identity/v3/users => generated 285 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:41:01.357683 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47ceb8-4772-446c-a73b-e57661de012e admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:41:01.375841 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47ceb8-4772-446c-a73b-e57661de012e admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:41:01.390174 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc87683-a115-4dba-831f-5257431fef49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:41:01.391139 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc87683-a115-4dba-831f-5257431fef49 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:41:01.391583 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc87683-a115-4dba-831f-5257431fef49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:41:01.392669 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc87683-a115-4dba-831f-5257431fef49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:41:01.393654 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc87683-a115-4dba-831f-5257431fef49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:41:01.399324 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc87683-a115-4dba-831f-5257431fef49 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:41:01.430634 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045cc420-3b50-4085-a15f-2a6c1522daa6 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:41:01.438061 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1355/2725] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:41:01.446888 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045cc420-3b50-4085-a15f-2a6c1522daa6 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:41:01.453545 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432edea-ab7a-4964-adb3-ec8b3182bb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:41:01.454501 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432edea-ab7a-4964-adb3-ec8b3182bb2c admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:41:01.455001 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432edea-ab7a-4964-adb3-ec8b3182bb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:41:01.455602 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432edea-ab7a-4964-adb3-ec8b3182bb2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:41:01.456653 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7432edea-ab7a-4964-adb3-ec8b3182bb2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:41:01.460515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7432edea-ab7a-4964-adb3-ec8b3182bb2c admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:41:01.480951 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1371/2726] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:41:01.484883 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc87683-a115-4dba-831f-5257431fef49 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:41:01.501422 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc87683-a115-4dba-831f-5257431fef49 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:41:01.519686 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0e2d4-ec67-44b5-b957-dd03c0d2b3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:41:01.521104 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0e2d4-ec67-44b5-b957-dd03c0d2b3f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:41:01.521953 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0e2d4-ec67-44b5-b957-dd03c0d2b3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:41:01.522486 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0e2d4-ec67-44b5-b957-dd03c0d2b3f7 admin admin] PATH_INFO: `/v3/projects/c1dc1fd16a9841fa8b89830b728f7079/users/8e320cb81b2342b79cec5c5014988a80/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:41:01.545440 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d0e2d4-ec67-44b5-b957-dd03c0d2b3f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1dc1fd16a9841fa8b89830b728f7079, user_id=8e320cb81b2342b79cec5c5014988a80, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:41:01.548910 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d0e2d4-ec67-44b5-b957-dd03c0d2b3f7 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:41:01.630452 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1356/2727] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:41:01 2022] PUT /identity/v3/projects/c1dc1fd16a9841fa8b89830b728f7079/users/8e320cb81b2342b79cec5c5014988a80/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:41:01.641327 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49aadb-825f-43a6-b600-25e7ed20c1d5 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:41:01.646671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49aadb-825f-43a6-b600-25e7ed20c1d5 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:41:01.646671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49aadb-825f-43a6-b600-25e7ed20c1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:41:01.697834 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-2c49aadb-825f-43a6-b600-25e7ed20c1d5 None None] MFA Rules not processed for user `8e320cb81b2342b79cec5c5014988a80`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:41:01.699383 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-2c49aadb-825f-43a6-b600-25e7ed20c1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:41:01.810674 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1372/2728] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:41:01 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:41:01.823177 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0e2d4-ec67-44b5-b957-dd03c0d2b3f7 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:41:01.824996 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-d2d0e2d4-ec67-44b5-b957-dd03c0d2b3f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:41:01.858837 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:41:01.930270 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0e2d4-ec67-44b5-b957-dd03c0d2b3f7 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:41:01.935393 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d687c44-dd40-4666-80b7-cfa481bf5e7e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a23a8e608f94d5d8153dcf7e79250f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:41:01.937918 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d687c44-dd40-4666-80b7-cfa481bf5e7e service glance] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:41:01.938237 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d687c44-dd40-4666-80b7-cfa481bf5e7e service glance] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:41:01.938531 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d687c44-dd40-4666-80b7-cfa481bf5e7e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:41:01.954458 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d687c44-dd40-4666-80b7-cfa481bf5e7e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:41:01.955975 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d687c44-dd40-4666-80b7-cfa481bf5e7e service glance] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:41:01.986889 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1357/2729] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:41:01 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:41:10.534664 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20d2c8-b345-4919-92ab-c1c98edc91ac None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:41:10.535181 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20d2c8-b345-4919-92ab-c1c98edc91ac None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:41:10.535282 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20d2c8-b345-4919-92ab-c1c98edc91ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:41:10.553800 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-8e20d2c8-b345-4919-92ab-c1c98edc91ac None None] MFA Rules not processed for user `2b357a9f007242c2b5eeaf70ae972907`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:41:10.555004 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-8e20d2c8-b345-4919-92ab-c1c98edc91ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:41:10.613190 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1373/2730] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:41:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:41:12.017220 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=17 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:41:14.081038 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d93861-e76c-45be-86ca-545eb8c4c828 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:41:14.081629 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d93861-e76c-45be-86ca-545eb8c4c828 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:41:14.081629 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d93861-e76c-45be-86ca-545eb8c4c828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:41:14.102432 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-a6d93861-e76c-45be-86ca-545eb8c4c828 None None] MFA Rules not processed for user `22d11b8e390e4b9db3b84c419266c4b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:41:14.103891 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-a6d93861-e76c-45be-86ca-545eb8c4c828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:41:14.159852 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1358/2731] 10.222.0.60 () {58 vars in 1009 bytes} [Thu Jul 21 19:41:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:41:14.173428 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e20d2c8-b345-4919-92ab-c1c98edc91ac None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:41:14.174815 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-8e20d2c8-b345-4919-92ab-c1c98edc91ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:41:14.234099 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:41:14.253846 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e20d2c8-b345-4919-92ab-c1c98edc91ac None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:41:14.264057 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc203f4-aa6b-4082-9bbb-4c6227f9eef9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa579af53a6441a9205cf82864a640e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:41:14.264057 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc203f4-aa6b-4082-9bbb-4c6227f9eef9 service swift] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:41:14.264057 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc203f4-aa6b-4082-9bbb-4c6227f9eef9 service swift] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:41:14.264057 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc203f4-aa6b-4082-9bbb-4c6227f9eef9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:41:14.274186 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc203f4-aa6b-4082-9bbb-4c6227f9eef9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:41:14.276149 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc203f4-aa6b-4082-9bbb-4c6227f9eef9 service swift] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:41:14.288227 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1374/2732] 10.222.0.60 () {60 vars in 1384 bytes} [Thu Jul 21 19:41:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 19:41:24.153008 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=25 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:41:24.392730 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=10 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:41:30.029240 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d93861-e76c-45be-86ca-545eb8c4c828 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:41:30.100629 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d93861-e76c-45be-86ca-545eb8c4c828 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:41:30.105254 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27100dcb-458a-4982-94ad-63f923260191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:41:30.106128 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27100dcb-458a-4982-94ad-63f923260191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:41:30.106412 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27100dcb-458a-4982-94ad-63f923260191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:41:30.106714 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27100dcb-458a-4982-94ad-63f923260191 admin admin] PATH_INFO: `/v3/users/8e320cb81b2342b79cec5c5014988a80` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:41:30.107972 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27100dcb-458a-4982-94ad-63f923260191 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e320cb81b2342b79cec5c5014988a80)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:41:30.109904 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27100dcb-458a-4982-94ad-63f923260191 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:41:30.247575 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-27100dcb-458a-4982-94ad-63f923260191 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e320cb81b2342b79cec5c5014988a80'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:41:30.313773 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-27100dcb-458a-4982-94ad-63f923260191 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e320cb81b2342b79cec5c5014988a80'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:41:30.326540 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-27100dcb-458a-4982-94ad-63f923260191 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e320cb81b2342b79cec5c5014988a80'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:41:30.327165 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-27100dcb-458a-4982-94ad-63f923260191 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e320cb81b2342b79cec5c5014988a80'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:41:30.334168 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-27100dcb-458a-4982-94ad-63f923260191 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e320cb81b2342b79cec5c5014988a80'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:41:30.340046 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1359/2733] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:41:30 2022] DELETE /identity/v3/users/8e320cb81b2342b79cec5c5014988a80 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:41:30.344540 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ad3f7-365f-4cfb-b3ab-8073c49482cc None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:41:30.345042 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ad3f7-365f-4cfb-b3ab-8073c49482cc None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:41:30.345246 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ad3f7-365f-4cfb-b3ab-8073c49482cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:41:30.363609 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-c84ad3f7-365f-4cfb-b3ab-8073c49482cc None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:41:30.365500 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-c84ad3f7-365f-4cfb-b3ab-8073c49482cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:41:30.432119 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1375/2734] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:41:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:41:30.441535 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27100dcb-458a-4982-94ad-63f923260191 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:41:30.443010 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-27100dcb-458a-4982-94ad-63f923260191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:41:30.502054 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27100dcb-458a-4982-94ad-63f923260191 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:41:30.506214 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57f6b1-0d1e-4a73-9471-4185a74c2948 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:41:30.506910 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57f6b1-0d1e-4a73-9471-4185a74c2948 service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:41:30.507193 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57f6b1-0d1e-4a73-9471-4185a74c2948 service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:41:30.507485 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57f6b1-0d1e-4a73-9471-4185a74c2948 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:41:30.516658 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b57f6b1-0d1e-4a73-9471-4185a74c2948 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:41:30.518082 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b57f6b1-0d1e-4a73-9471-4185a74c2948 service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:41:30.527855 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1360/2735] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:41:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 19:41:30.995612 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ad3f7-365f-4cfb-b3ab-8073c49482cc None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:41:30.997117 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-c84ad3f7-365f-4cfb-b3ab-8073c49482cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:41:31.019095 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ad3f7-365f-4cfb-b3ab-8073c49482cc None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:41:31.034570 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ad67a-7e6e-464c-a92e-7ece736fe647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:41:31.039351 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ad67a-7e6e-464c-a92e-7ece736fe647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:41:31.039833 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ad67a-7e6e-464c-a92e-7ece736fe647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:41:31.040225 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ad67a-7e6e-464c-a92e-7ece736fe647 admin admin] PATH_INFO: `/v3/projects/c1dc1fd16a9841fa8b89830b728f7079` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:41:31.041690 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ad67a-7e6e-464c-a92e-7ece736fe647 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1dc1fd16a9841fa8b89830b728f7079)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:41:31.043940 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ad67a-7e6e-464c-a92e-7ece736fe647 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:41:31.217395 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-bf2ad67a-7e6e-464c-a92e-7ece736fe647 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1dc1fd16a9841fa8b89830b728f7079', 'request_id': 'req-bf2ad67a-7e6e-464c-a92e-7ece736fe647'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:41:31.225069 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-bf2ad67a-7e6e-464c-a92e-7ece736fe647 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1dc1fd16a9841fa8b89830b728f7079', 'request_id': 'req-bf2ad67a-7e6e-464c-a92e-7ece736fe647'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:41:31.303701 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-bf2ad67a-7e6e-464c-a92e-7ece736fe647 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1dc1fd16a9841fa8b89830b728f7079', 'request_id': 'req-bf2ad67a-7e6e-464c-a92e-7ece736fe647'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:41:31.328696 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-bf2ad67a-7e6e-464c-a92e-7ece736fe647 admin admin] The token cache is being invalidate because project c1dc1fd16a9841fa8b89830b728f7079 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:41:31.328994 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-bf2ad67a-7e6e-464c-a92e-7ece736fe647 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:41:31.329987 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-bf2ad67a-7e6e-464c-a92e-7ece736fe647 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:41:31.337451 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5d866-def6-45d8-a660-925f463296f1 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:41:31.340862 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5d866-def6-45d8-a660-925f463296f1 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:41:31.340862 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5d866-def6-45d8-a660-925f463296f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:41:31.341273 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1376/2736] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:41:30 2022] DELETE /identity/v3/projects/c1dc1fd16a9841fa8b89830b728f7079 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:41:31.362471 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-52a5d866-def6-45d8-a660-925f463296f1 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:41:31.367139 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-52a5d866-def6-45d8-a660-925f463296f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:41:31.389073 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:41:31.458776 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1361/2737] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:41:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:41:31.467535 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74368034-1a57-43d1-833f-9defc525f55b None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:41:31.470865 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74368034-1a57-43d1-833f-9defc525f55b None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:41:31.470865 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74368034-1a57-43d1-833f-9defc525f55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:41:31.493052 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-74368034-1a57-43d1-833f-9defc525f55b None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:41:31.494295 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-74368034-1a57-43d1-833f-9defc525f55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:41:31.504203 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1377/2738] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:41:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:41:31.509102 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5d866-def6-45d8-a660-925f463296f1 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:41:31.519308 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5d866-def6-45d8-a660-925f463296f1 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:41:31.524693 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3adbc-1040-4c19-90f5-4c3998471c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:41:31.525369 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3adbc-1040-4c19-90f5-4c3998471c89 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:41:31.525795 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3adbc-1040-4c19-90f5-4c3998471c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:41:31.526084 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3adbc-1040-4c19-90f5-4c3998471c89 admin admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:41:31.526823 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d3adbc-1040-4c19-90f5-4c3998471c89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:41:31.527182 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d3adbc-1040-4c19-90f5-4c3998471c89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:41:31.528829 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d3adbc-1040-4c19-90f5-4c3998471c89 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:41:31.542498 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1362/2739] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:41:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:41:31.546969 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74368034-1a57-43d1-833f-9defc525f55b None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:41:31.557047 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74368034-1a57-43d1-833f-9defc525f55b None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:41:31.578741 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca607599-8ba0-45ad-9147-911da76a6660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:41:31.579428 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca607599-8ba0-45ad-9147-911da76a6660 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:41:31.579746 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca607599-8ba0-45ad-9147-911da76a6660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:41:31.580025 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca607599-8ba0-45ad-9147-911da76a6660 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:41:31.580801 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca607599-8ba0-45ad-9147-911da76a6660 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:41:31.583338 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca607599-8ba0-45ad-9147-911da76a6660 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:41:31.693808 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1378/2740] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:41:31 2022] POST /identity/v3/projects => generated 383 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:41:31.698383 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3adbc-1040-4c19-90f5-4c3998471c89 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:41:31.709031 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3adbc-1040-4c19-90f5-4c3998471c89 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:41:31.767513 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d553f8-3299-4164-81a3-964d935f7e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:41:31.768404 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d553f8-3299-4164-81a3-964d935f7e3e admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:41:31.768690 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d553f8-3299-4164-81a3-964d935f7e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:41:31.768970 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d553f8-3299-4164-81a3-964d935f7e3e admin admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:41:31.769665 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d553f8-3299-4164-81a3-964d935f7e3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:41:31.771940 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d553f8-3299-4164-81a3-964d935f7e3e admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:41:31.861867 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1363/2741] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:41:31 2022] POST /identity/v3/users => generated 292 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:41:31.867220 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca607599-8ba0-45ad-9147-911da76a6660 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:41:31.878450 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca607599-8ba0-45ad-9147-911da76a6660 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:41:31.883732 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403b58a-3b84-41ec-a642-588384be0dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:41:31.884411 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403b58a-3b84-41ec-a642-588384be0dfb admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:41:31.884730 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403b58a-3b84-41ec-a642-588384be0dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:41:31.885008 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403b58a-3b84-41ec-a642-588384be0dfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:41:31.885745 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0403b58a-3b84-41ec-a642-588384be0dfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:41:31.887368 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0403b58a-3b84-41ec-a642-588384be0dfb admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:41:31.899880 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1379/2742] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:41:31.904828 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d553f8-3299-4164-81a3-964d935f7e3e admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:41:31.915423 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d553f8-3299-4164-81a3-964d935f7e3e admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:41:31.920106 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defec77e-bb48-4b77-ba0b-ccc550131b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:41:31.920688 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defec77e-bb48-4b77-ba0b-ccc550131b74 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:41:31.920971 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defec77e-bb48-4b77-ba0b-ccc550131b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:41:31.921246 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defec77e-bb48-4b77-ba0b-ccc550131b74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:41:31.921967 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defec77e-bb48-4b77-ba0b-ccc550131b74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:41:31.923882 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defec77e-bb48-4b77-ba0b-ccc550131b74 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:41:31.934733 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1364/2743] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:41:31.939037 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403b58a-3b84-41ec-a642-588384be0dfb admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:41:31.949998 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403b58a-3b84-41ec-a642-588384be0dfb admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:41:31.954804 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee99b5c-576d-4b99-aac4-abe25d2287de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:41:31.955776 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee99b5c-576d-4b99-aac4-abe25d2287de admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:41:31.956069 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee99b5c-576d-4b99-aac4-abe25d2287de admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:41:31.956345 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee99b5c-576d-4b99-aac4-abe25d2287de admin admin] PATH_INFO: `/v3/projects/18b9a8b0e3cd4d86977fa62bc172c969/users/b323c9b304d34d27be1288d2a649d4dd/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:41:31.972047 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee99b5c-576d-4b99-aac4-abe25d2287de admin admin] RBAC: Authorizing `identity:create_grant(project_id=18b9a8b0e3cd4d86977fa62bc172c969, user_id=b323c9b304d34d27be1288d2a649d4dd, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:41:31.975427 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee99b5c-576d-4b99-aac4-abe25d2287de admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:41:32.039198 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1380/2744] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:41:31 2022] PUT /identity/v3/projects/18b9a8b0e3cd4d86977fa62bc172c969/users/b323c9b304d34d27be1288d2a649d4dd/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:41:32.050307 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f4194-3fda-4274-a634-aef75fc0bfb3 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:41:32.050603 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f4194-3fda-4274-a634-aef75fc0bfb3 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:41:32.052707 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f4194-3fda-4274-a634-aef75fc0bfb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:41:32.080739 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-c42f4194-3fda-4274-a634-aef75fc0bfb3 None None] MFA Rules not processed for user `b323c9b304d34d27be1288d2a649d4dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:41:32.081971 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-c42f4194-3fda-4274-a634-aef75fc0bfb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:41:32.152537 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1365/2745] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:41:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:41:32.164955 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee99b5c-576d-4b99-aac4-abe25d2287de admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:41:32.166755 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-cee99b5c-576d-4b99-aac4-abe25d2287de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:41:32.208461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:41:32.244508 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee99b5c-576d-4b99-aac4-abe25d2287de admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:41:32.248605 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caecefa-7c82-478f-9d8a-afb5854930c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:41:32.249357 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caecefa-7c82-478f-9d8a-afb5854930c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:41:32.252105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caecefa-7c82-478f-9d8a-afb5854930c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:41:32.252570 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caecefa-7c82-478f-9d8a-afb5854930c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:41:32.263570 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caecefa-7c82-478f-9d8a-afb5854930c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:41:32.265301 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caecefa-7c82-478f-9d8a-afb5854930c8 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:41:32.284515 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1381/2746] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:41:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:41:35.357657 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f4194-3fda-4274-a634-aef75fc0bfb3 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:41:35.377399 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:41:35.426775 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f4194-3fda-4274-a634-aef75fc0bfb3 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:41:35.431115 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d93e69-7b80-472a-8408-5878cd2970c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:41:35.432067 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d93e69-7b80-472a-8408-5878cd2970c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:41:35.432353 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d93e69-7b80-472a-8408-5878cd2970c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:41:35.432626 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d93e69-7b80-472a-8408-5878cd2970c8 admin admin] PATH_INFO: `/v3/users/b323c9b304d34d27be1288d2a649d4dd` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:41:35.433818 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d93e69-7b80-472a-8408-5878cd2970c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b323c9b304d34d27be1288d2a649d4dd)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:41:35.435778 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d93e69-7b80-472a-8408-5878cd2970c8 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:41:35.615787 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-50d93e69-7b80-472a-8408-5878cd2970c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b323c9b304d34d27be1288d2a649d4dd'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:41:35.696743 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-50d93e69-7b80-472a-8408-5878cd2970c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b323c9b304d34d27be1288d2a649d4dd'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:41:35.710425 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-50d93e69-7b80-472a-8408-5878cd2970c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b323c9b304d34d27be1288d2a649d4dd'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:41:35.711119 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-50d93e69-7b80-472a-8408-5878cd2970c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b323c9b304d34d27be1288d2a649d4dd'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:41:35.717968 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-50d93e69-7b80-472a-8408-5878cd2970c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b323c9b304d34d27be1288d2a649d4dd'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:41:35.724595 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1366/2747] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:41:35 2022] DELETE /identity/v3/users/b323c9b304d34d27be1288d2a649d4dd => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:41:35.729142 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b067e-69bd-4b3f-a789-c35f05e24839 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:41:35.729613 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b067e-69bd-4b3f-a789-c35f05e24839 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:41:35.729837 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b067e-69bd-4b3f-a789-c35f05e24839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:41:35.799191 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-db4b067e-69bd-4b3f-a789-c35f05e24839 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:41:35.800458 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-db4b067e-69bd-4b3f-a789-c35f05e24839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:41:35.927814 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1382/2748] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:41:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:41:35.931099 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d93e69-7b80-472a-8408-5878cd2970c8 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:41:35.932740 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-50d93e69-7b80-472a-8408-5878cd2970c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:41:36.039495 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d93e69-7b80-472a-8408-5878cd2970c8 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:41:36.043209 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d06d01-4283-4259-9152-daa269444606 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:41:36.043926 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d06d01-4283-4259-9152-daa269444606 service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:41:36.044210 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d06d01-4283-4259-9152-daa269444606 service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:41:36.044489 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d06d01-4283-4259-9152-daa269444606 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:41:36.054397 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d06d01-4283-4259-9152-daa269444606 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:41:36.055885 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d06d01-4283-4259-9152-daa269444606 service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:41:36.066337 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1367/2749] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:41:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 19:41:36.548286 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b067e-69bd-4b3f-a789-c35f05e24839 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:41:36.549937 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-db4b067e-69bd-4b3f-a789-c35f05e24839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:41:36.562367 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b067e-69bd-4b3f-a789-c35f05e24839 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:41:36.571881 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5a4d9-7c53-4492-86ab-87de33453e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:41:36.572793 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5a4d9-7c53-4492-86ab-87de33453e25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:41:36.573077 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5a4d9-7c53-4492-86ab-87de33453e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:41:36.573353 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5a4d9-7c53-4492-86ab-87de33453e25 admin admin] PATH_INFO: `/v3/projects/18b9a8b0e3cd4d86977fa62bc172c969` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:41:36.574576 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a5a4d9-7c53-4492-86ab-87de33453e25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18b9a8b0e3cd4d86977fa62bc172c969)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:41:36.576532 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a5a4d9-7c53-4492-86ab-87de33453e25 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:41:36.582255 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f8bd1-fa86-44ef-9f32-2ab78ab9da75 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:41:36.583294 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f8bd1-fa86-44ef-9f32-2ab78ab9da75 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:41:36.583602 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f8bd1-fa86-44ef-9f32-2ab78ab9da75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:41:36.603132 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-335f8bd1-fa86-44ef-9f32-2ab78ab9da75 None None] MFA Rules not processed for user `87f021ceaea34306a44761f4e984bf9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:41:36.604368 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-335f8bd1-fa86-44ef-9f32-2ab78ab9da75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:41:36.617696 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:41:36.660596 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1368/2750] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:41:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:41:36.692461 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-43a5a4d9-7c53-4492-86ab-87de33453e25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18b9a8b0e3cd4d86977fa62bc172c969', 'request_id': 'req-43a5a4d9-7c53-4492-86ab-87de33453e25'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:41:36.693686 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:41:36.699766 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-43a5a4d9-7c53-4492-86ab-87de33453e25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18b9a8b0e3cd4d86977fa62bc172c969', 'request_id': 'req-43a5a4d9-7c53-4492-86ab-87de33453e25'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:41:36.787765 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-43a5a4d9-7c53-4492-86ab-87de33453e25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18b9a8b0e3cd4d86977fa62bc172c969', 'request_id': 'req-43a5a4d9-7c53-4492-86ab-87de33453e25'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:41:36.799350 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-43a5a4d9-7c53-4492-86ab-87de33453e25 admin admin] The token cache is being invalidate because project 18b9a8b0e3cd4d86977fa62bc172c969 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:41:36.799669 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-43a5a4d9-7c53-4492-86ab-87de33453e25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:41:36.800402 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-43a5a4d9-7c53-4492-86ab-87de33453e25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:41:36.802773 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1383/2751] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:41:36 2022] DELETE /identity/v3/projects/18b9a8b0e3cd4d86977fa62bc172c969 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:41:36.808041 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce973be-5b43-4385-aeda-73f9e7fb9838 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:41:36.808501 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce973be-5b43-4385-aeda-73f9e7fb9838 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:41:36.808799 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce973be-5b43-4385-aeda-73f9e7fb9838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:41:36.858006 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-2ce973be-5b43-4385-aeda-73f9e7fb9838 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:41:36.859225 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-2ce973be-5b43-4385-aeda-73f9e7fb9838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:41:36.937133 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1369/2752] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:41:36.950052 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe448d-899d-4a22-9925-b410da6a5ae8 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:41:36.950408 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe448d-899d-4a22-9925-b410da6a5ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:41:36.950696 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe448d-899d-4a22-9925-b410da6a5ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:41:36.971113 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-71fe448d-899d-4a22-9925-b410da6a5ae8 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:41:36.972382 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-71fe448d-899d-4a22-9925-b410da6a5ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:41:36.981540 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1384/2753] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:41:36.985988 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce973be-5b43-4385-aeda-73f9e7fb9838 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:41:36.996403 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce973be-5b43-4385-aeda-73f9e7fb9838 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:41:37.001045 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46788c29-06fe-425b-861f-3c854cbbecda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:41:37.001698 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46788c29-06fe-425b-861f-3c854cbbecda admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:41:37.001981 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46788c29-06fe-425b-861f-3c854cbbecda admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:41:37.002257 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46788c29-06fe-425b-861f-3c854cbbecda admin admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:41:37.002979 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46788c29-06fe-425b-861f-3c854cbbecda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:41:37.003285 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46788c29-06fe-425b-861f-3c854cbbecda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:41:37.005015 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46788c29-06fe-425b-861f-3c854cbbecda admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:41:37.016962 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1370/2754] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:41:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:41:37.028526 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe448d-899d-4a22-9925-b410da6a5ae8 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:41:37.039744 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe448d-899d-4a22-9925-b410da6a5ae8 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:41:37.044498 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7607d1-f771-40a4-8106-dbb90d01d052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:41:37.045185 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7607d1-f771-40a4-8106-dbb90d01d052 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:41:37.045561 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7607d1-f771-40a4-8106-dbb90d01d052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:41:37.045835 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7607d1-f771-40a4-8106-dbb90d01d052 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:41:37.046530 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7607d1-f771-40a4-8106-dbb90d01d052 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:41:37.048525 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7607d1-f771-40a4-8106-dbb90d01d052 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:41:37.145675 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1385/2755] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:41:37 2022] POST /identity/v3/projects => generated 375 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:41:37.150029 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46788c29-06fe-425b-861f-3c854cbbecda admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:41:37.161593 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46788c29-06fe-425b-861f-3c854cbbecda admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:41:37.235742 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0d15d-6951-4877-b180-9761a3df9644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:41:37.236667 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0d15d-6951-4877-b180-9761a3df9644 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:41:37.237016 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0d15d-6951-4877-b180-9761a3df9644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:41:37.237297 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0d15d-6951-4877-b180-9761a3df9644 admin admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:41:37.237993 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e0d15d-6951-4877-b180-9761a3df9644 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:41:37.240649 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e0d15d-6951-4877-b180-9761a3df9644 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:41:37.318557 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1371/2756] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:41:37 2022] POST /identity/v3/users => generated 288 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:41:37.322924 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7607d1-f771-40a4-8106-dbb90d01d052 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:41:37.333931 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7607d1-f771-40a4-8106-dbb90d01d052 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:41:37.338469 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b481e-a828-43ec-80b0-5a8f677f3adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:41:37.339127 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b481e-a828-43ec-80b0-5a8f677f3adb admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:41:37.339415 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b481e-a828-43ec-80b0-5a8f677f3adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:41:37.344167 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b481e-a828-43ec-80b0-5a8f677f3adb admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:41:37.344167 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b481e-a828-43ec-80b0-5a8f677f3adb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:41:37.344167 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b481e-a828-43ec-80b0-5a8f677f3adb admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:41:37.355065 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1386/2757] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:41:37.358992 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0d15d-6951-4877-b180-9761a3df9644 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:41:37.373204 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0d15d-6951-4877-b180-9761a3df9644 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:41:37.380528 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe0f7d-6585-4926-ac1d-c985e798a8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:41:37.381287 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe0f7d-6585-4926-ac1d-c985e798a8ca admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:41:37.381640 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe0f7d-6585-4926-ac1d-c985e798a8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:41:37.382008 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe0f7d-6585-4926-ac1d-c985e798a8ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:41:37.382859 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe0f7d-6585-4926-ac1d-c985e798a8ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:41:37.384577 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe0f7d-6585-4926-ac1d-c985e798a8ca admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:41:37.403895 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1372/2758] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:41:37.405034 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b481e-a828-43ec-80b0-5a8f677f3adb admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:41:37.419035 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b481e-a828-43ec-80b0-5a8f677f3adb admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:41:37.427711 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c2f25-bfd0-4b1e-8a04-196e0bb4000b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:41:37.430386 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c2f25-bfd0-4b1e-8a04-196e0bb4000b admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:41:37.430386 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c2f25-bfd0-4b1e-8a04-196e0bb4000b admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:41:37.430386 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c2f25-bfd0-4b1e-8a04-196e0bb4000b admin admin] PATH_INFO: `/v3/projects/53b21970880b4050a34c2d2fd9a9e7d6/users/df412b8189ec4477b01e6a126520350f/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:41:37.448315 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540c2f25-bfd0-4b1e-8a04-196e0bb4000b admin admin] RBAC: Authorizing `identity:create_grant(project_id=53b21970880b4050a34c2d2fd9a9e7d6, user_id=df412b8189ec4477b01e6a126520350f, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:41:37.451055 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540c2f25-bfd0-4b1e-8a04-196e0bb4000b admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:41:37.537870 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1387/2759] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:41:37 2022] PUT /identity/v3/projects/53b21970880b4050a34c2d2fd9a9e7d6/users/df412b8189ec4477b01e6a126520350f/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:41:37.546093 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cd093-97a6-4580-9f17-46fd59cb1196 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:41:37.546390 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cd093-97a6-4580-9f17-46fd59cb1196 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:41:37.546670 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cd093-97a6-4580-9f17-46fd59cb1196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:41:37.559367 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:41:37.573554 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-030cd093-97a6-4580-9f17-46fd59cb1196 None None] MFA Rules not processed for user `df412b8189ec4477b01e6a126520350f`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:41:37.574781 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-030cd093-97a6-4580-9f17-46fd59cb1196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:41:37.638340 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1373/2760] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:41:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:41:37.649779 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c2f25-bfd0-4b1e-8a04-196e0bb4000b admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:41:37.651510 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-540c2f25-bfd0-4b1e-8a04-196e0bb4000b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:41:37.711099 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c2f25-bfd0-4b1e-8a04-196e0bb4000b admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:41:37.714773 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27b87a-c46e-44bf-8a17-0268fd56329a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:41:37.715409 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27b87a-c46e-44bf-8a17-0268fd56329a service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:41:37.715723 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27b87a-c46e-44bf-8a17-0268fd56329a service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:41:37.716003 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27b87a-c46e-44bf-8a17-0268fd56329a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:41:37.724941 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e27b87a-c46e-44bf-8a17-0268fd56329a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:41:37.726367 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e27b87a-c46e-44bf-8a17-0268fd56329a service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:41:37.735299 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1388/2761] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:41:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:41:38.449233 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030cd093-97a6-4580-9f17-46fd59cb1196 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:41:38.450701 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-030cd093-97a6-4580-9f17-46fd59cb1196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:41:38.527359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030cd093-97a6-4580-9f17-46fd59cb1196 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:41:38.531507 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9813fa6-6269-4b31-ba5c-3253fa12b5a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:41:38.532167 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9813fa6-6269-4b31-ba5c-3253fa12b5a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:41:38.532461 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9813fa6-6269-4b31-ba5c-3253fa12b5a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:41:38.532771 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9813fa6-6269-4b31-ba5c-3253fa12b5a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:41:38.534732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-a9813fa6-6269-4b31-ba5c-3253fa12b5a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:41:38.611028 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9813fa6-6269-4b31-ba5c-3253fa12b5a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:41:38.612788 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9813fa6-6269-4b31-ba5c-3253fa12b5a4 service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:41:38.625333 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1374/2762] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:41:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:41:39.564704 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e483787-f49e-44e6-aced-6e55f52eaa56 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:41:39.565262 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e483787-f49e-44e6-aced-6e55f52eaa56 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:41:39.565262 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e483787-f49e-44e6-aced-6e55f52eaa56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:41:39.584973 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-9e483787-f49e-44e6-aced-6e55f52eaa56 None None] MFA Rules not processed for user `df412b8189ec4477b01e6a126520350f`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:41:39.587754 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-9e483787-f49e-44e6-aced-6e55f52eaa56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:41:39.598758 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1389/2763] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:41:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:41:41.796154 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9813fa6-6269-4b31-ba5c-3253fa12b5a4 service neutron] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:41:41.797691 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-a9813fa6-6269-4b31-ba5c-3253fa12b5a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:41:41.873262 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:41:41.953943 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9813fa6-6269-4b31-ba5c-3253fa12b5a4 service neutron] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:41:41.960762 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63883c6e-af05-4898-8c0f-026d2d65ba7e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcc5eefc2f7c419190e96b46b163fedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:41:41.961914 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63883c6e-af05-4898-8c0f-026d2d65ba7e service placement] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:41:41.961914 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63883c6e-af05-4898-8c0f-026d2d65ba7e service placement] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:41:41.962270 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63883c6e-af05-4898-8c0f-026d2d65ba7e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:41:41.964431 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-63883c6e-af05-4898-8c0f-026d2d65ba7e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:41:41.979387 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63883c6e-af05-4898-8c0f-026d2d65ba7e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:41:41.981589 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63883c6e-af05-4898-8c0f-026d2d65ba7e service placement] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:41:42.006447 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1375/2764] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:41:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:41:49.581420 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=62,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:41:52.119620 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=20 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:42:00.198317 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf0087-9e0b-458d-ace8-910188625bf7 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:00.198859 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf0087-9e0b-458d-ace8-910188625bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:00.198859 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf0087-9e0b-458d-ace8-910188625bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:00.227269 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-f3bf0087-9e0b-458d-ace8-910188625bf7 None None] MFA Rules not processed for user `22d11b8e390e4b9db3b84c419266c4b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:42:00.228426 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f3bf0087-9e0b-458d-ace8-910188625bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:42:00.291333 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1390/2765] 10.222.0.60 () {58 vars in 1009 bytes} [Thu Jul 21 19:42:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:42:00.313719 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63883c6e-af05-4898-8c0f-026d2d65ba7e service placement] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:42:00.315279 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-63883c6e-af05-4898-8c0f-026d2d65ba7e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:42:00.383783 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63883c6e-af05-4898-8c0f-026d2d65ba7e service placement] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:42:00.388852 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c009be-76c4-41ab-a38f-f5af0555f5ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa579af53a6441a9205cf82864a640e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:42:00.389491 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c009be-76c4-41ab-a38f-f5af0555f5ce service swift] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:00.389770 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c009be-76c4-41ab-a38f-f5af0555f5ce service swift] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:00.390042 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c009be-76c4-41ab-a38f-f5af0555f5ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:00.399583 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c009be-76c4-41ab-a38f-f5af0555f5ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:42:00.401185 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c009be-76c4-41ab-a38f-f5af0555f5ce service swift] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:42:00.410175 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1376/2766] 10.222.0.60 () {60 vars in 1384 bytes} [Thu Jul 21 19:42:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 19:42:01.228255 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48c87a-1942-41ab-a752-fb49ae6f03af None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:01.228255 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48c87a-1942-41ab-a752-fb49ae6f03af None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:01.228255 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48c87a-1942-41ab-a752-fb49ae6f03af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:01.242351 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-dd48c87a-1942-41ab-a752-fb49ae6f03af None None] MFA Rules not processed for user `22d11b8e390e4b9db3b84c419266c4b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:42:01.243625 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-dd48c87a-1942-41ab-a752-fb49ae6f03af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:42:01.250967 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1391/2767] 10.222.0.60 () {58 vars in 967 bytes} [Thu Jul 21 19:42:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:42:01.263525 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c009be-76c4-41ab-a38f-f5af0555f5ce service swift] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:42:01.274718 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c009be-76c4-41ab-a38f-f5af0555f5ce service swift] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:42:01.279641 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b661d258-5845-4c2d-894e-7857a21baa28 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa579af53a6441a9205cf82864a640e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:42:01.280271 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661d258-5845-4c2d-894e-7857a21baa28 service swift] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:01.280553 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661d258-5845-4c2d-894e-7857a21baa28 service swift] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:01.280829 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661d258-5845-4c2d-894e-7857a21baa28 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:01.289014 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b661d258-5845-4c2d-894e-7857a21baa28 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:42:01.290566 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b661d258-5845-4c2d-894e-7857a21baa28 service swift] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:42:01.298759 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1377/2768] 10.222.0.60 () {60 vars in 1384 bytes} [Thu Jul 21 19:42:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 19:42:01.860016 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f371a8e-41cf-4f90-a6d3-dfc925204efb None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:01.860332 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f371a8e-41cf-4f90-a6d3-dfc925204efb None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:01.860617 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f371a8e-41cf-4f90-a6d3-dfc925204efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:01.882020 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-3f371a8e-41cf-4f90-a6d3-dfc925204efb None None] MFA Rules not processed for user `22d11b8e390e4b9db3b84c419266c4b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:42:01.882020 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3f371a8e-41cf-4f90-a6d3-dfc925204efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:42:01.888670 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1392/2769] 10.222.0.60 () {58 vars in 1009 bytes} [Thu Jul 21 19:42:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:42:01.900814 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b661d258-5845-4c2d-894e-7857a21baa28 service swift] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:42:01.912219 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b661d258-5845-4c2d-894e-7857a21baa28 service swift] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:42:01.919024 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40cb54-18af-4009-bc62-d583e874525d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa579af53a6441a9205cf82864a640e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:42:01.919024 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40cb54-18af-4009-bc62-d583e874525d service swift] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:01.919024 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40cb54-18af-4009-bc62-d583e874525d service swift] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:01.919024 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40cb54-18af-4009-bc62-d583e874525d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:01.927609 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d40cb54-18af-4009-bc62-d583e874525d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:42:01.929203 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d40cb54-18af-4009-bc62-d583e874525d service swift] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:42:01.937212 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1378/2770] 10.222.0.60 () {60 vars in 1384 bytes} [Thu Jul 21 19:42:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 19:42:02.510804 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd2db0-8daf-4f1c-a690-9e9561fa175f None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:02.511278 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd2db0-8daf-4f1c-a690-9e9561fa175f None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:02.511393 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd2db0-8daf-4f1c-a690-9e9561fa175f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:02.529179 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-0ebd2db0-8daf-4f1c-a690-9e9561fa175f None None] MFA Rules not processed for user `22d11b8e390e4b9db3b84c419266c4b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:42:02.530373 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-0ebd2db0-8daf-4f1c-a690-9e9561fa175f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:42:02.537590 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1393/2771] 10.222.0.60 () {58 vars in 967 bytes} [Thu Jul 21 19:42:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:42:02.549568 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40cb54-18af-4009-bc62-d583e874525d service swift] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:42:02.560039 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40cb54-18af-4009-bc62-d583e874525d service swift] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:42:02.565109 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ba488-1bbe-4ec1-b690-19035227df62 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa579af53a6441a9205cf82864a640e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:42:02.566371 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ba488-1bbe-4ec1-b690-19035227df62 service swift] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:02.566658 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ba488-1bbe-4ec1-b690-19035227df62 service swift] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:02.567064 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ba488-1bbe-4ec1-b690-19035227df62 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:02.575354 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ba488-1bbe-4ec1-b690-19035227df62 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:42:02.576982 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ba488-1bbe-4ec1-b690-19035227df62 service swift] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:42:02.585662 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1379/2772] 10.222.0.60 () {60 vars in 1384 bytes} [Thu Jul 21 19:42:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 19:42:05.176591 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd2db0-8daf-4f1c-a690-9e9561fa175f None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:42:05.239770 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd2db0-8daf-4f1c-a690-9e9561fa175f None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:42:05.244230 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb3509-61ac-476f-9ffe-d5ccc5db2d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:42:05.245114 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb3509-61ac-476f-9ffe-d5ccc5db2d36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:05.245378 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb3509-61ac-476f-9ffe-d5ccc5db2d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:05.245656 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb3509-61ac-476f-9ffe-d5ccc5db2d36 admin admin] PATH_INFO: `/v3/users/df412b8189ec4477b01e6a126520350f` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:05.246843 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb3509-61ac-476f-9ffe-d5ccc5db2d36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df412b8189ec4477b01e6a126520350f)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:42:05.248788 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb3509-61ac-476f-9ffe-d5ccc5db2d36 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:42:05.435536 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-3cdb3509-61ac-476f-9ffe-d5ccc5db2d36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df412b8189ec4477b01e6a126520350f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:42:05.501382 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-3cdb3509-61ac-476f-9ffe-d5ccc5db2d36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df412b8189ec4477b01e6a126520350f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:42:05.501990 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-3cdb3509-61ac-476f-9ffe-d5ccc5db2d36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df412b8189ec4477b01e6a126520350f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:42:05.509793 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-3cdb3509-61ac-476f-9ffe-d5ccc5db2d36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df412b8189ec4477b01e6a126520350f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:42:05.516767 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:42:05.523087 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-3cdb3509-61ac-476f-9ffe-d5ccc5db2d36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df412b8189ec4477b01e6a126520350f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:42:05.529102 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1394/2773] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:42:05 2022] DELETE /identity/v3/users/df412b8189ec4477b01e6a126520350f => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:42:05.533634 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746912bf-d72b-464a-93a3-72cc74af719b None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:05.534142 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746912bf-d72b-464a-93a3-72cc74af719b None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:05.534261 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746912bf-d72b-464a-93a3-72cc74af719b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:05.551966 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-746912bf-d72b-464a-93a3-72cc74af719b None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:42:05.553175 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-746912bf-d72b-464a-93a3-72cc74af719b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:42:05.612096 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1380/2774] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:42:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:42:05.621828 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb3509-61ac-476f-9ffe-d5ccc5db2d36 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:42:05.623229 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3cdb3509-61ac-476f-9ffe-d5ccc5db2d36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:42:05.704385 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb3509-61ac-476f-9ffe-d5ccc5db2d36 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:42:05.708192 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53822ca5-5c32-4f6d-8f01-8f08816bd7b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:42:05.708838 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53822ca5-5c32-4f6d-8f01-8f08816bd7b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:05.709129 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53822ca5-5c32-4f6d-8f01-8f08816bd7b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:05.709405 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53822ca5-5c32-4f6d-8f01-8f08816bd7b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:05.722997 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53822ca5-5c32-4f6d-8f01-8f08816bd7b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:42:05.724451 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53822ca5-5c32-4f6d-8f01-8f08816bd7b7 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:42:05.745641 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1395/2775] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:42:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:42:06.051892 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746912bf-d72b-464a-93a3-72cc74af719b None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:42:06.053323 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-746912bf-d72b-464a-93a3-72cc74af719b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:42:06.065295 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746912bf-d72b-464a-93a3-72cc74af719b None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:42:06.070414 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e67421-d4c5-4685-9eb4-f550687f4d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:42:06.071279 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e67421-d4c5-4685-9eb4-f550687f4d2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:06.071602 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e67421-d4c5-4685-9eb4-f550687f4d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:06.071882 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e67421-d4c5-4685-9eb4-f550687f4d2a admin admin] PATH_INFO: `/v3/projects/53b21970880b4050a34c2d2fd9a9e7d6` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:06.078269 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e67421-d4c5-4685-9eb4-f550687f4d2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=53b21970880b4050a34c2d2fd9a9e7d6)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:42:06.078269 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e67421-d4c5-4685-9eb4-f550687f4d2a admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:42:06.219892 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:42:06.222952 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-62e67421-d4c5-4685-9eb4-f550687f4d2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53b21970880b4050a34c2d2fd9a9e7d6', 'request_id': 'req-62e67421-d4c5-4685-9eb4-f550687f4d2a'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:42:06.306123 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-62e67421-d4c5-4685-9eb4-f550687f4d2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53b21970880b4050a34c2d2fd9a9e7d6', 'request_id': 'req-62e67421-d4c5-4685-9eb4-f550687f4d2a'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:42:06.311852 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-62e67421-d4c5-4685-9eb4-f550687f4d2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53b21970880b4050a34c2d2fd9a9e7d6', 'request_id': 'req-62e67421-d4c5-4685-9eb4-f550687f4d2a'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:42:06.324127 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-62e67421-d4c5-4685-9eb4-f550687f4d2a admin admin] The token cache is being invalidate because project 53b21970880b4050a34c2d2fd9a9e7d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:42:06.324420 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-62e67421-d4c5-4685-9eb4-f550687f4d2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:42:06.325058 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-62e67421-d4c5-4685-9eb4-f550687f4d2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:42:06.326591 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1381/2776] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:42:06 2022] DELETE /identity/v3/projects/53b21970880b4050a34c2d2fd9a9e7d6 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:42:06.332372 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f5390-de1b-4a24-a99e-3c67924e13df None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:06.332862 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f5390-de1b-4a24-a99e-3c67924e13df None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:06.333184 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f5390-de1b-4a24-a99e-3c67924e13df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:06.350672 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-365f5390-de1b-4a24-a99e-3c67924e13df None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:42:06.351931 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-365f5390-de1b-4a24-a99e-3c67924e13df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:42:06.410055 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1396/2777] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:42:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:42:06.417575 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22be4f-0297-432b-9860-9568e4147120 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:06.417872 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22be4f-0297-432b-9860-9568e4147120 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:06.418158 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22be4f-0297-432b-9860-9568e4147120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:06.438469 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-ab22be4f-0297-432b-9860-9568e4147120 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:42:06.439727 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-ab22be4f-0297-432b-9860-9568e4147120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:42:06.448624 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1382/2778] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:42:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:42:06.452890 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f5390-de1b-4a24-a99e-3c67924e13df None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:42:06.463399 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f5390-de1b-4a24-a99e-3c67924e13df None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:42:06.468007 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e748f7-6e21-419b-bd40-ed125b3360ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:42:06.468662 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e748f7-6e21-419b-bd40-ed125b3360ba admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:06.468947 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e748f7-6e21-419b-bd40-ed125b3360ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:06.469226 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e748f7-6e21-419b-bd40-ed125b3360ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:06.469952 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e748f7-6e21-419b-bd40-ed125b3360ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:42:06.470262 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e748f7-6e21-419b-bd40-ed125b3360ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:42:06.471937 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e748f7-6e21-419b-bd40-ed125b3360ba admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:42:06.483382 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1397/2779] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:42:06.487725 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22be4f-0297-432b-9860-9568e4147120 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:42:06.496856 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22be4f-0297-432b-9860-9568e4147120 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:42:06.501445 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f4a36b-1023-4e5c-90fa-3cae227890f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:42:06.502084 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4a36b-1023-4e5c-90fa-3cae227890f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:06.502364 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4a36b-1023-4e5c-90fa-3cae227890f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:06.502640 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4a36b-1023-4e5c-90fa-3cae227890f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:06.503864 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f4a36b-1023-4e5c-90fa-3cae227890f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:42:06.505736 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f4a36b-1023-4e5c-90fa-3cae227890f7 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:42:06.589206 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1383/2780] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:42:06 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 19:42:06.593359 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e748f7-6e21-419b-bd40-ed125b3360ba admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:42:06.603613 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e748f7-6e21-419b-bd40-ed125b3360ba admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:42:06.660764 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0d4f3-419e-405f-8882-b6ec10b9faae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:42:06.661421 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0d4f3-419e-405f-8882-b6ec10b9faae admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:06.661704 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0d4f3-419e-405f-8882-b6ec10b9faae admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:06.661979 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0d4f3-419e-405f-8882-b6ec10b9faae admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:06.662648 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f0d4f3-419e-405f-8882-b6ec10b9faae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:42:06.664656 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f0d4f3-419e-405f-8882-b6ec10b9faae admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:42:06.671113 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:42:06.742350 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1398/2781] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:42:06 2022] POST /identity/v3/users => generated 291 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:42:06.747628 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f4a36b-1023-4e5c-90fa-3cae227890f7 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:42:06.758892 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f4a36b-1023-4e5c-90fa-3cae227890f7 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:42:06.763484 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410c024-0485-4a44-89d1-74a6b47a8fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:42:06.764141 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410c024-0485-4a44-89d1-74a6b47a8fbf admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:06.764431 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410c024-0485-4a44-89d1-74a6b47a8fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:06.764711 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410c024-0485-4a44-89d1-74a6b47a8fbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:06.765437 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7410c024-0485-4a44-89d1-74a6b47a8fbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:42:06.767049 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7410c024-0485-4a44-89d1-74a6b47a8fbf admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:42:06.777572 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1384/2782] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:42:06.781677 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0d4f3-419e-405f-8882-b6ec10b9faae admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:42:06.792219 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0d4f3-419e-405f-8882-b6ec10b9faae admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:42:06.796774 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d680c-3e6d-41b6-a710-3f1e42065cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:42:06.797423 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d680c-3e6d-41b6-a710-3f1e42065cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:06.797706 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d680c-3e6d-41b6-a710-3f1e42065cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:06.797989 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d680c-3e6d-41b6-a710-3f1e42065cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:06.798705 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d680c-3e6d-41b6-a710-3f1e42065cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:42:06.800880 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d680c-3e6d-41b6-a710-3f1e42065cf3 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:42:06.810771 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1399/2783] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:42:06.814717 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410c024-0485-4a44-89d1-74a6b47a8fbf admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:42:06.825765 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410c024-0485-4a44-89d1-74a6b47a8fbf admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:42:06.830396 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6914dc-dcab-43c1-88ef-8ec259bc5816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:42:06.831818 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6914dc-dcab-43c1-88ef-8ec259bc5816 admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:06.831818 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6914dc-dcab-43c1-88ef-8ec259bc5816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:06.832139 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6914dc-dcab-43c1-88ef-8ec259bc5816 admin admin] PATH_INFO: `/v3/projects/d0844843050f4081aa5e792b390dc13a/users/a82b2dc882994ef9bc7ffca3ff25e988/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:06.846279 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6914dc-dcab-43c1-88ef-8ec259bc5816 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0844843050f4081aa5e792b390dc13a, user_id=a82b2dc882994ef9bc7ffca3ff25e988, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:42:06.849933 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6914dc-dcab-43c1-88ef-8ec259bc5816 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:42:06.942713 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1385/2784] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:42:06 2022] PUT /identity/v3/projects/d0844843050f4081aa5e792b390dc13a/users/a82b2dc882994ef9bc7ffca3ff25e988/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:42:06.948185 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c88805-cb3d-422c-bc45-31ce18a3653a None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:06.948486 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c88805-cb3d-422c-bc45-31ce18a3653a None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:06.948773 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c88805-cb3d-422c-bc45-31ce18a3653a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:06.966974 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-f4c88805-cb3d-422c-bc45-31ce18a3653a None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:42:06.968233 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f4c88805-cb3d-422c-bc45-31ce18a3653a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:42:07.028491 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1400/2785] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:42:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:42:07.038717 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6914dc-dcab-43c1-88ef-8ec259bc5816 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:42:07.040474 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-8f6914dc-dcab-43c1-88ef-8ec259bc5816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:42:07.096274 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6914dc-dcab-43c1-88ef-8ec259bc5816 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:42:07.100599 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb8435-a537-47a3-aed1-89406442d2fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:42:07.101182 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb8435-a537-47a3-aed1-89406442d2fd service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:07.101470 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb8435-a537-47a3-aed1-89406442d2fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:07.101750 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb8435-a537-47a3-aed1-89406442d2fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:07.110612 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb8435-a537-47a3-aed1-89406442d2fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:42:07.112066 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb8435-a537-47a3-aed1-89406442d2fd service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:42:07.121960 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1386/2786] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:42:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:42:08.474760 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be3980-a2bd-41f1-849f-52c8e6e0f9eb None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:08.475285 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be3980-a2bd-41f1-849f-52c8e6e0f9eb None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:08.475410 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be3980-a2bd-41f1-849f-52c8e6e0f9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:08.503978 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-e6be3980-a2bd-41f1-849f-52c8e6e0f9eb None None] MFA Rules not processed for user `a82b2dc882994ef9bc7ffca3ff25e988`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:42:08.505244 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-e6be3980-a2bd-41f1-849f-52c8e6e0f9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:42:08.574853 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1401/2787] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:42:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:42:08.586228 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb8435-a537-47a3-aed1-89406442d2fd service neutron] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:42:08.587678 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-b5cb8435-a537-47a3-aed1-89406442d2fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:42:08.677100 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb8435-a537-47a3-aed1-89406442d2fd service neutron] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:42:08.681525 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351f36a-f933-4641-a693-09b0280176e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:42:08.682190 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351f36a-f933-4641-a693-09b0280176e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:08.682596 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351f36a-f933-4641-a693-09b0280176e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:08.683169 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351f36a-f933-4641-a693-09b0280176e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:08.691246 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:42:08.694524 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3351f36a-f933-4641-a693-09b0280176e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:42:08.696282 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3351f36a-f933-4641-a693-09b0280176e9 service cinder] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:42:08.706460 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1387/2788] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:42:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:42:10.423703 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3785d-68bc-4dc6-a853-ccc70aaa0c4f None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:10.424210 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3785d-68bc-4dc6-a853-ccc70aaa0c4f None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:10.424327 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3785d-68bc-4dc6-a853-ccc70aaa0c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:10.443150 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-57e3785d-68bc-4dc6-a853-ccc70aaa0c4f None None] MFA Rules not processed for user `a82b2dc882994ef9bc7ffca3ff25e988`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:42:10.444394 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-57e3785d-68bc-4dc6-a853-ccc70aaa0c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:42:10.451486 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1402/2789] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:42:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:42:18.872412 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=2 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:42:20.437181 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:42:40.903790 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49092cd1-5a10-4a67-9466-98f591fa74ac None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:40.904422 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49092cd1-5a10-4a67-9466-98f591fa74ac None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:40.904521 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49092cd1-5a10-4a67-9466-98f591fa74ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:40.925069 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-49092cd1-5a10-4a67-9466-98f591fa74ac None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:42:40.927172 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-49092cd1-5a10-4a67-9466-98f591fa74ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:42:40.935642 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1388/2790] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Jul 21 19:42:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:42:40.949679 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3785d-68bc-4dc6-a853-ccc70aaa0c4f None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:42:40.951211 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-57e3785d-68bc-4dc6-a853-ccc70aaa0c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:42:41.055696 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3785d-68bc-4dc6-a853-ccc70aaa0c4f None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:42:41.061293 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f6a11-2485-447e-8d2d-648ac643cf84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:42:41.062717 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f6a11-2485-447e-8d2d-648ac643cf84 service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:41.062717 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f6a11-2485-447e-8d2d-648ac643cf84 service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:41.062717 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f6a11-2485-447e-8d2d-648ac643cf84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:41.072297 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f6a11-2485-447e-8d2d-648ac643cf84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:42:41.073872 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f6a11-2485-447e-8d2d-648ac643cf84 service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:42:41.084013 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1403/2791] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:42:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:42:45.123206 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec3007-d279-43f0-8e3c-d89f66da5762 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:45.123738 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec3007-d279-43f0-8e3c-d89f66da5762 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:45.123928 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec3007-d279-43f0-8e3c-d89f66da5762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:45.150925 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-56ec3007-d279-43f0-8e3c-d89f66da5762 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:42:45.152180 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-56ec3007-d279-43f0-8e3c-d89f66da5762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:42:45.160422 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1389/2792] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Jul 21 19:42:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:42:45.177297 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f6a11-2485-447e-8d2d-648ac643cf84 service nova] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:42:45.183502 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f88f6a11-2485-447e-8d2d-648ac643cf84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:42:45.199504 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f6a11-2485-447e-8d2d-648ac643cf84 service nova] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:42:45.205015 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d4c5d-04f8-4288-9494-0a9669fb3daa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:42:45.205661 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d4c5d-04f8-4288-9494-0a9669fb3daa service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:45.205948 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d4c5d-04f8-4288-9494-0a9669fb3daa service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:45.206230 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d4c5d-04f8-4288-9494-0a9669fb3daa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:45.215547 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49d4c5d-04f8-4288-9494-0a9669fb3daa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:42:45.217160 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49d4c5d-04f8-4288-9494-0a9669fb3daa service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:42:45.227157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1404/2793] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:42:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:42:48.619599 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d349433-627e-4f12-8c30-42160bcb11c9 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:48.620284 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d349433-627e-4f12-8c30-42160bcb11c9 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:48.620284 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d349433-627e-4f12-8c30-42160bcb11c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:48.642052 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-8d349433-627e-4f12-8c30-42160bcb11c9 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:42:48.643312 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-8d349433-627e-4f12-8c30-42160bcb11c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:42:48.652374 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1390/2794] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Jul 21 19:42:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:42:48.667752 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d4c5d-04f8-4288-9494-0a9669fb3daa service nova] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:42:48.678961 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d4c5d-04f8-4288-9494-0a9669fb3daa service nova] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:42:48.684828 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49631f-d668-4d8b-b271-aacd99b9d687 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:42:48.685510 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49631f-d668-4d8b-b271-aacd99b9d687 service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:48.685800 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49631f-d668-4d8b-b271-aacd99b9d687 service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:48.686184 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49631f-d668-4d8b-b271-aacd99b9d687 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:48.695842 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce49631f-d668-4d8b-b271-aacd99b9d687 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:42:48.697464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce49631f-d668-4d8b-b271-aacd99b9d687 service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:42:48.718653 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1405/2795] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:42:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:42:48.822168 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d349433-627e-4f12-8c30-42160bcb11c9 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:42:48.823649 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-8d349433-627e-4f12-8c30-42160bcb11c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:42:48.836067 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d349433-627e-4f12-8c30-42160bcb11c9 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:42:48.840867 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d12f3c-a634-448f-ab8e-12d3a1c46e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:42:48.841749 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d12f3c-a634-448f-ab8e-12d3a1c46e2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:48.842035 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d12f3c-a634-448f-ab8e-12d3a1c46e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:48.842314 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d12f3c-a634-448f-ab8e-12d3a1c46e2d admin admin] PATH_INFO: `/v3/users/87f021ceaea34306a44761f4e984bf9e` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:48.843550 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d12f3c-a634-448f-ab8e-12d3a1c46e2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=87f021ceaea34306a44761f4e984bf9e)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:42:48.845455 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d12f3c-a634-448f-ab8e-12d3a1c46e2d admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:42:49.045894 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-70d12f3c-a634-448f-ab8e-12d3a1c46e2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87f021ceaea34306a44761f4e984bf9e'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:42:49.123763 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-70d12f3c-a634-448f-ab8e-12d3a1c46e2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87f021ceaea34306a44761f4e984bf9e'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:42:49.136077 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-70d12f3c-a634-448f-ab8e-12d3a1c46e2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87f021ceaea34306a44761f4e984bf9e'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:42:49.136732 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-70d12f3c-a634-448f-ab8e-12d3a1c46e2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87f021ceaea34306a44761f4e984bf9e'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:42:49.144436 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-70d12f3c-a634-448f-ab8e-12d3a1c46e2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87f021ceaea34306a44761f4e984bf9e'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:42:49.150636 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1391/2796] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:42:48 2022] DELETE /identity/v3/users/87f021ceaea34306a44761f4e984bf9e => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:42:49.389634 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49631f-d668-4d8b-b271-aacd99b9d687 service nova] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:42:49.400930 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49631f-d668-4d8b-b271-aacd99b9d687 service nova] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:42:49.470342 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f09a1-a0a7-479f-a8fd-1c05c153a893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:42:49.470342 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f09a1-a0a7-479f-a8fd-1c05c153a893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:49.470342 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f09a1-a0a7-479f-a8fd-1c05c153a893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:49.470637 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f09a1-a0a7-479f-a8fd-1c05c153a893 admin admin] PATH_INFO: `/v3/projects/12edd41c20b64228a7ffec6c0fecceaa` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:49.471623 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22f09a1-a0a7-479f-a8fd-1c05c153a893 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12edd41c20b64228a7ffec6c0fecceaa)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:42:49.474166 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22f09a1-a0a7-479f-a8fd-1c05c153a893 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:42:49.599178 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:42:49.605476 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-b22f09a1-a0a7-479f-a8fd-1c05c153a893 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12edd41c20b64228a7ffec6c0fecceaa', 'request_id': 'req-b22f09a1-a0a7-479f-a8fd-1c05c153a893'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:42:49.611926 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-b22f09a1-a0a7-479f-a8fd-1c05c153a893 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12edd41c20b64228a7ffec6c0fecceaa', 'request_id': 'req-b22f09a1-a0a7-479f-a8fd-1c05c153a893'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:42:49.723529 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-b22f09a1-a0a7-479f-a8fd-1c05c153a893 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12edd41c20b64228a7ffec6c0fecceaa', 'request_id': 'req-b22f09a1-a0a7-479f-a8fd-1c05c153a893'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:42:49.734484 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-b22f09a1-a0a7-479f-a8fd-1c05c153a893 admin admin] The token cache is being invalidate because project 12edd41c20b64228a7ffec6c0fecceaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:42:49.735142 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-b22f09a1-a0a7-479f-a8fd-1c05c153a893 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:42:49.736535 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-b22f09a1-a0a7-479f-a8fd-1c05c153a893 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:42:49.738618 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1406/2797] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:42:49 2022] DELETE /identity/v3/projects/12edd41c20b64228a7ffec6c0fecceaa => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:42:49.743386 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a28250-987d-46f2-afc0-b3a8a1678cae None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:49.743937 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a28250-987d-46f2-afc0-b3a8a1678cae None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:49.744046 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a28250-987d-46f2-afc0-b3a8a1678cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:49.762400 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-33a28250-987d-46f2-afc0-b3a8a1678cae None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:42:49.763638 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-33a28250-987d-46f2-afc0-b3a8a1678cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:42:49.822848 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1392/2798] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:42:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:42:49.837463 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918d977-2a5d-4388-8b3f-cb2fe6346075 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:49.837748 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918d977-2a5d-4388-8b3f-cb2fe6346075 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:49.838026 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918d977-2a5d-4388-8b3f-cb2fe6346075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:49.856567 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-d918d977-2a5d-4388-8b3f-cb2fe6346075 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:42:49.857881 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-d918d977-2a5d-4388-8b3f-cb2fe6346075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:42:49.865829 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1407/2799] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:42:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:42:49.870051 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a28250-987d-46f2-afc0-b3a8a1678cae None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:42:49.880645 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a28250-987d-46f2-afc0-b3a8a1678cae None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:42:49.886777 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b7eaf-6fc7-44fe-a749-1d771f8ffc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:42:49.887481 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b7eaf-6fc7-44fe-a749-1d771f8ffc6a admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:49.887775 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b7eaf-6fc7-44fe-a749-1d771f8ffc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:49.888059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b7eaf-6fc7-44fe-a749-1d771f8ffc6a admin admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:49.889279 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b7eaf-6fc7-44fe-a749-1d771f8ffc6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:42:49.889715 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b7eaf-6fc7-44fe-a749-1d771f8ffc6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:42:49.891429 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b7eaf-6fc7-44fe-a749-1d771f8ffc6a admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:42:49.907407 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1393/2800] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:42:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:42:49.912503 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d918d977-2a5d-4388-8b3f-cb2fe6346075 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:42:49.922326 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d918d977-2a5d-4388-8b3f-cb2fe6346075 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:42:49.927174 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2108a63-e3ba-4754-9ab2-75283963d0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:42:49.927936 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2108a63-e3ba-4754-9ab2-75283963d0d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:49.928222 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2108a63-e3ba-4754-9ab2-75283963d0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:49.928501 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2108a63-e3ba-4754-9ab2-75283963d0d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:49.929229 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2108a63-e3ba-4754-9ab2-75283963d0d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:42:49.931111 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2108a63-e3ba-4754-9ab2-75283963d0d8 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:42:50.050598 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1408/2801] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:42:49 2022] POST /identity/v3/projects => generated 357 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 19:42:50.055237 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b7eaf-6fc7-44fe-a749-1d771f8ffc6a admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:42:50.065310 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b7eaf-6fc7-44fe-a749-1d771f8ffc6a admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:42:50.105007 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:42:50.123458 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1250fd-7b8b-4136-9bb2-2aa0c406dbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:42:50.124125 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1250fd-7b8b-4136-9bb2-2aa0c406dbd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:50.124409 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1250fd-7b8b-4136-9bb2-2aa0c406dbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:50.124684 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1250fd-7b8b-4136-9bb2-2aa0c406dbd2 admin admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:50.125375 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1250fd-7b8b-4136-9bb2-2aa0c406dbd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:42:50.127312 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1250fd-7b8b-4136-9bb2-2aa0c406dbd2 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:42:50.238362 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1394/2802] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:42:50 2022] POST /identity/v3/users => generated 279 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 19:42:50.243105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2108a63-e3ba-4754-9ab2-75283963d0d8 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:42:50.253569 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2108a63-e3ba-4754-9ab2-75283963d0d8 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:42:50.258971 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7fb98a-a520-49f8-8814-12ad8424f0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:42:50.259672 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fb98a-a520-49f8-8814-12ad8424f0a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:50.259966 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fb98a-a520-49f8-8814-12ad8424f0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:50.260240 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fb98a-a520-49f8-8814-12ad8424f0a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:50.260966 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7fb98a-a520-49f8-8814-12ad8424f0a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:42:50.262562 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7fb98a-a520-49f8-8814-12ad8424f0a4 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:42:50.273346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1409/2803] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:42:50.277133 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1250fd-7b8b-4136-9bb2-2aa0c406dbd2 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:42:50.287215 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1250fd-7b8b-4136-9bb2-2aa0c406dbd2 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:42:50.291867 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ef497-4a99-497c-8107-ee15a2d4a430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:42:50.292525 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ef497-4a99-497c-8107-ee15a2d4a430 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:50.292819 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ef497-4a99-497c-8107-ee15a2d4a430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:50.293095 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ef497-4a99-497c-8107-ee15a2d4a430 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:50.293824 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ef497-4a99-497c-8107-ee15a2d4a430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:42:50.296385 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ef497-4a99-497c-8107-ee15a2d4a430 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:42:50.306769 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1395/2804] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:42:50.310757 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7fb98a-a520-49f8-8814-12ad8424f0a4 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:42:50.323457 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7fb98a-a520-49f8-8814-12ad8424f0a4 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:42:50.328229 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7a3cf-98df-4696-a1cc-20dbc72bf7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:42:50.329151 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7a3cf-98df-4696-a1cc-20dbc72bf7c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:50.335181 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7a3cf-98df-4696-a1cc-20dbc72bf7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:50.335181 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7a3cf-98df-4696-a1cc-20dbc72bf7c7 admin admin] PATH_INFO: `/v3/projects/0fe4131eeb1247fb9ebb19cd49c04e93/users/888a0dbaa2214479b00b85d499997189/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:50.345085 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7a3cf-98df-4696-a1cc-20dbc72bf7c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fe4131eeb1247fb9ebb19cd49c04e93, user_id=888a0dbaa2214479b00b85d499997189, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:42:50.347780 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7a3cf-98df-4696-a1cc-20dbc72bf7c7 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:42:50.417284 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1410/2805] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:42:50 2022] PUT /identity/v3/projects/0fe4131eeb1247fb9ebb19cd49c04e93/users/888a0dbaa2214479b00b85d499997189/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:42:50.431883 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95babc-acc6-44b6-b4ad-f784a42b3ad1 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:50.432181 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95babc-acc6-44b6-b4ad-f784a42b3ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:50.432582 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95babc-acc6-44b6-b4ad-f784a42b3ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:50.460084 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-0a95babc-acc6-44b6-b4ad-f784a42b3ad1 None None] MFA Rules not processed for user `888a0dbaa2214479b00b85d499997189`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:42:50.461349 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-0a95babc-acc6-44b6-b4ad-f784a42b3ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:42:50.526836 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1396/2806] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:42:50 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:42:50.531209 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7a3cf-98df-4696-a1cc-20dbc72bf7c7 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:42:50.595076 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7a3cf-98df-4696-a1cc-20dbc72bf7c7 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:42:50.600172 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27253d22-ffbb-45cf-ad87-a6cd8897361b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:42:50.600824 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27253d22-ffbb-45cf-ad87-a6cd8897361b admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:50.601105 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27253d22-ffbb-45cf-ad87-a6cd8897361b admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:50.601380 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27253d22-ffbb-45cf-ad87-a6cd8897361b admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:50.602052 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27253d22-ffbb-45cf-ad87-a6cd8897361b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:42:50.603989 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27253d22-ffbb-45cf-ad87-a6cd8897361b admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:42:50.690404 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1411/2807] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:42:50 2022] POST /identity/v3/projects => generated 355 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:42:50.694770 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95babc-acc6-44b6-b4ad-f784a42b3ad1 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:42:50.705601 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95babc-acc6-44b6-b4ad-f784a42b3ad1 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:42:50.761841 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c61481-8df2-465d-8ba7-20b1de70b2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:42:50.762532 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c61481-8df2-465d-8ba7-20b1de70b2f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:50.762819 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c61481-8df2-465d-8ba7-20b1de70b2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:50.763094 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c61481-8df2-465d-8ba7-20b1de70b2f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:50.763818 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c61481-8df2-465d-8ba7-20b1de70b2f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:42:50.765762 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c61481-8df2-465d-8ba7-20b1de70b2f5 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:42:50.844041 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1397/2808] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:42:50 2022] POST /identity/v3/users => generated 284 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:42:50.848180 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27253d22-ffbb-45cf-ad87-a6cd8897361b admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:42:50.859224 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27253d22-ffbb-45cf-ad87-a6cd8897361b admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:42:50.863927 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d37727-f7ca-48a7-ba80-874c981cb968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:42:50.864584 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d37727-f7ca-48a7-ba80-874c981cb968 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:50.864864 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d37727-f7ca-48a7-ba80-874c981cb968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:50.865143 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d37727-f7ca-48a7-ba80-874c981cb968 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:50.865858 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d37727-f7ca-48a7-ba80-874c981cb968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:42:50.867463 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d37727-f7ca-48a7-ba80-874c981cb968 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:42:50.878305 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1412/2809] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:42:50.882501 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c61481-8df2-465d-8ba7-20b1de70b2f5 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:42:50.892621 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c61481-8df2-465d-8ba7-20b1de70b2f5 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:42:50.898056 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a899122-811a-41ff-811f-d9f3227a7806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:42:50.898934 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a899122-811a-41ff-811f-d9f3227a7806 admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:50.899218 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a899122-811a-41ff-811f-d9f3227a7806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:50.899755 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a899122-811a-41ff-811f-d9f3227a7806 admin admin] PATH_INFO: `/v3/projects/d31e9555f1604244b029b3481f2a381c/users/18b431bef628475f83f06e8685ce4c66/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:50.915485 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a899122-811a-41ff-811f-d9f3227a7806 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d31e9555f1604244b029b3481f2a381c, user_id=18b431bef628475f83f06e8685ce4c66, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:42:50.918214 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a899122-811a-41ff-811f-d9f3227a7806 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:42:51.015016 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1398/2810] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:42:50 2022] PUT /identity/v3/projects/d31e9555f1604244b029b3481f2a381c/users/18b431bef628475f83f06e8685ce4c66/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:42:51.018988 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d37727-f7ca-48a7-ba80-874c981cb968 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:42:51.029234 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d37727-f7ca-48a7-ba80-874c981cb968 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:42:51.066930 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:42:51.086077 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a26df-187c-4bc3-b9f2-b01cafc61503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:42:51.086739 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a26df-187c-4bc3-b9f2-b01cafc61503 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:51.087020 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a26df-187c-4bc3-b9f2-b01cafc61503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:51.087293 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a26df-187c-4bc3-b9f2-b01cafc61503 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:51.088090 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a26df-187c-4bc3-b9f2-b01cafc61503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:42:51.089677 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a26df-187c-4bc3-b9f2-b01cafc61503 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:42:51.099573 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1413/2811] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:42:51.103678 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a899122-811a-41ff-811f-d9f3227a7806 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:42:51.114656 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a899122-811a-41ff-811f-d9f3227a7806 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:42:51.119526 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0339116-e884-4625-b526-d091ebd91944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:42:51.120404 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0339116-e884-4625-b526-d091ebd91944 admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:51.120690 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0339116-e884-4625-b526-d091ebd91944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:51.120970 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0339116-e884-4625-b526-d091ebd91944 admin admin] PATH_INFO: `/v3/projects/d31e9555f1604244b029b3481f2a381c/users/18b431bef628475f83f06e8685ce4c66/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:51.123000 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0339116-e884-4625-b526-d091ebd91944 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d31e9555f1604244b029b3481f2a381c, user_id=18b431bef628475f83f06e8685ce4c66, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:42:51.125746 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0339116-e884-4625-b526-d091ebd91944 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:42:51.132878 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:42:51.137277 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1399/2812] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:42:51 2022] PUT /identity/v3/projects/d31e9555f1604244b029b3481f2a381c/users/18b431bef628475f83f06e8685ce4c66/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:42:51.148983 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f3d3c-5244-40e8-a68d-60c6faf7f7ef None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:51.149303 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f3d3c-5244-40e8-a68d-60c6faf7f7ef None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:51.149609 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f3d3c-5244-40e8-a68d-60c6faf7f7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:51.176203 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-a82f3d3c-5244-40e8-a68d-60c6faf7f7ef None None] MFA Rules not processed for user `18b431bef628475f83f06e8685ce4c66`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:42:51.178197 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-a82f3d3c-5244-40e8-a68d-60c6faf7f7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:42:51.245681 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1414/2813] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:42:51 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:42:51.257744 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0339116-e884-4625-b526-d091ebd91944 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:42:51.259409 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-e0339116-e884-4625-b526-d091ebd91944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:42:51.316874 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0339116-e884-4625-b526-d091ebd91944 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:42:51.321519 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4d03f1-da00-464b-95d2-558e48941e71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:42:51.322114 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d03f1-da00-464b-95d2-558e48941e71 service cinder] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:51.322400 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d03f1-da00-464b-95d2-558e48941e71 service cinder] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:51.322680 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d03f1-da00-464b-95d2-558e48941e71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:51.339704 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4d03f1-da00-464b-95d2-558e48941e71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:42:51.341171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4d03f1-da00-464b-95d2-558e48941e71 service cinder] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:42:51.351087 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1400/2814] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:42:51 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:42:51.507106 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbecfc2-84c8-44d5-98c0-3e31c9aed9d1 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:51.507455 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbecfc2-84c8-44d5-98c0-3e31c9aed9d1 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:51.507748 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbecfc2-84c8-44d5-98c0-3e31c9aed9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:51.525935 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-bcbecfc2-84c8-44d5-98c0-3e31c9aed9d1 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:42:51.527153 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-bcbecfc2-84c8-44d5-98c0-3e31c9aed9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:42:51.548444 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4d03f1-da00-464b-95d2-558e48941e71 service cinder] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:42:51.549842 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-0d4d03f1-da00-464b-95d2-558e48941e71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:42:51.562137 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4d03f1-da00-464b-95d2-558e48941e71 service cinder] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:42:51.566056 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f17c73-fef7-4138-beed-b581d45eb999 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:42:51.566740 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f17c73-fef7-4138-beed-b581d45eb999 service cinder] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:51.567024 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f17c73-fef7-4138-beed-b581d45eb999 service cinder] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:51.567925 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f17c73-fef7-4138-beed-b581d45eb999 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:51.589775 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1415/2815] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Jul 21 19:42:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:42:51.605563 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbecfc2-84c8-44d5-98c0-3e31c9aed9d1 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:42:51.606858 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-bcbecfc2-84c8-44d5-98c0-3e31c9aed9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:42:51.625124 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f17c73-fef7-4138-beed-b581d45eb999 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:42:51.626553 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f17c73-fef7-4138-beed-b581d45eb999 service cinder] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:42:51.635972 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1401/2816] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:42:51 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:42:51.666006 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:42:51.682576 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbecfc2-84c8-44d5-98c0-3e31c9aed9d1 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:42:51.688299 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d2b31-5376-4165-a6fa-ceea82d61b38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:42:51.688982 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d2b31-5376-4165-a6fa-ceea82d61b38 service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:51.689268 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d2b31-5376-4165-a6fa-ceea82d61b38 service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:51.689548 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d2b31-5376-4165-a6fa-ceea82d61b38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:51.698933 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d2b31-5376-4165-a6fa-ceea82d61b38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:42:51.700586 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d2b31-5376-4165-a6fa-ceea82d61b38 service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:42:51.710665 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1416/2817] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:42:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 19:42:54.749906 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb851127-ca3a-443a-b357-a9bc7eb5da47 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:54.758453 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb851127-ca3a-443a-b357-a9bc7eb5da47 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:54.758453 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb851127-ca3a-443a-b357-a9bc7eb5da47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:54.769100 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-fb851127-ca3a-443a-b357-a9bc7eb5da47 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:42:54.770393 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-fb851127-ca3a-443a-b357-a9bc7eb5da47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:42:54.778187 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1402/2818] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Jul 21 19:42:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:42:54.793715 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d2b31-5376-4165-a6fa-ceea82d61b38 service nova] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:42:54.795245 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-058d2b31-5376-4165-a6fa-ceea82d61b38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:42:54.812540 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d2b31-5376-4165-a6fa-ceea82d61b38 service nova] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:42:54.818960 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87e7c2-0be4-4296-aa39-21db7cbcc30b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:42:54.823140 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87e7c2-0be4-4296-aa39-21db7cbcc30b service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:54.823140 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87e7c2-0be4-4296-aa39-21db7cbcc30b service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:54.823140 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87e7c2-0be4-4296-aa39-21db7cbcc30b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:54.828967 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df87e7c2-0be4-4296-aa39-21db7cbcc30b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:42:54.830596 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df87e7c2-0be4-4296-aa39-21db7cbcc30b service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:42:54.840324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1417/2819] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:42:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:42:57.962658 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922d64f-eb8e-428a-96b4-a33f408ae2ed None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:57.963145 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922d64f-eb8e-428a-96b4-a33f408ae2ed None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:57.963261 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922d64f-eb8e-428a-96b4-a33f408ae2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:57.982117 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-e922d64f-eb8e-428a-96b4-a33f408ae2ed None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:42:57.983363 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-e922d64f-eb8e-428a-96b4-a33f408ae2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:42:57.991911 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1403/2820] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Jul 21 19:42:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:42:58.007883 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87e7c2-0be4-4296-aa39-21db7cbcc30b service nova] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:42:58.019122 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87e7c2-0be4-4296-aa39-21db7cbcc30b service nova] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:42:58.025075 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df0d0d2-a280-4989-b7c5-ce9bf4423cc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:42:58.025876 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0d0d2-a280-4989-b7c5-ce9bf4423cc6 service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:42:58.026160 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0d0d2-a280-4989-b7c5-ce9bf4423cc6 service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:42:58.026436 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0d0d2-a280-4989-b7c5-ce9bf4423cc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:42:58.034758 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df0d0d2-a280-4989-b7c5-ce9bf4423cc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:42:58.036361 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df0d0d2-a280-4989-b7c5-ce9bf4423cc6 service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:42:58.046688 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1418/2821] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:42:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:43:07.977416 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=60 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:43:08.042276 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=18 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:43:08.920117 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922d64f-eb8e-428a-96b4-a33f408ae2ed None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:08.932267 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922d64f-eb8e-428a-96b4-a33f408ae2ed None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:08.938877 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4774f-5032-45b6-aad5-13b4ce7bed6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:08.940020 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4774f-5032-45b6-aad5-13b4ce7bed6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:08.940467 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4774f-5032-45b6-aad5-13b4ce7bed6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:08.940923 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4774f-5032-45b6-aad5-13b4ce7bed6c admin admin] PATH_INFO: `/v3/users/888a0dbaa2214479b00b85d499997189` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:08.942435 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4774f-5032-45b6-aad5-13b4ce7bed6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=888a0dbaa2214479b00b85d499997189)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:08.945919 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4774f-5032-45b6-aad5-13b4ce7bed6c admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:09.208116 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-deb4774f-5032-45b6-aad5-13b4ce7bed6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '888a0dbaa2214479b00b85d499997189'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:09.278194 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-deb4774f-5032-45b6-aad5-13b4ce7bed6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '888a0dbaa2214479b00b85d499997189'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:09.298288 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-deb4774f-5032-45b6-aad5-13b4ce7bed6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '888a0dbaa2214479b00b85d499997189'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:09.299407 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-deb4774f-5032-45b6-aad5-13b4ce7bed6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '888a0dbaa2214479b00b85d499997189'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:09.309914 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-deb4774f-5032-45b6-aad5-13b4ce7bed6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '888a0dbaa2214479b00b85d499997189'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:09.316108 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1404/2822] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:43:08 2022] DELETE /identity/v3/users/888a0dbaa2214479b00b85d499997189 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:43:09.321705 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8947cf8-1056-4a22-bd33-86bd52f96300 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:09.322389 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8947cf8-1056-4a22-bd33-86bd52f96300 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:09.322389 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8947cf8-1056-4a22-bd33-86bd52f96300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:09.340717 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-a8947cf8-1056-4a22-bd33-86bd52f96300 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:43:09.342123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-a8947cf8-1056-4a22-bd33-86bd52f96300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:43:09.416046 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1419/2823] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:43:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:43:09.426190 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4774f-5032-45b6-aad5-13b4ce7bed6c admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:09.427481 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-deb4774f-5032-45b6-aad5-13b4ce7bed6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:43:09.500132 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4774f-5032-45b6-aad5-13b4ce7bed6c admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:09.508127 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869248f-79b8-46d5-8f96-7eabf8617df2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:09.508888 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869248f-79b8-46d5-8f96-7eabf8617df2 service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:09.512273 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869248f-79b8-46d5-8f96-7eabf8617df2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:09.512774 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869248f-79b8-46d5-8f96-7eabf8617df2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:09.530187 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b869248f-79b8-46d5-8f96-7eabf8617df2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:09.533175 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b869248f-79b8-46d5-8f96-7eabf8617df2 service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:09.558960 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1405/2824] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:43:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:43:10.101875 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8947cf8-1056-4a22-bd33-86bd52f96300 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:10.103337 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-a8947cf8-1056-4a22-bd33-86bd52f96300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:43:10.115825 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8947cf8-1056-4a22-bd33-86bd52f96300 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:10.121243 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72180fe0-195d-45b1-b9bc-4d1ca7fbcc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:10.122127 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72180fe0-195d-45b1-b9bc-4d1ca7fbcc56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:10.122483 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72180fe0-195d-45b1-b9bc-4d1ca7fbcc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:10.122747 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72180fe0-195d-45b1-b9bc-4d1ca7fbcc56 admin admin] PATH_INFO: `/v3/projects/0fe4131eeb1247fb9ebb19cd49c04e93` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:10.124043 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72180fe0-195d-45b1-b9bc-4d1ca7fbcc56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fe4131eeb1247fb9ebb19cd49c04e93)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:10.126028 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72180fe0-195d-45b1-b9bc-4d1ca7fbcc56 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:10.260028 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-72180fe0-195d-45b1-b9bc-4d1ca7fbcc56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fe4131eeb1247fb9ebb19cd49c04e93', 'request_id': 'req-72180fe0-195d-45b1-b9bc-4d1ca7fbcc56'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:10.268944 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-72180fe0-195d-45b1-b9bc-4d1ca7fbcc56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fe4131eeb1247fb9ebb19cd49c04e93', 'request_id': 'req-72180fe0-195d-45b1-b9bc-4d1ca7fbcc56'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:10.381403 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-72180fe0-195d-45b1-b9bc-4d1ca7fbcc56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fe4131eeb1247fb9ebb19cd49c04e93', 'request_id': 'req-72180fe0-195d-45b1-b9bc-4d1ca7fbcc56'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:10.394275 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-72180fe0-195d-45b1-b9bc-4d1ca7fbcc56 admin admin] The token cache is being invalidate because project 0fe4131eeb1247fb9ebb19cd49c04e93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:43:10.394566 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-72180fe0-195d-45b1-b9bc-4d1ca7fbcc56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:10.395464 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-72180fe0-195d-45b1-b9bc-4d1ca7fbcc56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:10.397057 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1420/2825] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:43:10 2022] DELETE /identity/v3/projects/0fe4131eeb1247fb9ebb19cd49c04e93 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:43:10.401089 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869248f-79b8-46d5-8f96-7eabf8617df2 service neutron] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:10.411254 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869248f-79b8-46d5-8f96-7eabf8617df2 service neutron] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:10.476729 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e5b72-ea7d-46e4-94a2-3e07161444c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:10.477600 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e5b72-ea7d-46e4-94a2-3e07161444c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:10.477883 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e5b72-ea7d-46e4-94a2-3e07161444c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:10.478190 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e5b72-ea7d-46e4-94a2-3e07161444c7 admin admin] PATH_INFO: `/v3/users/18b431bef628475f83f06e8685ce4c66` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:10.479475 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02e5b72-ea7d-46e4-94a2-3e07161444c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18b431bef628475f83f06e8685ce4c66)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:10.481450 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02e5b72-ea7d-46e4-94a2-3e07161444c7 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:10.496839 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:43:10.651811 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-e02e5b72-ea7d-46e4-94a2-3e07161444c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18b431bef628475f83f06e8685ce4c66'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:10.712520 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-e02e5b72-ea7d-46e4-94a2-3e07161444c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18b431bef628475f83f06e8685ce4c66'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:10.725365 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-e02e5b72-ea7d-46e4-94a2-3e07161444c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18b431bef628475f83f06e8685ce4c66'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:10.726524 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-e02e5b72-ea7d-46e4-94a2-3e07161444c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18b431bef628475f83f06e8685ce4c66'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:10.733464 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-e02e5b72-ea7d-46e4-94a2-3e07161444c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18b431bef628475f83f06e8685ce4c66'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:10.739260 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1406/2826] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:43:10 2022] DELETE /identity/v3/users/18b431bef628475f83f06e8685ce4c66 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:43:11.262388 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72180fe0-195d-45b1-b9bc-4d1ca7fbcc56 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:11.263992 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-72180fe0-195d-45b1-b9bc-4d1ca7fbcc56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:43:11.283345 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72180fe0-195d-45b1-b9bc-4d1ca7fbcc56 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:11.344220 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca9ac1-4998-4f84-8c3e-876ffd9215af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:11.345093 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca9ac1-4998-4f84-8c3e-876ffd9215af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:11.345378 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca9ac1-4998-4f84-8c3e-876ffd9215af admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:11.345657 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca9ac1-4998-4f84-8c3e-876ffd9215af admin admin] PATH_INFO: `/v3/projects/d31e9555f1604244b029b3481f2a381c` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:11.346858 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca9ac1-4998-4f84-8c3e-876ffd9215af admin admin] RBAC: Authorizing `identity:delete_project(project_id=d31e9555f1604244b029b3481f2a381c)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:11.348877 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca9ac1-4998-4f84-8c3e-876ffd9215af admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:11.439781 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:43:11.457364 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ccca9ac1-4998-4f84-8c3e-876ffd9215af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd31e9555f1604244b029b3481f2a381c', 'request_id': 'req-ccca9ac1-4998-4f84-8c3e-876ffd9215af'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:11.464260 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ccca9ac1-4998-4f84-8c3e-876ffd9215af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd31e9555f1604244b029b3481f2a381c', 'request_id': 'req-ccca9ac1-4998-4f84-8c3e-876ffd9215af'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:11.551398 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ccca9ac1-4998-4f84-8c3e-876ffd9215af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd31e9555f1604244b029b3481f2a381c', 'request_id': 'req-ccca9ac1-4998-4f84-8c3e-876ffd9215af'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:11.562289 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ccca9ac1-4998-4f84-8c3e-876ffd9215af admin admin] The token cache is being invalidate because project d31e9555f1604244b029b3481f2a381c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:43:11.562792 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ccca9ac1-4998-4f84-8c3e-876ffd9215af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:11.563910 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ccca9ac1-4998-4f84-8c3e-876ffd9215af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:11.565487 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1421/2827] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:43:11 2022] DELETE /identity/v3/projects/d31e9555f1604244b029b3481f2a381c => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:43:11.572460 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264d6aa-0146-48bd-ba92-0411efd7d373 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:11.572945 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264d6aa-0146-48bd-ba92-0411efd7d373 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:11.573044 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264d6aa-0146-48bd-ba92-0411efd7d373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:11.591688 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-f264d6aa-0146-48bd-ba92-0411efd7d373 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:43:11.592901 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-f264d6aa-0146-48bd-ba92-0411efd7d373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:43:11.655068 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1407/2828] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:43:11.663767 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623da8bb-4826-4645-883c-4e04924ce837 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:11.664064 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623da8bb-4826-4645-883c-4e04924ce837 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:11.664495 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623da8bb-4826-4645-883c-4e04924ce837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:11.684867 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-623da8bb-4826-4645-883c-4e04924ce837 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:43:11.686098 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-623da8bb-4826-4645-883c-4e04924ce837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:43:11.694405 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1422/2829] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:43:11.699521 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264d6aa-0146-48bd-ba92-0411efd7d373 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:11.709099 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264d6aa-0146-48bd-ba92-0411efd7d373 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:11.714093 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b976c-0c9a-442e-8421-f08a3844466a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:11.714744 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b976c-0c9a-442e-8421-f08a3844466a admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:11.715028 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b976c-0c9a-442e-8421-f08a3844466a admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:11.715305 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b976c-0c9a-442e-8421-f08a3844466a admin admin] PATH_INFO: `/v3/domains` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:11.716065 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b976c-0c9a-442e-8421-f08a3844466a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:43:11.716409 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b976c-0c9a-442e-8421-f08a3844466a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:11.717989 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b976c-0c9a-442e-8421-f08a3844466a admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:11.729845 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1408/2830] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:43:11.734095 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623da8bb-4826-4645-883c-4e04924ce837 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:11.744419 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623da8bb-4826-4645-883c-4e04924ce837 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:11.749177 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c1f64-2afb-41cd-aba2-c8bd9d1d3ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:11.749840 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c1f64-2afb-41cd-aba2-c8bd9d1d3ea0 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:11.750123 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c1f64-2afb-41cd-aba2-c8bd9d1d3ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:11.750398 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c1f64-2afb-41cd-aba2-c8bd9d1d3ea0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:11.751087 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c1f64-2afb-41cd-aba2-c8bd9d1d3ea0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:11.753014 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c1f64-2afb-41cd-aba2-c8bd9d1d3ea0 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:11.828769 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1423/2831] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:43:11 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:43:11.833102 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b976c-0c9a-442e-8421-f08a3844466a admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:11.852410 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b976c-0c9a-442e-8421-f08a3844466a admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:11.910565 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece10437-f88a-4c66-8ea2-a7431d58377d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:11.911375 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece10437-f88a-4c66-8ea2-a7431d58377d admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:11.911900 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece10437-f88a-4c66-8ea2-a7431d58377d admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:11.912284 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece10437-f88a-4c66-8ea2-a7431d58377d admin admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:11.913073 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece10437-f88a-4c66-8ea2-a7431d58377d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:11.915131 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece10437-f88a-4c66-8ea2-a7431d58377d admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:11.998626 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1409/2832] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:43:11 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:43:12.003060 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c1f64-2afb-41cd-aba2-c8bd9d1d3ea0 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:12.014340 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c1f64-2afb-41cd-aba2-c8bd9d1d3ea0 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:12.019100 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319573f7-b898-4772-81bb-72e0b7c0db54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:12.019789 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319573f7-b898-4772-81bb-72e0b7c0db54 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:12.020075 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319573f7-b898-4772-81bb-72e0b7c0db54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:12.020352 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319573f7-b898-4772-81bb-72e0b7c0db54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:12.021073 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319573f7-b898-4772-81bb-72e0b7c0db54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:12.022703 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319573f7-b898-4772-81bb-72e0b7c0db54 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:12.033341 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1424/2833] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:43:12.037440 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece10437-f88a-4c66-8ea2-a7431d58377d admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:12.048054 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece10437-f88a-4c66-8ea2-a7431d58377d admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:12.052589 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7150bdb-f39b-4d88-990f-f92bbdabaf60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:12.053408 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7150bdb-f39b-4d88-990f-f92bbdabaf60 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:12.053697 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7150bdb-f39b-4d88-990f-f92bbdabaf60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:12.053970 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7150bdb-f39b-4d88-990f-f92bbdabaf60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:12.055392 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7150bdb-f39b-4d88-990f-f92bbdabaf60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:12.056978 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7150bdb-f39b-4d88-990f-f92bbdabaf60 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:12.062171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:43:12.067837 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1410/2834] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:43:12.072799 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319573f7-b898-4772-81bb-72e0b7c0db54 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:12.083793 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319573f7-b898-4772-81bb-72e0b7c0db54 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:12.088831 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70f418-1093-4107-b8e6-75e4fbf09bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:12.089707 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70f418-1093-4107-b8e6-75e4fbf09bd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:12.089986 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70f418-1093-4107-b8e6-75e4fbf09bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:12.090260 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70f418-1093-4107-b8e6-75e4fbf09bd9 admin admin] PATH_INFO: `/v3/projects/c1b519507ca9406eb52531deab8e7139/users/38e8e99cb42746d68cee61407a574c57/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:12.106755 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70f418-1093-4107-b8e6-75e4fbf09bd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1b519507ca9406eb52531deab8e7139, user_id=38e8e99cb42746d68cee61407a574c57, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:12.109345 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70f418-1093-4107-b8e6-75e4fbf09bd9 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:12.180514 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1425/2835] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:43:12 2022] PUT /identity/v3/projects/c1b519507ca9406eb52531deab8e7139/users/38e8e99cb42746d68cee61407a574c57/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:43:12.192216 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9787e9c-ef61-4ee9-80b8-193412998d5c None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:12.192511 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9787e9c-ef61-4ee9-80b8-193412998d5c None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:12.192791 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9787e9c-ef61-4ee9-80b8-193412998d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:12.219417 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-b9787e9c-ef61-4ee9-80b8-193412998d5c None None] MFA Rules not processed for user `38e8e99cb42746d68cee61407a574c57`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:43:12.220785 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-b9787e9c-ef61-4ee9-80b8-193412998d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:43:12.285263 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1411/2836] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:43:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:43:12.290500 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70f418-1093-4107-b8e6-75e4fbf09bd9 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:12.351973 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70f418-1093-4107-b8e6-75e4fbf09bd9 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:12.357173 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a409a20-8f70-47ba-864a-b92e4bd6d323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:12.357821 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a409a20-8f70-47ba-864a-b92e4bd6d323 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:12.358113 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a409a20-8f70-47ba-864a-b92e4bd6d323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:12.358423 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a409a20-8f70-47ba-864a-b92e4bd6d323 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:12.359153 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a409a20-8f70-47ba-864a-b92e4bd6d323 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:12.361233 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a409a20-8f70-47ba-864a-b92e4bd6d323 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:12.439542 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1426/2837] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:43:12 2022] POST /identity/v3/projects => generated 385 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:43:12.443606 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9787e9c-ef61-4ee9-80b8-193412998d5c None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:12.454854 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9787e9c-ef61-4ee9-80b8-193412998d5c None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:12.510578 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3208d427-40e2-4380-b70b-9d8d36d022eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:12.511250 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208d427-40e2-4380-b70b-9d8d36d022eb admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:12.511586 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208d427-40e2-4380-b70b-9d8d36d022eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:12.511888 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208d427-40e2-4380-b70b-9d8d36d022eb admin admin] PATH_INFO: `/v3/users` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:12.512623 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3208d427-40e2-4380-b70b-9d8d36d022eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:12.514590 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3208d427-40e2-4380-b70b-9d8d36d022eb admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:12.609499 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1412/2838] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:43:12 2022] POST /identity/v3/users => generated 299 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:43:12.613452 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a409a20-8f70-47ba-864a-b92e4bd6d323 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:12.624562 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a409a20-8f70-47ba-864a-b92e4bd6d323 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:12.629225 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d50e7-4741-4e35-ac6a-5c745bc39254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:12.629888 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d50e7-4741-4e35-ac6a-5c745bc39254 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:12.630170 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d50e7-4741-4e35-ac6a-5c745bc39254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:12.630447 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d50e7-4741-4e35-ac6a-5c745bc39254 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:12.631170 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d50e7-4741-4e35-ac6a-5c745bc39254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:12.632836 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d50e7-4741-4e35-ac6a-5c745bc39254 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:12.643796 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1427/2839] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 19:43:12.648571 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3208d427-40e2-4380-b70b-9d8d36d022eb admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:12.658632 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3208d427-40e2-4380-b70b-9d8d36d022eb admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:12.663297 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01c8c1-a804-4b5f-85ab-39a1e7253b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:12.664796 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01c8c1-a804-4b5f-85ab-39a1e7253b09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:12.665078 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01c8c1-a804-4b5f-85ab-39a1e7253b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:12.665356 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01c8c1-a804-4b5f-85ab-39a1e7253b09 admin admin] PATH_INFO: `/v3/projects/bd050cadeb3944ff8371718eebc2fbbb/users/58ea2789c7954dc0a9dd087a0f5caa51/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:12.680607 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01c8c1-a804-4b5f-85ab-39a1e7253b09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd050cadeb3944ff8371718eebc2fbbb, user_id=58ea2789c7954dc0a9dd087a0f5caa51, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:12.683245 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01c8c1-a804-4b5f-85ab-39a1e7253b09 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:12.792629 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1413/2840] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:43:12 2022] PUT /identity/v3/projects/bd050cadeb3944ff8371718eebc2fbbb/users/58ea2789c7954dc0a9dd087a0f5caa51/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:43:12.796522 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d50e7-4741-4e35-ac6a-5c745bc39254 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:12.806726 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d50e7-4741-4e35-ac6a-5c745bc39254 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:12.827244 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:43:12.865012 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639a5b2-7ac8-4a97-b78a-ccb71197ad0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:12.865615 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639a5b2-7ac8-4a97-b78a-ccb71197ad0a admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:12.865906 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639a5b2-7ac8-4a97-b78a-ccb71197ad0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:12.866190 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639a5b2-7ac8-4a97-b78a-ccb71197ad0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:12.867000 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639a5b2-7ac8-4a97-b78a-ccb71197ad0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:12.868665 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639a5b2-7ac8-4a97-b78a-ccb71197ad0a admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:12.878983 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1428/2841] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:43:12.883866 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01c8c1-a804-4b5f-85ab-39a1e7253b09 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:12.901573 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01c8c1-a804-4b5f-85ab-39a1e7253b09 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:12.907705 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96157cbd-f57d-417b-beb1-167c357cf9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:12.908721 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96157cbd-f57d-417b-beb1-167c357cf9b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:12.909040 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96157cbd-f57d-417b-beb1-167c357cf9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:12.909405 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96157cbd-f57d-417b-beb1-167c357cf9b8 admin admin] PATH_INFO: `/v3/projects/bd050cadeb3944ff8371718eebc2fbbb/users/58ea2789c7954dc0a9dd087a0f5caa51/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:12.911729 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96157cbd-f57d-417b-beb1-167c357cf9b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd050cadeb3944ff8371718eebc2fbbb, user_id=58ea2789c7954dc0a9dd087a0f5caa51, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:12.914864 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96157cbd-f57d-417b-beb1-167c357cf9b8 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:12.927599 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1414/2842] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:43:12 2022] PUT /identity/v3/projects/bd050cadeb3944ff8371718eebc2fbbb/users/58ea2789c7954dc0a9dd087a0f5caa51/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:43:12.938179 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df76d76-6e7d-4f58-9273-1ecdcb96b3bf None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:12.938179 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df76d76-6e7d-4f58-9273-1ecdcb96b3bf None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:12.938392 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df76d76-6e7d-4f58-9273-1ecdcb96b3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:12.967817 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-5df76d76-6e7d-4f58-9273-1ecdcb96b3bf None None] MFA Rules not processed for user `58ea2789c7954dc0a9dd087a0f5caa51`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:43:12.969025 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-5df76d76-6e7d-4f58-9273-1ecdcb96b3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:43:13.050740 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1429/2843] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:43:12 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:43:13.061835 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96157cbd-f57d-417b-beb1-167c357cf9b8 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:13.063597 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-96157cbd-f57d-417b-beb1-167c357cf9b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:43:13.115342 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:43:13.127363 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96157cbd-f57d-417b-beb1-167c357cf9b8 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:13.131016 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee776c-ba4b-4331-b25c-6533a6169337 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:13.131700 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee776c-ba4b-4331-b25c-6533a6169337 service cinder] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:13.131986 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee776c-ba4b-4331-b25c-6533a6169337 service cinder] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:13.132758 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee776c-ba4b-4331-b25c-6533a6169337 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:13.194938 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee776c-ba4b-4331-b25c-6533a6169337 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:13.197384 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee776c-ba4b-4331-b25c-6533a6169337 service cinder] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:13.207163 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1415/2844] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:43:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:43:14.353794 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4a611-6daf-4c5f-8923-2212e6a423a4 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:14.354303 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4a611-6daf-4c5f-8923-2212e6a423a4 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:14.354422 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4a611-6daf-4c5f-8923-2212e6a423a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:14.372265 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-b0a4a611-6daf-4c5f-8923-2212e6a423a4 None None] MFA Rules not processed for user `a82b2dc882994ef9bc7ffca3ff25e988`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:43:14.373509 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-b0a4a611-6daf-4c5f-8923-2212e6a423a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:43:14.437555 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1430/2845] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:43:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:43:14.948898 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2392c1-d636-41b7-8d01-4d573e852a5c None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:14.949384 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2392c1-d636-41b7-8d01-4d573e852a5c None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:14.949494 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2392c1-d636-41b7-8d01-4d573e852a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:14.967390 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-5d2392c1-d636-41b7-8d01-4d573e852a5c None None] MFA Rules not processed for user `22d11b8e390e4b9db3b84c419266c4b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:43:14.968895 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-5d2392c1-d636-41b7-8d01-4d573e852a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:43:15.029196 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1416/2846] 10.222.0.60 () {58 vars in 967 bytes} [Thu Jul 21 19:43:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:43:15.197217 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a4a611-6daf-4c5f-8923-2212e6a423a4 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:15.199076 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-b0a4a611-6daf-4c5f-8923-2212e6a423a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:43:15.254811 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:43:15.274448 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a4a611-6daf-4c5f-8923-2212e6a423a4 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:15.279687 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191abd0-5ffe-4e3a-93d1-5867ca78dfd5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa579af53a6441a9205cf82864a640e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:15.280342 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191abd0-5ffe-4e3a-93d1-5867ca78dfd5 service swift] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:15.280633 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191abd0-5ffe-4e3a-93d1-5867ca78dfd5 service swift] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:15.280922 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191abd0-5ffe-4e3a-93d1-5867ca78dfd5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:15.290171 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0191abd0-5ffe-4e3a-93d1-5867ca78dfd5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:15.291815 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0191abd0-5ffe-4e3a-93d1-5867ca78dfd5 service swift] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:15.299969 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1431/2847] 10.222.0.60 () {60 vars in 1384 bytes} [Thu Jul 21 19:43:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 19:43:18.345558 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2392c1-d636-41b7-8d01-4d573e852a5c None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:18.347113 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-5d2392c1-d636-41b7-8d01-4d573e852a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:43:18.361506 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2392c1-d636-41b7-8d01-4d573e852a5c None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:18.367697 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335a191-723d-433b-9a84-0a2a4c8c7d96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:18.368652 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335a191-723d-433b-9a84-0a2a4c8c7d96 service cinder] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:18.369135 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335a191-723d-433b-9a84-0a2a4c8c7d96 service cinder] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:18.369875 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335a191-723d-433b-9a84-0a2a4c8c7d96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:18.381467 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8335a191-723d-433b-9a84-0a2a4c8c7d96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:18.383742 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8335a191-723d-433b-9a84-0a2a4c8c7d96 service cinder] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:18.413985 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1417/2848] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:43:18 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:43:24.268192 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191abd0-5ffe-4e3a-93d1-5867ca78dfd5 service swift] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:24.336249 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191abd0-5ffe-4e3a-93d1-5867ca78dfd5 service swift] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:24.340833 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451eb0c1-a2cb-4ae3-ab2e-e2f485a6aab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:24.341705 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451eb0c1-a2cb-4ae3-ab2e-e2f485a6aab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:24.341990 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451eb0c1-a2cb-4ae3-ab2e-e2f485a6aab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:24.342267 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451eb0c1-a2cb-4ae3-ab2e-e2f485a6aab8 admin admin] PATH_INFO: `/v3/users/38e8e99cb42746d68cee61407a574c57` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:24.343463 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451eb0c1-a2cb-4ae3-ab2e-e2f485a6aab8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38e8e99cb42746d68cee61407a574c57)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:24.345491 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451eb0c1-a2cb-4ae3-ab2e-e2f485a6aab8 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:24.359822 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335a191-723d-433b-9a84-0a2a4c8c7d96 service cinder] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:24.360786 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-8335a191-723d-433b-9a84-0a2a4c8c7d96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:43:24.378191 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335a191-723d-433b-9a84-0a2a4c8c7d96 service cinder] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:24.383533 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01055249-c43f-4f9e-be6e-3a7dd2f07248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:24.384408 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01055249-c43f-4f9e-be6e-3a7dd2f07248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:24.384696 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01055249-c43f-4f9e-be6e-3a7dd2f07248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:24.384975 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01055249-c43f-4f9e-be6e-3a7dd2f07248 admin admin] PATH_INFO: `/v3/users/2b357a9f007242c2b5eeaf70ae972907` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:24.386175 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01055249-c43f-4f9e-be6e-3a7dd2f07248 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b357a9f007242c2b5eeaf70ae972907)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:24.388174 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01055249-c43f-4f9e-be6e-3a7dd2f07248 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:24.554545 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-451eb0c1-a2cb-4ae3-ab2e-e2f485a6aab8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38e8e99cb42746d68cee61407a574c57'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:24.576573 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-01055249-c43f-4f9e-be6e-3a7dd2f07248 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b357a9f007242c2b5eeaf70ae972907'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:24.614370 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-451eb0c1-a2cb-4ae3-ab2e-e2f485a6aab8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38e8e99cb42746d68cee61407a574c57'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:24.614995 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-451eb0c1-a2cb-4ae3-ab2e-e2f485a6aab8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38e8e99cb42746d68cee61407a574c57'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:24.623188 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-451eb0c1-a2cb-4ae3-ab2e-e2f485a6aab8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38e8e99cb42746d68cee61407a574c57'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:24.637930 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-451eb0c1-a2cb-4ae3-ab2e-e2f485a6aab8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38e8e99cb42746d68cee61407a574c57'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:24.644762 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1432/2849] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:43:24 2022] DELETE /identity/v3/users/38e8e99cb42746d68cee61407a574c57 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:43:24.650055 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2603e7d-9ad1-4f65-bcf7-def4dac4261f None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:24.650383 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2603e7d-9ad1-4f65-bcf7-def4dac4261f None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:24.650942 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2603e7d-9ad1-4f65-bcf7-def4dac4261f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:24.669428 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-b2603e7d-9ad1-4f65-bcf7-def4dac4261f None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:43:24.670661 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-b2603e7d-9ad1-4f65-bcf7-def4dac4261f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:43:24.689341 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-01055249-c43f-4f9e-be6e-3a7dd2f07248 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b357a9f007242c2b5eeaf70ae972907'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:24.702993 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-01055249-c43f-4f9e-be6e-3a7dd2f07248 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b357a9f007242c2b5eeaf70ae972907'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:24.703826 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-01055249-c43f-4f9e-be6e-3a7dd2f07248 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b357a9f007242c2b5eeaf70ae972907'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:24.711727 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-01055249-c43f-4f9e-be6e-3a7dd2f07248 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b357a9f007242c2b5eeaf70ae972907'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:24.714241 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:43:24.718644 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1418/2850] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:43:24 2022] DELETE /identity/v3/users/2b357a9f007242c2b5eeaf70ae972907 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:43:24.726454 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:43:24.735474 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1433/2851] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:43:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:43:24.751231 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01055249-c43f-4f9e-be6e-3a7dd2f07248 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:24.752752 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-01055249-c43f-4f9e-be6e-3a7dd2f07248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:43:24.821404 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01055249-c43f-4f9e-be6e-3a7dd2f07248 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:24.825741 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f7227-5d55-4907-ba7e-7273f54ebb5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:24.826708 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f7227-5d55-4907-ba7e-7273f54ebb5e service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:24.827233 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f7227-5d55-4907-ba7e-7273f54ebb5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:24.827769 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f7227-5d55-4907-ba7e-7273f54ebb5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:24.908595 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f7227-5d55-4907-ba7e-7273f54ebb5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:24.910002 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f7227-5d55-4907-ba7e-7273f54ebb5e service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:24.922121 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1419/2852] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:43:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 19:43:25.096163 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2603e7d-9ad1-4f65-bcf7-def4dac4261f None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:25.097729 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-b2603e7d-9ad1-4f65-bcf7-def4dac4261f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:43:25.112152 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2603e7d-9ad1-4f65-bcf7-def4dac4261f None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:25.117399 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe27f0-1ed0-4c43-a582-827b1751c945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:25.118423 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe27f0-1ed0-4c43-a582-827b1751c945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:25.118715 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe27f0-1ed0-4c43-a582-827b1751c945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:25.119059 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe27f0-1ed0-4c43-a582-827b1751c945 admin admin] PATH_INFO: `/v3/projects/fb11b65e90a94804b50e88ad0bce8ae8` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:25.120466 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe27f0-1ed0-4c43-a582-827b1751c945 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb11b65e90a94804b50e88ad0bce8ae8)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:25.126248 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe27f0-1ed0-4c43-a582-827b1751c945 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:25.392569 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-7cbe27f0-1ed0-4c43-a582-827b1751c945 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb11b65e90a94804b50e88ad0bce8ae8', 'request_id': 'req-7cbe27f0-1ed0-4c43-a582-827b1751c945'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:25.402355 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-7cbe27f0-1ed0-4c43-a582-827b1751c945 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb11b65e90a94804b50e88ad0bce8ae8', 'request_id': 'req-7cbe27f0-1ed0-4c43-a582-827b1751c945'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:25.523871 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-7cbe27f0-1ed0-4c43-a582-827b1751c945 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb11b65e90a94804b50e88ad0bce8ae8', 'request_id': 'req-7cbe27f0-1ed0-4c43-a582-827b1751c945'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:25.535671 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-7cbe27f0-1ed0-4c43-a582-827b1751c945 admin admin] The token cache is being invalidate because project fb11b65e90a94804b50e88ad0bce8ae8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:43:25.535964 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-7cbe27f0-1ed0-4c43-a582-827b1751c945 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:25.536629 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-7cbe27f0-1ed0-4c43-a582-827b1751c945 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:25.538731 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1434/2853] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:43:25 2022] DELETE /identity/v3/projects/fb11b65e90a94804b50e88ad0bce8ae8 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:43:25.542884 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f7227-5d55-4907-ba7e-7273f54ebb5e service neutron] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:25.555561 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f7227-5d55-4907-ba7e-7273f54ebb5e service neutron] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:25.566109 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe27f0-1ed0-4c43-a582-827b1751c945 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:25.567194 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-7cbe27f0-1ed0-4c43-a582-827b1751c945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:43:25.628650 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796bb2b6-f5f6-435c-88f7-69bb4820a5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:25.629456 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bb2b6-f5f6-435c-88f7-69bb4820a5f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:25.629747 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bb2b6-f5f6-435c-88f7-69bb4820a5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:25.630024 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bb2b6-f5f6-435c-88f7-69bb4820a5f2 admin admin] PATH_INFO: `/v3/users/bfc2ad8dd5e34343b488483469ba7d96` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:25.631373 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796bb2b6-f5f6-435c-88f7-69bb4820a5f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfc2ad8dd5e34343b488483469ba7d96)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:25.633436 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796bb2b6-f5f6-435c-88f7-69bb4820a5f2 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:25.637481 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe27f0-1ed0-4c43-a582-827b1751c945 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:25.642249 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b452f99-40c4-4e5a-bd48-a8056fa767d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:25.643126 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b452f99-40c4-4e5a-bd48-a8056fa767d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:25.643412 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b452f99-40c4-4e5a-bd48-a8056fa767d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:25.643723 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b452f99-40c4-4e5a-bd48-a8056fa767d1 admin admin] PATH_INFO: `/v3/projects/c1b519507ca9406eb52531deab8e7139` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:25.645125 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b452f99-40c4-4e5a-bd48-a8056fa767d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1b519507ca9406eb52531deab8e7139)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:25.647120 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b452f99-40c4-4e5a-bd48-a8056fa767d1 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:25.886578 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-1b452f99-40c4-4e5a-bd48-a8056fa767d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1b519507ca9406eb52531deab8e7139', 'request_id': 'req-1b452f99-40c4-4e5a-bd48-a8056fa767d1'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:25.889473 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-796bb2b6-f5f6-435c-88f7-69bb4820a5f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfc2ad8dd5e34343b488483469ba7d96'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:25.892880 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-1b452f99-40c4-4e5a-bd48-a8056fa767d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1b519507ca9406eb52531deab8e7139', 'request_id': 'req-1b452f99-40c4-4e5a-bd48-a8056fa767d1'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:25.894519 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:43:26.003372 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-796bb2b6-f5f6-435c-88f7-69bb4820a5f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfc2ad8dd5e34343b488483469ba7d96'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:26.017997 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-796bb2b6-f5f6-435c-88f7-69bb4820a5f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfc2ad8dd5e34343b488483469ba7d96'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:26.018953 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-796bb2b6-f5f6-435c-88f7-69bb4820a5f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfc2ad8dd5e34343b488483469ba7d96'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:26.028561 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-796bb2b6-f5f6-435c-88f7-69bb4820a5f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfc2ad8dd5e34343b488483469ba7d96'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:26.039042 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1420/2854] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:43:25 2022] DELETE /identity/v3/users/bfc2ad8dd5e34343b488483469ba7d96 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:43:26.117664 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-1b452f99-40c4-4e5a-bd48-a8056fa767d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1b519507ca9406eb52531deab8e7139', 'request_id': 'req-1b452f99-40c4-4e5a-bd48-a8056fa767d1'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:26.137959 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-1b452f99-40c4-4e5a-bd48-a8056fa767d1 admin admin] The token cache is being invalidate because project c1b519507ca9406eb52531deab8e7139 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:43:26.138183 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-1b452f99-40c4-4e5a-bd48-a8056fa767d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:26.138856 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-1b452f99-40c4-4e5a-bd48-a8056fa767d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:26.140470 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1435/2855] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:43:25 2022] DELETE /identity/v3/projects/c1b519507ca9406eb52531deab8e7139 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:43:26.144579 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796bb2b6-f5f6-435c-88f7-69bb4820a5f2 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:26.146350 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-796bb2b6-f5f6-435c-88f7-69bb4820a5f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:43:26.228611 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796bb2b6-f5f6-435c-88f7-69bb4820a5f2 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:26.233542 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dadf25a-b7cd-47ab-a8aa-eada1251f29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:26.234536 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dadf25a-b7cd-47ab-a8aa-eada1251f29b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:26.234995 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dadf25a-b7cd-47ab-a8aa-eada1251f29b admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:26.235363 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dadf25a-b7cd-47ab-a8aa-eada1251f29b admin admin] PATH_INFO: `/v3/users/58ea2789c7954dc0a9dd087a0f5caa51` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:26.236720 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dadf25a-b7cd-47ab-a8aa-eada1251f29b admin admin] RBAC: Authorizing `identity:delete_user(user_id=58ea2789c7954dc0a9dd087a0f5caa51)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:26.238994 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dadf25a-b7cd-47ab-a8aa-eada1251f29b admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:26.388869 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b452f99-40c4-4e5a-bd48-a8056fa767d1 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:26.390406 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-1b452f99-40c4-4e5a-bd48-a8056fa767d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:43:26.406754 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:43:26.446710 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-0dadf25a-b7cd-47ab-a8aa-eada1251f29b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58ea2789c7954dc0a9dd087a0f5caa51'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:26.461774 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b452f99-40c4-4e5a-bd48-a8056fa767d1 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:26.466523 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b24d3c-7bcc-4cee-b160-8ec2a315ae20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:26.473346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b24d3c-7bcc-4cee-b160-8ec2a315ae20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:26.473346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b24d3c-7bcc-4cee-b160-8ec2a315ae20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:26.473346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b24d3c-7bcc-4cee-b160-8ec2a315ae20 admin admin] PATH_INFO: `/v3/projects/f53956d4dce5484289008579f34652fc` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:26.473346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b24d3c-7bcc-4cee-b160-8ec2a315ae20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f53956d4dce5484289008579f34652fc)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:26.473346 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b24d3c-7bcc-4cee-b160-8ec2a315ae20 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:26.512167 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-0dadf25a-b7cd-47ab-a8aa-eada1251f29b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58ea2789c7954dc0a9dd087a0f5caa51'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:26.525908 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-0dadf25a-b7cd-47ab-a8aa-eada1251f29b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58ea2789c7954dc0a9dd087a0f5caa51'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:26.526637 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-0dadf25a-b7cd-47ab-a8aa-eada1251f29b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58ea2789c7954dc0a9dd087a0f5caa51'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:26.533620 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-0dadf25a-b7cd-47ab-a8aa-eada1251f29b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58ea2789c7954dc0a9dd087a0f5caa51'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:26.539961 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1421/2856] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:43:26 2022] DELETE /identity/v3/users/58ea2789c7954dc0a9dd087a0f5caa51 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:43:26.611030 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-47b24d3c-7bcc-4cee-b160-8ec2a315ae20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f53956d4dce5484289008579f34652fc', 'request_id': 'req-47b24d3c-7bcc-4cee-b160-8ec2a315ae20'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:26.620551 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-47b24d3c-7bcc-4cee-b160-8ec2a315ae20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f53956d4dce5484289008579f34652fc', 'request_id': 'req-47b24d3c-7bcc-4cee-b160-8ec2a315ae20'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:26.718171 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-47b24d3c-7bcc-4cee-b160-8ec2a315ae20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f53956d4dce5484289008579f34652fc', 'request_id': 'req-47b24d3c-7bcc-4cee-b160-8ec2a315ae20'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:26.731132 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-47b24d3c-7bcc-4cee-b160-8ec2a315ae20 admin admin] The token cache is being invalidate because project f53956d4dce5484289008579f34652fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:43:26.731132 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-47b24d3c-7bcc-4cee-b160-8ec2a315ae20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:26.732494 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-47b24d3c-7bcc-4cee-b160-8ec2a315ae20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:26.733865 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1436/2857] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:43:26 2022] DELETE /identity/v3/projects/f53956d4dce5484289008579f34652fc => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:43:27.262978 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dadf25a-b7cd-47ab-a8aa-eada1251f29b admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:27.264676 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-0dadf25a-b7cd-47ab-a8aa-eada1251f29b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:43:27.345114 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dadf25a-b7cd-47ab-a8aa-eada1251f29b admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:27.409478 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd33bf-07a7-4a11-b23a-e5971d14724e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:27.410405 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd33bf-07a7-4a11-b23a-e5971d14724e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:27.410690 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd33bf-07a7-4a11-b23a-e5971d14724e admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:27.410964 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd33bf-07a7-4a11-b23a-e5971d14724e admin admin] PATH_INFO: `/v3/projects/bd050cadeb3944ff8371718eebc2fbbb` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:27.412363 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd33bf-07a7-4a11-b23a-e5971d14724e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd050cadeb3944ff8371718eebc2fbbb)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:27.414527 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd33bf-07a7-4a11-b23a-e5971d14724e admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:27.542113 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-50bd33bf-07a7-4a11-b23a-e5971d14724e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd050cadeb3944ff8371718eebc2fbbb', 'request_id': 'req-50bd33bf-07a7-4a11-b23a-e5971d14724e'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:27.626294 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-50bd33bf-07a7-4a11-b23a-e5971d14724e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd050cadeb3944ff8371718eebc2fbbb', 'request_id': 'req-50bd33bf-07a7-4a11-b23a-e5971d14724e'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:27.634071 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-50bd33bf-07a7-4a11-b23a-e5971d14724e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd050cadeb3944ff8371718eebc2fbbb', 'request_id': 'req-50bd33bf-07a7-4a11-b23a-e5971d14724e'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:27.646634 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-50bd33bf-07a7-4a11-b23a-e5971d14724e admin admin] The token cache is being invalidate because project bd050cadeb3944ff8371718eebc2fbbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:43:27.646924 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-50bd33bf-07a7-4a11-b23a-e5971d14724e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:27.647657 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-50bd33bf-07a7-4a11-b23a-e5971d14724e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:27.649199 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1422/2858] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:43:27 2022] DELETE /identity/v3/projects/bd050cadeb3944ff8371718eebc2fbbb => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:43:27.655295 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cda45a-18cf-466c-8cdc-8dac64c41347 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:27.655848 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cda45a-18cf-466c-8cdc-8dac64c41347 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:27.655985 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cda45a-18cf-466c-8cdc-8dac64c41347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:27.674275 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-66cda45a-18cf-466c-8cdc-8dac64c41347 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:43:27.675535 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-66cda45a-18cf-466c-8cdc-8dac64c41347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:43:27.742581 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1437/2859] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:43:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:43:27.751061 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b6817-8068-47e9-84cd-6432e0785073 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:27.751359 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b6817-8068-47e9-84cd-6432e0785073 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:27.751671 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b6817-8068-47e9-84cd-6432e0785073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:27.770935 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-2b1b6817-8068-47e9-84cd-6432e0785073 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:43:27.772191 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-2b1b6817-8068-47e9-84cd-6432e0785073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:43:27.780482 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1423/2860] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:43:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:43:27.784818 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cda45a-18cf-466c-8cdc-8dac64c41347 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:27.795746 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cda45a-18cf-466c-8cdc-8dac64c41347 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:27.800551 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78c64c-589a-46fc-b8d9-db4439c21d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:27.801211 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78c64c-589a-46fc-b8d9-db4439c21d5d admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:27.801493 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78c64c-589a-46fc-b8d9-db4439c21d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:27.801828 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78c64c-589a-46fc-b8d9-db4439c21d5d admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:27.802569 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab78c64c-589a-46fc-b8d9-db4439c21d5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:43:27.802883 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab78c64c-589a-46fc-b8d9-db4439c21d5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:27.805291 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab78c64c-589a-46fc-b8d9-db4439c21d5d admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:27.817688 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1438/2861] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:43:27.824567 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1b6817-8068-47e9-84cd-6432e0785073 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:27.834713 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1b6817-8068-47e9-84cd-6432e0785073 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:27.839837 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab6abbd-be35-42b2-ae44-eb0614b2f45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:27.840547 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6abbd-be35-42b2-ae44-eb0614b2f45a admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:27.840831 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6abbd-be35-42b2-ae44-eb0614b2f45a admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:27.841113 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6abbd-be35-42b2-ae44-eb0614b2f45a admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:27.841892 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab6abbd-be35-42b2-ae44-eb0614b2f45a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:27.844040 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab6abbd-be35-42b2-ae44-eb0614b2f45a admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:27.953145 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1424/2862] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:43:27 2022] POST /identity/v3/projects => generated 359 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:43:27.957592 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78c64c-589a-46fc-b8d9-db4439c21d5d admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:27.968420 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78c64c-589a-46fc-b8d9-db4439c21d5d admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:28.034689 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17f2c3-6011-43c9-a39e-5a2a3c1ed77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:28.035287 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17f2c3-6011-43c9-a39e-5a2a3c1ed77e admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:28.035610 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17f2c3-6011-43c9-a39e-5a2a3c1ed77e admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:28.035894 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17f2c3-6011-43c9-a39e-5a2a3c1ed77e admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:28.036595 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b17f2c3-6011-43c9-a39e-5a2a3c1ed77e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:28.039086 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b17f2c3-6011-43c9-a39e-5a2a3c1ed77e admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:28.140424 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1439/2863] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:43:27 2022] POST /identity/v3/users => generated 280 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:43:28.144639 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab6abbd-be35-42b2-ae44-eb0614b2f45a admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:28.155320 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab6abbd-be35-42b2-ae44-eb0614b2f45a admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:28.158352 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:43:28.162380 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c019b1-8482-4d92-9175-c53f96afa0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:28.166193 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c019b1-8482-4d92-9175-c53f96afa0fe admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:28.166193 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c019b1-8482-4d92-9175-c53f96afa0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:28.166193 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c019b1-8482-4d92-9175-c53f96afa0fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:28.166193 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c019b1-8482-4d92-9175-c53f96afa0fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:28.167176 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c019b1-8482-4d92-9175-c53f96afa0fe admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:28.179334 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1425/2864] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:43:28.183481 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17f2c3-6011-43c9-a39e-5a2a3c1ed77e admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:28.193882 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17f2c3-6011-43c9-a39e-5a2a3c1ed77e admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:28.199528 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f20fe-e7bd-48f2-a8b1-80c46b083213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:28.200229 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f20fe-e7bd-48f2-a8b1-80c46b083213 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:28.200519 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f20fe-e7bd-48f2-a8b1-80c46b083213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:28.200800 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f20fe-e7bd-48f2-a8b1-80c46b083213 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:28.201526 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f20fe-e7bd-48f2-a8b1-80c46b083213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:28.203301 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f20fe-e7bd-48f2-a8b1-80c46b083213 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:28.215426 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1440/2865] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:43:28.232086 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c019b1-8482-4d92-9175-c53f96afa0fe admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:28.242619 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c019b1-8482-4d92-9175-c53f96afa0fe admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:28.247278 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f65a2d-2ad5-4dd5-8941-031e13cd5d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:28.248212 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f65a2d-2ad5-4dd5-8941-031e13cd5d51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:28.248494 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f65a2d-2ad5-4dd5-8941-031e13cd5d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:28.248771 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f65a2d-2ad5-4dd5-8941-031e13cd5d51 admin admin] PATH_INFO: `/v3/projects/f2d96f8020a747c796ce471766338f40/users/be4d750f8895446191169b1ea0cd691a/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:28.249586 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:43:28.263673 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f65a2d-2ad5-4dd5-8941-031e13cd5d51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2d96f8020a747c796ce471766338f40, user_id=be4d750f8895446191169b1ea0cd691a, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:28.266399 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f65a2d-2ad5-4dd5-8941-031e13cd5d51 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:28.341618 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1426/2866] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:43:28 2022] PUT /identity/v3/projects/f2d96f8020a747c796ce471766338f40/users/be4d750f8895446191169b1ea0cd691a/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:43:28.408413 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a125e8f-75c7-4725-8467-a7c9729ff6fb None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:28.409922 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a125e8f-75c7-4725-8467-a7c9729ff6fb None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:28.409922 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a125e8f-75c7-4725-8467-a7c9729ff6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:28.441041 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-4a125e8f-75c7-4725-8467-a7c9729ff6fb None None] MFA Rules not processed for user `be4d750f8895446191169b1ea0cd691a`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:43:28.442264 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-4a125e8f-75c7-4725-8467-a7c9729ff6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:43:28.508623 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1441/2867] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:43:28 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:43:28.542098 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f65a2d-2ad5-4dd5-8941-031e13cd5d51 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:28.543901 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-24f65a2d-2ad5-4dd5-8941-031e13cd5d51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:43:28.604200 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f65a2d-2ad5-4dd5-8941-031e13cd5d51 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:28.608003 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a411b5c3-e9f3-4aaf-a20c-93dc96175801 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:28.608657 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411b5c3-e9f3-4aaf-a20c-93dc96175801 service cinder] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:28.608941 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411b5c3-e9f3-4aaf-a20c-93dc96175801 service cinder] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:28.609213 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411b5c3-e9f3-4aaf-a20c-93dc96175801 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:28.618348 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a411b5c3-e9f3-4aaf-a20c-93dc96175801 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:28.619895 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a411b5c3-e9f3-4aaf-a20c-93dc96175801 service cinder] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:28.629480 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1427/2868] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:43:28 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:43:28.643950 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a125e8f-75c7-4725-8467-a7c9729ff6fb None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:28.715339 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a125e8f-75c7-4725-8467-a7c9729ff6fb None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:28.720042 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefe045-5758-448b-81ac-5f1030d6d83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:28.721016 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefe045-5758-448b-81ac-5f1030d6d83e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:28.721304 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefe045-5758-448b-81ac-5f1030d6d83e admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:28.721590 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefe045-5758-448b-81ac-5f1030d6d83e admin admin] PATH_INFO: `/v3/users/be4d750f8895446191169b1ea0cd691a` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:28.722976 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeefe045-5758-448b-81ac-5f1030d6d83e admin admin] RBAC: Authorizing `identity:delete_user(user_id=be4d750f8895446191169b1ea0cd691a)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:28.724932 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeefe045-5758-448b-81ac-5f1030d6d83e admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:28.781148 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:43:28.887678 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:43:28.892679 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-eeefe045-5758-448b-81ac-5f1030d6d83e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be4d750f8895446191169b1ea0cd691a'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:28.940280 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-eeefe045-5758-448b-81ac-5f1030d6d83e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be4d750f8895446191169b1ea0cd691a'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:28.940911 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-eeefe045-5758-448b-81ac-5f1030d6d83e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be4d750f8895446191169b1ea0cd691a'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:28.949717 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-eeefe045-5758-448b-81ac-5f1030d6d83e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be4d750f8895446191169b1ea0cd691a'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:28.962167 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-eeefe045-5758-448b-81ac-5f1030d6d83e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be4d750f8895446191169b1ea0cd691a'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:28.968212 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1442/2869] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:43:28 2022] DELETE /identity/v3/users/be4d750f8895446191169b1ea0cd691a => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:43:28.972791 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd522d4-9e09-45b7-b69e-6ab4a94e86d8 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:28.973083 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd522d4-9e09-45b7-b69e-6ab4a94e86d8 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:28.973363 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd522d4-9e09-45b7-b69e-6ab4a94e86d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:28.994623 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-cdd522d4-9e09-45b7-b69e-6ab4a94e86d8 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:43:28.995858 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-cdd522d4-9e09-45b7-b69e-6ab4a94e86d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:43:29.060377 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1428/2870] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:43:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:43:29.070750 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefe045-5758-448b-81ac-5f1030d6d83e admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:29.072472 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-eeefe045-5758-448b-81ac-5f1030d6d83e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:43:29.134399 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefe045-5758-448b-81ac-5f1030d6d83e admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:29.147126 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b55311-820d-468b-874f-351e17284f02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:29.147126 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b55311-820d-468b-874f-351e17284f02 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:29.147126 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b55311-820d-468b-874f-351e17284f02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:29.147126 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b55311-820d-468b-874f-351e17284f02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:29.149495 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b55311-820d-468b-874f-351e17284f02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:29.150944 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b55311-820d-468b-874f-351e17284f02 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:29.160857 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1443/2871] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:43:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:43:29.599090 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd522d4-9e09-45b7-b69e-6ab4a94e86d8 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:29.601208 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-cdd522d4-9e09-45b7-b69e-6ab4a94e86d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:43:29.624304 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd522d4-9e09-45b7-b69e-6ab4a94e86d8 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:29.629712 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f815a0-3f00-44f5-855a-d570548cfee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:29.630661 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f815a0-3f00-44f5-855a-d570548cfee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:29.630952 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f815a0-3f00-44f5-855a-d570548cfee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:29.631237 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f815a0-3f00-44f5-855a-d570548cfee3 admin admin] PATH_INFO: `/v3/projects/f2d96f8020a747c796ce471766338f40` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:29.633094 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f815a0-3f00-44f5-855a-d570548cfee3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2d96f8020a747c796ce471766338f40)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:29.635049 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f815a0-3f00-44f5-855a-d570548cfee3 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:29.788952 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-d8f815a0-3f00-44f5-855a-d570548cfee3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2d96f8020a747c796ce471766338f40', 'request_id': 'req-d8f815a0-3f00-44f5-855a-d570548cfee3'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:29.855069 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-d8f815a0-3f00-44f5-855a-d570548cfee3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2d96f8020a747c796ce471766338f40', 'request_id': 'req-d8f815a0-3f00-44f5-855a-d570548cfee3'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:29.861230 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-d8f815a0-3f00-44f5-855a-d570548cfee3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2d96f8020a747c796ce471766338f40', 'request_id': 'req-d8f815a0-3f00-44f5-855a-d570548cfee3'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:29.873297 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-d8f815a0-3f00-44f5-855a-d570548cfee3 admin admin] The token cache is being invalidate because project f2d96f8020a747c796ce471766338f40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:43:29.873606 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-d8f815a0-3f00-44f5-855a-d570548cfee3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:29.874447 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-d8f815a0-3f00-44f5-855a-d570548cfee3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:43:29.876036 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1429/2872] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:43:29 2022] DELETE /identity/v3/projects/f2d96f8020a747c796ce471766338f40 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:43:29.883153 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528d040-e254-4261-aaab-132900df1f5a None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:29.883746 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528d040-e254-4261-aaab-132900df1f5a None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:29.883849 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528d040-e254-4261-aaab-132900df1f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:29.902882 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-4528d040-e254-4261-aaab-132900df1f5a None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:43:29.904145 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-4528d040-e254-4261-aaab-132900df1f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:43:29.967525 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1444/2873] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:43:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:43:29.976691 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd15e2-661d-4ce8-a5e9-9e8e988b3d77 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:29.977116 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd15e2-661d-4ce8-a5e9-9e8e988b3d77 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:29.977411 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd15e2-661d-4ce8-a5e9-9e8e988b3d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:29.996395 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-7ffd15e2-661d-4ce8-a5e9-9e8e988b3d77 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:43:29.997771 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-7ffd15e2-661d-4ce8-a5e9-9e8e988b3d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:43:30.006205 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1430/2874] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:43:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:43:30.010637 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528d040-e254-4261-aaab-132900df1f5a None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:30.020693 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528d040-e254-4261-aaab-132900df1f5a None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:30.026147 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767f776-20f2-410b-80b2-b6df553c6e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:30.026812 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767f776-20f2-410b-80b2-b6df553c6e7d admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:30.027131 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767f776-20f2-410b-80b2-b6df553c6e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:30.027411 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767f776-20f2-410b-80b2-b6df553c6e7d admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:30.028171 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767f776-20f2-410b-80b2-b6df553c6e7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 19:43:30.028479 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767f776-20f2-410b-80b2-b6df553c6e7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:30.030168 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767f776-20f2-410b-80b2-b6df553c6e7d admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:30.045857 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1445/2875] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Jul 21 19:43:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 19:43:30.048034 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd15e2-661d-4ce8-a5e9-9e8e988b3d77 None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:30.057719 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd15e2-661d-4ce8-a5e9-9e8e988b3d77 None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:30.062450 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf8a3d-8019-4de8-9290-53e147c3decb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:30.063107 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf8a3d-8019-4de8-9290-53e147c3decb admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:30.063390 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf8a3d-8019-4de8-9290-53e147c3decb admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:30.063736 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf8a3d-8019-4de8-9290-53e147c3decb admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:30.064430 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadf8a3d-8019-4de8-9290-53e147c3decb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:30.066330 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadf8a3d-8019-4de8-9290-53e147c3decb admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:30.159449 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1431/2876] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:43:30 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:43:30.163732 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767f776-20f2-410b-80b2-b6df553c6e7d admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:30.174351 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767f776-20f2-410b-80b2-b6df553c6e7d admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:30.221041 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:43:30.233044 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6fe1d-32b4-4a04-a4f0-ff2dd69478d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:30.233702 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6fe1d-32b4-4a04-a4f0-ff2dd69478d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:30.234331 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6fe1d-32b4-4a04-a4f0-ff2dd69478d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:30.234331 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6fe1d-32b4-4a04-a4f0-ff2dd69478d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:30.234925 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca6fe1d-32b4-4a04-a4f0-ff2dd69478d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:30.236870 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca6fe1d-32b4-4a04-a4f0-ff2dd69478d4 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:30.336717 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1446/2877] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:43:30 2022] POST /identity/v3/users => generated 287 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 19:43:30.339159 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf8a3d-8019-4de8-9290-53e147c3decb admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:30.350633 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf8a3d-8019-4de8-9290-53e147c3decb admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:30.355485 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a99157-2835-4da8-a751-a9080882b664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:30.356230 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a99157-2835-4da8-a751-a9080882b664 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:30.356444 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a99157-2835-4da8-a751-a9080882b664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:30.356709 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a99157-2835-4da8-a751-a9080882b664 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:30.357444 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a99157-2835-4da8-a751-a9080882b664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:30.359051 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a99157-2835-4da8-a751-a9080882b664 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:30.379706 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1432/2878] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:43:30.384747 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6fe1d-32b4-4a04-a4f0-ff2dd69478d4 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:30.395104 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6fe1d-32b4-4a04-a4f0-ff2dd69478d4 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:30.400621 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e528c8e-2030-4bb4-9342-f7741a03b62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:30.401298 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e528c8e-2030-4bb4-9342-f7741a03b62f admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:30.401584 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e528c8e-2030-4bb4-9342-f7741a03b62f admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:30.401890 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e528c8e-2030-4bb4-9342-f7741a03b62f admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:30.402606 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e528c8e-2030-4bb4-9342-f7741a03b62f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:30.404250 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e528c8e-2030-4bb4-9342-f7741a03b62f admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:30.415717 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1447/2879] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:43:30.424374 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a99157-2835-4da8-a751-a9080882b664 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:30.433381 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a99157-2835-4da8-a751-a9080882b664 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:30.439262 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864add2-cd42-49e1-935d-8c1566e2dbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:30.440197 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864add2-cd42-49e1-935d-8c1566e2dbd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:30.440481 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864add2-cd42-49e1-935d-8c1566e2dbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:30.440757 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864add2-cd42-49e1-935d-8c1566e2dbd8 admin admin] PATH_INFO: `/v3/projects/3c03108bc2df41c989a42d20f19d96dd/users/b6588b1d9bb54c48aeed8976f1512851/roles/0af30c087b3541a4847d708dd68464d6` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:30.445014 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:43:30.457920 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864add2-cd42-49e1-935d-8c1566e2dbd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c03108bc2df41c989a42d20f19d96dd, user_id=b6588b1d9bb54c48aeed8976f1512851, role_id=0af30c087b3541a4847d708dd68464d6)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:30.459913 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864add2-cd42-49e1-935d-8c1566e2dbd8 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:30.564290 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1433/2880] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:43:30 2022] PUT /identity/v3/projects/3c03108bc2df41c989a42d20f19d96dd/users/b6588b1d9bb54c48aeed8976f1512851/roles/0af30c087b3541a4847d708dd68464d6 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:43:30.568807 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19769cf-c065-4aad-b230-c1713a76ca49 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:30.569781 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19769cf-c065-4aad-b230-c1713a76ca49 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:30.570111 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19769cf-c065-4aad-b230-c1713a76ca49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:30.587932 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-a19769cf-c065-4aad-b230-c1713a76ca49 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:43:30.589138 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-a19769cf-c065-4aad-b230-c1713a76ca49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:43:30.650577 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1448/2881] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:43:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:43:30.660731 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864add2-cd42-49e1-935d-8c1566e2dbd8 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:30.664133 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-a864add2-cd42-49e1-935d-8c1566e2dbd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:43:30.721327 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864add2-cd42-49e1-935d-8c1566e2dbd8 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:30.725029 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d45421-2284-4ccb-a76b-96e9db3c4c86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:30.725770 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d45421-2284-4ccb-a76b-96e9db3c4c86 service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:30.726058 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d45421-2284-4ccb-a76b-96e9db3c4c86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:30.726335 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d45421-2284-4ccb-a76b-96e9db3c4c86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:30.735688 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d45421-2284-4ccb-a76b-96e9db3c4c86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:30.737120 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d45421-2284-4ccb-a76b-96e9db3c4c86 service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:30.747045 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1434/2882] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:43:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:43:31.270586 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be3191-eb68-4c7f-97ea-96c5bb603c44 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:31.271148 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be3191-eb68-4c7f-97ea-96c5bb603c44 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:31.271148 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be3191-eb68-4c7f-97ea-96c5bb603c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:31.290855 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-b6be3191-eb68-4c7f-97ea-96c5bb603c44 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:43:31.292152 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-b6be3191-eb68-4c7f-97ea-96c5bb603c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:43:31.301762 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1449/2883] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Jul 21 19:43:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:43:31.317137 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d45421-2284-4ccb-a76b-96e9db3c4c86 service neutron] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:31.318736 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-64d45421-2284-4ccb-a76b-96e9db3c4c86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:43:31.417247 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d45421-2284-4ccb-a76b-96e9db3c4c86 service neutron] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:31.431004 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb7889-c03b-4dee-9013-26bf5518c844 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:31.432827 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb7889-c03b-4dee-9013-26bf5518c844 service nova] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:31.432827 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb7889-c03b-4dee-9013-26bf5518c844 service nova] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:31.432827 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb7889-c03b-4dee-9013-26bf5518c844 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:31.441484 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bb7889-c03b-4dee-9013-26bf5518c844 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:31.443176 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bb7889-c03b-4dee-9013-26bf5518c844 service nova] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:31.454094 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1435/2884] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:43:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:43:34.745910 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798ccec-b9da-4aa6-b4eb-8e60b9bf6b65 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:34.746468 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798ccec-b9da-4aa6-b4eb-8e60b9bf6b65 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:34.746468 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798ccec-b9da-4aa6-b4eb-8e60b9bf6b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:34.770240 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-2798ccec-b9da-4aa6-b4eb-8e60b9bf6b65 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:43:34.771949 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-2798ccec-b9da-4aa6-b4eb-8e60b9bf6b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:43:34.782655 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1450/2885] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Jul 21 19:43:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:43:34.797059 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb7889-c03b-4dee-9013-26bf5518c844 service nova] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:34.799805 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-00bb7889-c03b-4dee-9013-26bf5518c844 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:43:34.829476 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb7889-c03b-4dee-9013-26bf5518c844 service nova] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:34.838462 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e4955-e596-4e3e-acfb-9546e1601ecf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:34.840024 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e4955-e596-4e3e-acfb-9546e1601ecf service nova] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:34.840315 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e4955-e596-4e3e-acfb-9546e1601ecf service nova] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:34.840657 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e4955-e596-4e3e-acfb-9546e1601ecf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:34.855097 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e4955-e596-4e3e-acfb-9546e1601ecf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:34.856774 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e4955-e596-4e3e-acfb-9546e1601ecf service nova] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:34.870532 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1436/2886] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:43:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:43:36.086628 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99531b26-2c5e-4177-bbcf-07d6942eafba None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:36.087201 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99531b26-2c5e-4177-bbcf-07d6942eafba None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:36.087201 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99531b26-2c5e-4177-bbcf-07d6942eafba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:36.115065 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-99531b26-2c5e-4177-bbcf-07d6942eafba None None] MFA Rules not processed for user `b6588b1d9bb54c48aeed8976f1512851`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:43:36.116458 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-99531b26-2c5e-4177-bbcf-07d6942eafba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:43:36.193032 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1451/2887] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:43:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:43:36.198281 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e4955-e596-4e3e-acfb-9546e1601ecf service nova] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:36.208676 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e4955-e596-4e3e-acfb-9546e1601ecf service nova] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:36.214660 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b9899-42e8-43a7-bed4-47d091a942e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:36.215346 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b9899-42e8-43a7-bed4-47d091a942e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:36.215836 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b9899-42e8-43a7-bed4-47d091a942e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:36.216128 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b9899-42e8-43a7-bed4-47d091a942e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:36.217001 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3b9899-42e8-43a7-bed4-47d091a942e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:36.218963 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3b9899-42e8-43a7-bed4-47d091a942e0 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:36.331366 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1437/2888] 10.222.0.60 () {60 vars in 1152 bytes} [Thu Jul 21 19:43:36 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 19:43:36.336400 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99531b26-2c5e-4177-bbcf-07d6942eafba None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:36.348021 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99531b26-2c5e-4177-bbcf-07d6942eafba None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:36.516873 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:43:36.532552 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215361d7-2f0f-4913-928a-cbae761e9bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:36.533235 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215361d7-2f0f-4913-928a-cbae761e9bb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:36.533534 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215361d7-2f0f-4913-928a-cbae761e9bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:36.533815 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215361d7-2f0f-4913-928a-cbae761e9bb3 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:36.534650 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215361d7-2f0f-4913-928a-cbae761e9bb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:36.536786 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215361d7-2f0f-4913-928a-cbae761e9bb3 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:36.638221 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1452/2889] 10.222.0.60 () {60 vars in 1143 bytes} [Thu Jul 21 19:43:36 2022] POST /identity/v3/users => generated 293 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 19:43:36.642360 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b9899-42e8-43a7-bed4-47d091a942e0 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:36.652748 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b9899-42e8-43a7-bed4-47d091a942e0 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:36.657227 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7e6a2-390d-4105-bf31-59be69265e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:36.657881 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7e6a2-390d-4105-bf31-59be69265e1e admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:36.658163 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7e6a2-390d-4105-bf31-59be69265e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:36.658436 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7e6a2-390d-4105-bf31-59be69265e1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:36.659188 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a7e6a2-390d-4105-bf31-59be69265e1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:36.660880 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a7e6a2-390d-4105-bf31-59be69265e1e admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:36.670874 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1438/2890] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:43:36.674960 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215361d7-2f0f-4913-928a-cbae761e9bb3 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:36.685954 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215361d7-2f0f-4913-928a-cbae761e9bb3 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:36.690683 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a14011-0fec-46c0-beb1-3fc7039930aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:36.691594 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a14011-0fec-46c0-beb1-3fc7039930aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:36.691880 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a14011-0fec-46c0-beb1-3fc7039930aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:36.692157 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a14011-0fec-46c0-beb1-3fc7039930aa admin admin] PATH_INFO: `/v3/projects/1523a20db3e54de68c156e3b44e6e45c/users/1771ce041d714db3abccbdaa6144da36/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:36.708968 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a14011-0fec-46c0-beb1-3fc7039930aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1523a20db3e54de68c156e3b44e6e45c, user_id=1771ce041d714db3abccbdaa6144da36, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:36.711731 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a14011-0fec-46c0-beb1-3fc7039930aa admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:36.815121 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1453/2891] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:43:36 2022] PUT /identity/v3/projects/1523a20db3e54de68c156e3b44e6e45c/users/1771ce041d714db3abccbdaa6144da36/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:43:36.819225 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7e6a2-390d-4105-bf31-59be69265e1e admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:36.832448 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7e6a2-390d-4105-bf31-59be69265e1e admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:36.843923 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:43:36.889370 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779ed80-d67e-431a-a9b8-512690ebef18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:36.890036 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779ed80-d67e-431a-a9b8-512690ebef18 admin admin] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:36.890321 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779ed80-d67e-431a-a9b8-512690ebef18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:36.890595 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779ed80-d67e-431a-a9b8-512690ebef18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:36.891301 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779ed80-d67e-431a-a9b8-512690ebef18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:36.893063 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779ed80-d67e-431a-a9b8-512690ebef18 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:36.908496 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a14011-0fec-46c0-beb1-3fc7039930aa admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:36.909761 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1439/2892] 10.222.0.60 () {58 vars in 1121 bytes} [Thu Jul 21 19:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 19:43:36.919719 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a14011-0fec-46c0-beb1-3fc7039930aa admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:36.924645 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cd4a0-bc87-4f21-ba09-3ce5255c45bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:36.925523 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cd4a0-bc87-4f21-ba09-3ce5255c45bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:36.925804 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cd4a0-bc87-4f21-ba09-3ce5255c45bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:36.926077 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cd4a0-bc87-4f21-ba09-3ce5255c45bf admin admin] PATH_INFO: `/v3/projects/1523a20db3e54de68c156e3b44e6e45c/users/1771ce041d714db3abccbdaa6144da36/roles/685e18230e1744c581baaf842d0fd4ca` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:36.928112 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362cd4a0-bc87-4f21-ba09-3ce5255c45bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1523a20db3e54de68c156e3b44e6e45c, user_id=1771ce041d714db3abccbdaa6144da36, role_id=685e18230e1744c581baaf842d0fd4ca)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:36.931522 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362cd4a0-bc87-4f21-ba09-3ce5255c45bf admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:36.941737 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1454/2893] 10.222.0.60 () {60 vars in 1482 bytes} [Thu Jul 21 19:43:36 2022] PUT /identity/v3/projects/1523a20db3e54de68c156e3b44e6e45c/users/1771ce041d714db3abccbdaa6144da36/roles/685e18230e1744c581baaf842d0fd4ca => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 19:43:39.733225 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecdbe2-e119-4357-9284-bff5dfb34d49 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:39.733702 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecdbe2-e119-4357-9284-bff5dfb34d49 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:39.734072 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecdbe2-e119-4357-9284-bff5dfb34d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:39.782955 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-88ecdbe2-e119-4357-9284-bff5dfb34d49 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:43:39.789563 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-88ecdbe2-e119-4357-9284-bff5dfb34d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:43:39.917066 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1440/2894] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Jul 21 19:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:43:39.953011 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cd4a0-bc87-4f21-ba09-3ce5255c45bf admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:40.074075 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cd4a0-bc87-4f21-ba09-3ce5255c45bf admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:40.080173 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc986b5c-51c8-4745-809a-6db2ef27c49c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:40.084354 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc986b5c-51c8-4745-809a-6db2ef27c49c service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:40.084354 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc986b5c-51c8-4745-809a-6db2ef27c49c service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:40.084354 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc986b5c-51c8-4745-809a-6db2ef27c49c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:40.091647 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc986b5c-51c8-4745-809a-6db2ef27c49c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:40.093554 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc986b5c-51c8-4745-809a-6db2ef27c49c service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:40.106411 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1455/2895] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:43:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:43:42.695743 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f712ff-395f-45d5-b2b0-0c7c88dedf0c None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:42.696560 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f712ff-395f-45d5-b2b0-0c7c88dedf0c None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:42.696560 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f712ff-395f-45d5-b2b0-0c7c88dedf0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:42.726809 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-85f712ff-395f-45d5-b2b0-0c7c88dedf0c None None] MFA Rules not processed for user `1771ce041d714db3abccbdaa6144da36`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:43:42.728061 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-85f712ff-395f-45d5-b2b0-0c7c88dedf0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:43:42.800769 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1441/2896] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:43:42 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:43:42.816024 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc986b5c-51c8-4745-809a-6db2ef27c49c service nova] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:42.829057 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc986b5c-51c8-4745-809a-6db2ef27c49c service nova] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:42.835690 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f250e4-c2fe-47d1-a807-9167dd62cc16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:42.836351 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f250e4-c2fe-47d1-a807-9167dd62cc16 service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:42.836632 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f250e4-c2fe-47d1-a807-9167dd62cc16 service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:42.836906 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f250e4-c2fe-47d1-a807-9167dd62cc16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:42.902319 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f250e4-c2fe-47d1-a807-9167dd62cc16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:42.903846 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f250e4-c2fe-47d1-a807-9167dd62cc16 service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:42.914411 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1456/2897] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:43:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:43:43.045852 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70de1e1-0020-42e3-8bbf-c20e5a37be77 None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:43.046381 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70de1e1-0020-42e3-8bbf-c20e5a37be77 None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:43.046835 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70de1e1-0020-42e3-8bbf-c20e5a37be77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:43.067592 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-b70de1e1-0020-42e3-8bbf-c20e5a37be77 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:43:43.069322 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-b70de1e1-0020-42e3-8bbf-c20e5a37be77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:43:43.077605 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1442/2898] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Jul 21 19:43:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 19:43:43.093435 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f250e4-c2fe-47d1-a807-9167dd62cc16 service nova] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:43.105418 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f250e4-c2fe-47d1-a807-9167dd62cc16 service nova] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:43.110890 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f4d844-1026-4a6b-b574-6584f4db1996 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:43.111563 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4d844-1026-4a6b-b574-6584f4db1996 service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:43.111838 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4d844-1026-4a6b-b574-6584f4db1996 service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:43.112117 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4d844-1026-4a6b-b574-6584f4db1996 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:43.121014 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f4d844-1026-4a6b-b574-6584f4db1996 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:43.122583 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f4d844-1026-4a6b-b574-6584f4db1996 service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:43.132043 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1457/2899] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:43:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:43:45.393915 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d51d1-8b95-4f1b-95f4-13da6f12ee1b None None] REQUEST_METHOD: `POST` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:45.394413 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d51d1-8b95-4f1b-95f4-13da6f12ee1b None None] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:45.394497 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d51d1-8b95-4f1b-95f4-13da6f12ee1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:45.416937 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.auth.core [None req-596d51d1-8b95-4f1b-95f4-13da6f12ee1b None None] MFA Rules not processed for user `b6588b1d9bb54c48aeed8976f1512851`. Rule list: `[]` (Enabled: `True`). {{(pid=80339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:43:45.418596 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-596d51d1-8b95-4f1b-95f4-13da6f12ee1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:43:45.426977 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1443/2900] 10.222.0.60 () {58 vars in 957 bytes} [Thu Jul 21 19:43:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:43:48.488652 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe4cb8-1c2a-4448-a1e8-a7cff5712793 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:48.489159 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe4cb8-1c2a-4448-a1e8-a7cff5712793 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:48.489281 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe4cb8-1c2a-4448-a1e8-a7cff5712793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:48.501705 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:43:48.508299 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-99fe4cb8-1c2a-4448-a1e8-a7cff5712793 None None] MFA Rules not processed for user `9e09a8e247ab497cad13b7109b21b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 19:43:48.509558 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-99fe4cb8-1c2a-4448-a1e8-a7cff5712793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:43:48.518258 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1458/2901] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Jul 21 19:43:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 19:43:48.535384 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d51d1-8b95-4f1b-95f4-13da6f12ee1b None None] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:48.549130 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d51d1-8b95-4f1b-95f4-13da6f12ee1b None None] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:48.554625 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5622ba-6caa-45ed-8038-d892b55439c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:48.555263 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5622ba-6caa-45ed-8038-d892b55439c2 service nova] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:48.557761 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5622ba-6caa-45ed-8038-d892b55439c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:48.557761 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5622ba-6caa-45ed-8038-d892b55439c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:48.564630 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5622ba-6caa-45ed-8038-d892b55439c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:48.566255 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5622ba-6caa-45ed-8038-d892b55439c2 service nova] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:48.576777 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1444/2902] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:43:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:43:51.619327 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe4cb8-1c2a-4448-a1e8-a7cff5712793 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:51.620959 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-99fe4cb8-1c2a-4448-a1e8-a7cff5712793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:43:51.678838 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe4cb8-1c2a-4448-a1e8-a7cff5712793 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:51.682685 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0785f20a-ffc5-4b2c-8bab-e241e862b367 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591016b95ab24d3a8de83089a141d914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:51.683394 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785f20a-ffc5-4b2c-8bab-e241e862b367 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:51.683704 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785f20a-ffc5-4b2c-8bab-e241e862b367 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:51.684059 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785f20a-ffc5-4b2c-8bab-e241e862b367 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:51.686019 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-0785f20a-ffc5-4b2c-8bab-e241e862b367 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:43:51.701041 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0785f20a-ffc5-4b2c-8bab-e241e862b367 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:51.702480 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0785f20a-ffc5-4b2c-8bab-e241e862b367 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:51.714163 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1459/2903] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:43:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:43:54.755890 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5622ba-6caa-45ed-8038-d892b55439c2 service nova] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:43:54.758230 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-6c5622ba-6caa-45ed-8038-d892b55439c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:43:54.772461 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=100 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:43:54.815887 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5622ba-6caa-45ed-8038-d892b55439c2 service nova] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:43:54.820239 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394731a0-b4d2-4b78-aba2-e754240c0419 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:43:54.821044 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394731a0-b4d2-4b78-aba2-e754240c0419 service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:43:54.822139 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394731a0-b4d2-4b78-aba2-e754240c0419 service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:43:54.822563 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394731a0-b4d2-4b78-aba2-e754240c0419 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:43:54.824569 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-394731a0-b4d2-4b78-aba2-e754240c0419 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:43:54.838806 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394731a0-b4d2-4b78-aba2-e754240c0419 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:43:54.840273 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394731a0-b4d2-4b78-aba2-e754240c0419 service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:43:54.851954 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1445/2904] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:43:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:44:01.708529 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=26 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:44:04.846215 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=20 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:44:13.933314 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0785f20a-ffc5-4b2c-8bab-e241e862b367 service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:44:13.943518 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0785f20a-ffc5-4b2c-8bab-e241e862b367 service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:44:13.948745 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7ee4d-460f-4b90-9f2f-33b5c662f598 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:44:13.949249 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7ee4d-460f-4b90-9f2f-33b5c662f598 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:44:13.949552 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7ee4d-460f-4b90-9f2f-33b5c662f598 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:44:13.950034 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7ee4d-460f-4b90-9f2f-33b5c662f598 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:44:13.960438 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d7ee4d-460f-4b90-9f2f-33b5c662f598 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:44:13.962054 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d7ee4d-460f-4b90-9f2f-33b5c662f598 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:44:13.973252 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1460/2905] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:44:13 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:44:16.183166 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394731a0-b4d2-4b78-aba2-e754240c0419 service neutron] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:44:16.192822 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394731a0-b4d2-4b78-aba2-e754240c0419 service neutron] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:44:16.197410 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9232007-8dec-46c7-8d7f-acc204268680 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:44:16.198020 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9232007-8dec-46c7-8d7f-acc204268680 service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:44:16.198485 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9232007-8dec-46c7-8d7f-acc204268680 service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:44:16.198861 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9232007-8dec-46c7-8d7f-acc204268680 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:44:16.200728 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-b9232007-8dec-46c7-8d7f-acc204268680 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:44:16.222357 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9232007-8dec-46c7-8d7f-acc204268680 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:44:16.224047 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9232007-8dec-46c7-8d7f-acc204268680 service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:44:16.236790 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1446/2906] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:44:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 19:44:20.723591 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7ee4d-460f-4b90-9f2f-33b5c662f598 service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:44:20.725065 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-c5d7ee4d-460f-4b90-9f2f-33b5c662f598 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:44:20.739834 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7ee4d-460f-4b90-9f2f-33b5c662f598 service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:44:20.744673 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df62f20-6ae3-4982-a0bb-c21fea37542a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:44:20.745587 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df62f20-6ae3-4982-a0bb-c21fea37542a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:44:20.745871 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df62f20-6ae3-4982-a0bb-c21fea37542a admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:44:20.746149 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df62f20-6ae3-4982-a0bb-c21fea37542a admin admin] PATH_INFO: `/v3/users/a82b2dc882994ef9bc7ffca3ff25e988` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:44:20.747324 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df62f20-6ae3-4982-a0bb-c21fea37542a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a82b2dc882994ef9bc7ffca3ff25e988)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:44:20.749262 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df62f20-6ae3-4982-a0bb-c21fea37542a admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:44:20.931100 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-6df62f20-6ae3-4982-a0bb-c21fea37542a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a82b2dc882994ef9bc7ffca3ff25e988'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:44:20.978935 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-6df62f20-6ae3-4982-a0bb-c21fea37542a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a82b2dc882994ef9bc7ffca3ff25e988'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:44:20.979662 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-6df62f20-6ae3-4982-a0bb-c21fea37542a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a82b2dc882994ef9bc7ffca3ff25e988'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:44:20.987177 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-6df62f20-6ae3-4982-a0bb-c21fea37542a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a82b2dc882994ef9bc7ffca3ff25e988'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:44:20.999388 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-6df62f20-6ae3-4982-a0bb-c21fea37542a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a82b2dc882994ef9bc7ffca3ff25e988'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:44:21.005393 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1461/2907] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:44:20 2022] DELETE /identity/v3/users/a82b2dc882994ef9bc7ffca3ff25e988 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:44:21.226845 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9232007-8dec-46c7-8d7f-acc204268680 service neutron] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:44:21.239228 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9232007-8dec-46c7-8d7f-acc204268680 service neutron] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:44:21.297689 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e992427-5197-4146-8cbe-4086e027cb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:44:21.298573 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e992427-5197-4146-8cbe-4086e027cb76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:44:21.298899 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e992427-5197-4146-8cbe-4086e027cb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:44:21.299250 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e992427-5197-4146-8cbe-4086e027cb76 admin admin] PATH_INFO: `/v3/projects/d0844843050f4081aa5e792b390dc13a` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:44:21.300544 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e992427-5197-4146-8cbe-4086e027cb76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0844843050f4081aa5e792b390dc13a)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:44:21.302465 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e992427-5197-4146-8cbe-4086e027cb76 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:44:21.397763 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-2e992427-5197-4146-8cbe-4086e027cb76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0844843050f4081aa5e792b390dc13a', 'request_id': 'req-2e992427-5197-4146-8cbe-4086e027cb76'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:44:21.448377 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-2e992427-5197-4146-8cbe-4086e027cb76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0844843050f4081aa5e792b390dc13a', 'request_id': 'req-2e992427-5197-4146-8cbe-4086e027cb76'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:44:21.454387 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-2e992427-5197-4146-8cbe-4086e027cb76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0844843050f4081aa5e792b390dc13a', 'request_id': 'req-2e992427-5197-4146-8cbe-4086e027cb76'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:44:21.466365 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-2e992427-5197-4146-8cbe-4086e027cb76 admin admin] The token cache is being invalidate because project d0844843050f4081aa5e792b390dc13a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:44:21.466657 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-2e992427-5197-4146-8cbe-4086e027cb76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:44:21.467287 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-2e992427-5197-4146-8cbe-4086e027cb76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:44:21.468840 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1447/2908] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:44:21 2022] DELETE /identity/v3/projects/d0844843050f4081aa5e792b390dc13a => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:44:31.001774 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=35,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:44:31.463310 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:46:24.313636 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df62f20-6ae3-4982-a0bb-c21fea37542a admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:46:24.315111 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-6df62f20-6ae3-4982-a0bb-c21fea37542a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:46:24.373412 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df62f20-6ae3-4982-a0bb-c21fea37542a admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:46:24.424090 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e672d-ad08-4e70-8605-a7d75679db68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:46:24.425028 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e672d-ad08-4e70-8605-a7d75679db68 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:46:24.425028 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e672d-ad08-4e70-8605-a7d75679db68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:46:24.425291 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e672d-ad08-4e70-8605-a7d75679db68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:46:24.427181 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-c31e672d-ad08-4e70-8605-a7d75679db68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:46:24.437359 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e672d-ad08-4e70-8605-a7d75679db68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:46:24.438794 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e672d-ad08-4e70-8605-a7d75679db68 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:46:24.446921 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1462/2909] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:46:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:46:24.747722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e992427-5197-4146-8cbe-4086e027cb76 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:46:24.749172 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-2e992427-5197-4146-8cbe-4086e027cb76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:46:24.762023 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e992427-5197-4146-8cbe-4086e027cb76 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:46:24.766022 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ff802-898b-4d6b-bd07-449cc475d3ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:46:24.770327 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ff802-898b-4d6b-bd07-449cc475d3ef service neutron] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:46:24.770327 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ff802-898b-4d6b-bd07-449cc475d3ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:46:24.770327 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ff802-898b-4d6b-bd07-449cc475d3ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:46:24.770327 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-8e8ff802-898b-4d6b-bd07-449cc475d3ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:46:24.779681 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ff802-898b-4d6b-bd07-449cc475d3ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:46:24.781197 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ff802-898b-4d6b-bd07-449cc475d3ef service neutron] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:46:24.789829 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1448/2910] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:46:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:46:24.879568 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e672d-ad08-4e70-8605-a7d75679db68 service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:46:24.889072 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e672d-ad08-4e70-8605-a7d75679db68 service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:46:24.892597 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59874b16-708a-4dba-9491-7c4d863847c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1908b2f87d5442da8ba826489cb2018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:46:24.893233 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59874b16-708a-4dba-9491-7c4d863847c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:46:24.893517 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59874b16-708a-4dba-9491-7c4d863847c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:46:24.893794 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59874b16-708a-4dba-9491-7c4d863847c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:46:24.895562 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-59874b16-708a-4dba-9491-7c4d863847c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:46:24.966154 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59874b16-708a-4dba-9491-7c4d863847c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:46:24.967622 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59874b16-708a-4dba-9491-7c4d863847c9 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:46:24.978685 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1463/2911] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:46:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:46:25.042845 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ff802-898b-4d6b-bd07-449cc475d3ef service neutron] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:46:25.044265 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-8e8ff802-898b-4d6b-bd07-449cc475d3ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:46:25.113425 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ff802-898b-4d6b-bd07-449cc475d3ef service neutron] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:46:25.119203 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c5e4a-6e35-49a2-937a-7666231cbf67 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcc5eefc2f7c419190e96b46b163fedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:46:25.119915 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c5e4a-6e35-49a2-937a-7666231cbf67 service placement] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:46:25.120200 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c5e4a-6e35-49a2-937a-7666231cbf67 service placement] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:46:25.120477 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c5e4a-6e35-49a2-937a-7666231cbf67 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:46:25.122233 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-c44c5e4a-6e35-49a2-937a-7666231cbf67 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:46:25.134105 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c5e4a-6e35-49a2-937a-7666231cbf67 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:46:25.135704 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c5e4a-6e35-49a2-937a-7666231cbf67 service placement] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:46:25.145554 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1449/2912] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:46:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:46:25.761961 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59874b16-708a-4dba-9491-7c4d863847c9 service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:46:25.763606 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-59874b16-708a-4dba-9491-7c4d863847c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:46:25.778181 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59874b16-708a-4dba-9491-7c4d863847c9 service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:46:25.783724 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08c089-6eba-4223-a164-5b2a6e17c309 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:46:25.784369 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08c089-6eba-4223-a164-5b2a6e17c309 service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:46:25.784656 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08c089-6eba-4223-a164-5b2a6e17c309 service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:46:25.784929 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08c089-6eba-4223-a164-5b2a6e17c309 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:46:25.787259 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3f08c089-6eba-4223-a164-5b2a6e17c309 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:46:25.799245 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f08c089-6eba-4223-a164-5b2a6e17c309 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:46:25.800847 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f08c089-6eba-4223-a164-5b2a6e17c309 service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:46:25.811805 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1464/2913] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:46:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:46:35.141295 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=38 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:46:35.807147 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=86 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:46:52.436684 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c5e4a-6e35-49a2-937a-7666231cbf67 service placement] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:46:52.447281 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c5e4a-6e35-49a2-937a-7666231cbf67 service placement] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:46:52.452715 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd4187-8485-49a9-bbaf-ba1ed19fb3cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcc5eefc2f7c419190e96b46b163fedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:46:52.453349 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd4187-8485-49a9-bbaf-ba1ed19fb3cc service placement] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:46:52.453634 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd4187-8485-49a9-bbaf-ba1ed19fb3cc service placement] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:46:52.453913 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd4187-8485-49a9-bbaf-ba1ed19fb3cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:46:52.455835 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-4ecd4187-8485-49a9-bbaf-ba1ed19fb3cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:46:52.467980 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd4187-8485-49a9-bbaf-ba1ed19fb3cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:46:52.469580 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd4187-8485-49a9-bbaf-ba1ed19fb3cc service placement] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:46:52.479784 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1450/2914] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:46:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:47:02.475413 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=6 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:47:44.695218 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08c089-6eba-4223-a164-5b2a6e17c309 service nova] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:47:44.697075 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3f08c089-6eba-4223-a164-5b2a6e17c309 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:47:44.713408 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08c089-6eba-4223-a164-5b2a6e17c309 service nova] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:47:44.719624 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f278039f-70c5-477f-b702-68316fdc57a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b4d98e967814e5f84f5f0d67ebb3c17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:47:44.720792 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278039f-70c5-477f-b702-68316fdc57a8 service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:47:44.721128 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278039f-70c5-477f-b702-68316fdc57a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:47:44.721412 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278039f-70c5-477f-b702-68316fdc57a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:47:44.724537 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f278039f-70c5-477f-b702-68316fdc57a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:47:44.737846 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f278039f-70c5-477f-b702-68316fdc57a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:47:44.740111 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f278039f-70c5-477f-b702-68316fdc57a8 service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:47:44.752260 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1465/2915] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:47:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:47:52.359342 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd4187-8485-49a9-bbaf-ba1ed19fb3cc service placement] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:47:52.370851 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd4187-8485-49a9-bbaf-ba1ed19fb3cc service placement] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:47:52.376987 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9badd-a294-4a34-988b-9b7ac1d8a948 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcc5eefc2f7c419190e96b46b163fedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:47:52.378415 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9badd-a294-4a34-988b-9b7ac1d8a948 service placement] REQUEST_METHOD: `GET` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:47:52.379088 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9badd-a294-4a34-988b-9b7ac1d8a948 service placement] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:47:52.379729 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9badd-a294-4a34-988b-9b7ac1d8a948 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:47:52.382124 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-efd9badd-a294-4a34-988b-9b7ac1d8a948 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:47:52.398773 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd9badd-a294-4a34-988b-9b7ac1d8a948 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:47:52.400383 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd9badd-a294-4a34-988b-9b7ac1d8a948 service placement] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:47:52.412672 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1451/2916] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:47:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:47:54.746961 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=6 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:47:56.132704 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f278039f-70c5-477f-b702-68316fdc57a8 service nova] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:47:56.134254 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f278039f-70c5-477f-b702-68316fdc57a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:47:56.201520 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f278039f-70c5-477f-b702-68316fdc57a8 service nova] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:47:56.206032 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e04e18-2446-48f3-b110-2587efd0569d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:47:56.207462 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e04e18-2446-48f3-b110-2587efd0569d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:47:56.207786 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e04e18-2446-48f3-b110-2587efd0569d admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:47:56.208070 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e04e18-2446-48f3-b110-2587efd0569d admin admin] PATH_INFO: `/v3/users/b6588b1d9bb54c48aeed8976f1512851` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:47:56.209337 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e04e18-2446-48f3-b110-2587efd0569d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6588b1d9bb54c48aeed8976f1512851)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:47:56.211258 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e04e18-2446-48f3-b110-2587efd0569d admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:47:56.384151 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-20e04e18-2446-48f3-b110-2587efd0569d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6588b1d9bb54c48aeed8976f1512851'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:47:56.467943 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-20e04e18-2446-48f3-b110-2587efd0569d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6588b1d9bb54c48aeed8976f1512851'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:47:56.468472 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-20e04e18-2446-48f3-b110-2587efd0569d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6588b1d9bb54c48aeed8976f1512851'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:47:56.476813 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-20e04e18-2446-48f3-b110-2587efd0569d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6588b1d9bb54c48aeed8976f1512851'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:47:56.489384 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-20e04e18-2446-48f3-b110-2587efd0569d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6588b1d9bb54c48aeed8976f1512851'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:47:56.495395 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1466/2917] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:47:56 2022] DELETE /identity/v3/users/b6588b1d9bb54c48aeed8976f1512851 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:47:56.732401 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9badd-a294-4a34-988b-9b7ac1d8a948 service placement] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:47:56.748722 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9badd-a294-4a34-988b-9b7ac1d8a948 service placement] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:47:56.812695 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c3d4b-4569-444e-9751-016e70115328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:47:56.813560 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c3d4b-4569-444e-9751-016e70115328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:47:56.813848 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c3d4b-4569-444e-9751-016e70115328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:47:56.814118 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c3d4b-4569-444e-9751-016e70115328 admin admin] PATH_INFO: `/v3/projects/3c03108bc2df41c989a42d20f19d96dd` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:47:56.815304 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566c3d4b-4569-444e-9751-016e70115328 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c03108bc2df41c989a42d20f19d96dd)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:47:56.817755 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566c3d4b-4569-444e-9751-016e70115328 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:47:56.930562 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-566c3d4b-4569-444e-9751-016e70115328 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c03108bc2df41c989a42d20f19d96dd', 'request_id': 'req-566c3d4b-4569-444e-9751-016e70115328'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:47:57.010569 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-566c3d4b-4569-444e-9751-016e70115328 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c03108bc2df41c989a42d20f19d96dd', 'request_id': 'req-566c3d4b-4569-444e-9751-016e70115328'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:47:57.016718 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-566c3d4b-4569-444e-9751-016e70115328 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c03108bc2df41c989a42d20f19d96dd', 'request_id': 'req-566c3d4b-4569-444e-9751-016e70115328'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:47:57.028346 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-566c3d4b-4569-444e-9751-016e70115328 admin admin] The token cache is being invalidate because project 3c03108bc2df41c989a42d20f19d96dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:47:57.028639 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-566c3d4b-4569-444e-9751-016e70115328 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:47:57.029320 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-566c3d4b-4569-444e-9751-016e70115328 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:47:57.030863 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1452/2918] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:47:56 2022] DELETE /identity/v3/projects/3c03108bc2df41c989a42d20f19d96dd => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:47:57.034991 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e04e18-2446-48f3-b110-2587efd0569d admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:47:57.036623 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-20e04e18-2446-48f3-b110-2587efd0569d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:47:57.049951 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e04e18-2446-48f3-b110-2587efd0569d admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:47:57.107142 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93dbbd5-980b-44bf-a689-8a63e86ab3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:47:57.108116 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93dbbd5-980b-44bf-a689-8a63e86ab3e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:47:57.108403 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93dbbd5-980b-44bf-a689-8a63e86ab3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:47:57.108680 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93dbbd5-980b-44bf-a689-8a63e86ab3e4 admin admin] PATH_INFO: `/v3/users/1771ce041d714db3abccbdaa6144da36` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:47:57.109948 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93dbbd5-980b-44bf-a689-8a63e86ab3e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1771ce041d714db3abccbdaa6144da36)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:47:57.111895 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93dbbd5-980b-44bf-a689-8a63e86ab3e4 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:47:57.135838 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:47:57.326652 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-a93dbbd5-980b-44bf-a689-8a63e86ab3e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1771ce041d714db3abccbdaa6144da36'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:47:57.415917 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-a93dbbd5-980b-44bf-a689-8a63e86ab3e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1771ce041d714db3abccbdaa6144da36'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:47:57.416571 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-a93dbbd5-980b-44bf-a689-8a63e86ab3e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1771ce041d714db3abccbdaa6144da36'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:47:57.429738 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-a93dbbd5-980b-44bf-a689-8a63e86ab3e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1771ce041d714db3abccbdaa6144da36'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:47:57.443965 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-a93dbbd5-980b-44bf-a689-8a63e86ab3e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1771ce041d714db3abccbdaa6144da36'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:47:57.450543 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1467/2919] 10.222.0.60 () {58 vars in 1223 bytes} [Thu Jul 21 19:47:57 2022] DELETE /identity/v3/users/1771ce041d714db3abccbdaa6144da36 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:47:57.714795 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c3d4b-4569-444e-9751-016e70115328 admin admin] Authenticating user token {{(pid=80339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:47:57.716765 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.fernet_utils [None req-566c3d4b-4569-444e-9751-016e70115328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:47:57.731171 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c3d4b-4569-444e-9751-016e70115328 admin admin] Validating token access rules against request {{(pid=80339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:47:57.789097 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09630ce7-4e27-43cf-94b5-05137d9c41d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e09a8e247ab497cad13b7109b21b1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15ec98f010f4039a43acd913bc93061', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:47:57.790021 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09630ce7-4e27-43cf-94b5-05137d9c41d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:47:57.790301 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09630ce7-4e27-43cf-94b5-05137d9c41d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:47:57.790576 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09630ce7-4e27-43cf-94b5-05137d9c41d3 admin admin] PATH_INFO: `/v3/projects/1523a20db3e54de68c156e3b44e6e45c` {{(pid=80339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:47:57.791788 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09630ce7-4e27-43cf-94b5-05137d9c41d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1523a20db3e54de68c156e3b44e6e45c)` {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:47:57.793664 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09630ce7-4e27-43cf-94b5-05137d9c41d3 admin admin] RBAC: Authorization granted {{(pid=80339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:47:57.814789 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:47:57.895841 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-09630ce7-4e27-43cf-94b5-05137d9c41d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1523a20db3e54de68c156e3b44e6e45c', 'request_id': 'req-09630ce7-4e27-43cf-94b5-05137d9c41d3'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:47:57.970100 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-09630ce7-4e27-43cf-94b5-05137d9c41d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1523a20db3e54de68c156e3b44e6e45c', 'request_id': 'req-09630ce7-4e27-43cf-94b5-05137d9c41d3'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:47:57.976544 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-09630ce7-4e27-43cf-94b5-05137d9c41d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1523a20db3e54de68c156e3b44e6e45c', 'request_id': 'req-09630ce7-4e27-43cf-94b5-05137d9c41d3'} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:47:57.987571 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-09630ce7-4e27-43cf-94b5-05137d9c41d3 admin admin] The token cache is being invalidate because project 1523a20db3e54de68c156e3b44e6e45c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 19:47:57.987861 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-09630ce7-4e27-43cf-94b5-05137d9c41d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:47:57.988483 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG keystone.notifications [None req-09630ce7-4e27-43cf-94b5-05137d9c41d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 19:47:57.990000 dv-cinder-749155-9-smb devstack@keystone.service[80339]: [pid: 80339|app: 0|req: 1453/2920] 10.222.0.60 () {58 vars in 1232 bytes} [Thu Jul 21 19:47:57 2022] DELETE /identity/v3/projects/1523a20db3e54de68c156e3b44e6e45c => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 19:48:07.446514 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:48:07.993469 dv-cinder-749155-9-smb devstack@keystone.service[80339]: DEBUG dbcounter [-] [80339] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 19:51:55.399565 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93dbbd5-980b-44bf-a689-8a63e86ab3e4 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 19:51:55.404857 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-a93dbbd5-980b-44bf-a689-8a63e86ab3e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:51:55.539327 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93dbbd5-980b-44bf-a689-8a63e86ab3e4 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 19:51:55.596564 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1df53-2e99-4c2d-9a5d-c207fbbc9519 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcc5eefc2f7c419190e96b46b163fedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9847b5e8bc0b4483bbce060a48f405f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 19:51:55.597204 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1df53-2e99-4c2d-9a5d-c207fbbc9519 service placement] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 19:51:55.597488 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1df53-2e99-4c2d-9a5d-c207fbbc9519 service placement] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 19:51:55.597766 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1df53-2e99-4c2d-9a5d-c207fbbc9519 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 19:51:55.599563 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-cff1df53-2e99-4c2d-9a5d-c207fbbc9519 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 19:51:55.610594 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff1df53-2e99-4c2d-9a5d-c207fbbc9519 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 19:51:55.612196 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff1df53-2e99-4c2d-9a5d-c207fbbc9519 service placement] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 19:51:55.622586 dv-cinder-749155-9-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1468/2921] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Jul 21 19:51:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 19:52:05.618415 dv-cinder-749155-9-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}